Software Developer creating reliable software solutions supporting critical technology platforms at Cisco. Balancing software capabilities with hardware considerations and influencing design decisions.
About the role
- Platform Engineer responsible for building and managing Kubernetes platforms for Spark workloads at Comcast. Collaborating with data teams to ensure efficient data processing and cost optimization.
Responsibilities
- Architecting and managing platforms where Spark runs, such as Kubernetes clusters or cloud services
- Packaging Spark workloads and integrating with orchestration systems like Apache Flyte
- Deploying Infrastructure via Terraform/Ansible
- Troubleshooting job failures and execution anomalies
- Optimizing Spark configurations to reduce costs
- Building automation and tools in languages like Python, Java, or Scala
- Writing medium to complex SQL Queries
- Implementing monitoring systems for platform stability
- Working closely with data engineers and scientists
- Engaging with open-source communities to discuss technical challenges
- Creating and maintaining documentation for Kubernetes infrastructure
- Providing training and support to team members
Requirements
- Bachelor's degree in computer science or a related field, or equivalent experience
- Expertise in Apache Spark
- Proficiency in Python, Pyspark, and Scala/Java
- Proficient in Linux Scripting (Bash)
- Proficient in writing SQL
- Experience in CI/CD tools, Github
- Experience in using observability tools like Prometheus, Grafana
- Knowledge of networking concepts like TCP/IP, DNS, Load Balancer
- Automation via Terraform/Ansible
- Hands-on experience with cloud providers (AWS, Azure, GCP)
- Familiarity with technologies like Delta Lake, Apache Iceberg, Apache Kafka, Hadoop
- Strong analytical skills for debugging complex issues
- Strong communication and collaboration abilities
Benefits
- Health insurance
- 401(k) matching
- Flexible work hours
- Paid time off
- Remote work options
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Senior Linux System SW Engineer at 42dot developing and stabilizing embedded Linux systems in automotive environments. Focused on kernel, device driver development for various SoCs in hybrid workplaces.
Software Engineer Mobile Flutter at Technogym developing and maintaining device applications with focus on fitness and wellness sector. Collaborating with teams to innovate and improve lifestyle applications.
Senior Software Engineer developing software applications as part of a hybrid team. Requires extensive experience and collaboration within a development environment.
Principal Software Engineer supporting missile defense systems for Northrop Grumman. Collaborating on the C2BMC program to optimize security and system performance.
Lead Software Engineer developing AI solutions at Caterpillar Inc. focusing on Generative AI projects, collaborating with data scientists and deploying services on AWS.
Software Engineering Manager leading high - performing Salesforce teams delivering scalable solutions at Caterpillar. Driving modernization through CI/CD and innovative Salesforce practices.
Tech Lead leading technical team in developing innovative applications for Porto Bank's digital services. Focusing on high scalability and cloud - native solutions within AWS environment.
Senior Software Engineer designing scalable backend services for financial solutions at DailyPay. Leading architectural evolution and mentoring engineers while ensuring high - quality backend operations.
Software Engineer Intern at FireMon designing and building user - friendly firewall management solutions. Collaborating across agile teams to enhance security operations and customer value.