Hybrid Platform Software Engineer, Kubernetes

Posted 3 hours ago

Apply now

About the role

  • Platform Engineer responsible for building and managing Kubernetes platforms for Spark workloads at Comcast. Collaborating with data teams to ensure efficient data processing and cost optimization.

Responsibilities

  • Architecting and managing platforms where Spark runs, such as Kubernetes clusters or cloud services
  • Packaging Spark workloads and integrating with orchestration systems like Apache Flyte
  • Deploying Infrastructure via Terraform/Ansible
  • Troubleshooting job failures and execution anomalies
  • Optimizing Spark configurations to reduce costs
  • Building automation and tools in languages like Python, Java, or Scala
  • Writing medium to complex SQL Queries
  • Implementing monitoring systems for platform stability
  • Working closely with data engineers and scientists
  • Engaging with open-source communities to discuss technical challenges
  • Creating and maintaining documentation for Kubernetes infrastructure
  • Providing training and support to team members

Requirements

  • Bachelor's degree in computer science or a related field, or equivalent experience
  • Expertise in Apache Spark
  • Proficiency in Python, Pyspark, and Scala/Java
  • Proficient in Linux Scripting (Bash)
  • Proficient in writing SQL
  • Experience in CI/CD tools, Github
  • Experience in using observability tools like Prometheus, Grafana
  • Knowledge of networking concepts like TCP/IP, DNS, Load Balancer
  • Automation via Terraform/Ansible
  • Hands-on experience with cloud providers (AWS, Azure, GCP)
  • Familiarity with technologies like Delta Lake, Apache Iceberg, Apache Kafka, Hadoop
  • Strong analytical skills for debugging complex issues
  • Strong communication and collaboration abilities

Benefits

  • Health insurance
  • 401(k) matching
  • Flexible work hours
  • Paid time off
  • Remote work options

Job title

Platform Software Engineer, Kubernetes

Job type

Experience level

Mid levelSenior

Salary

$114,985 - $172,478 per year

Degree requirement

Bachelor's Degree

Location requirements

Report this job

See something inaccurate? Let us know and we'll update the listing.

Report job