Hybrid Senior Data Engineer

at The Walt Disney Company

• Job title: Senior Data Engineer
• Job type: Full Time
• Experience level: Senior
• Salary: $141,900 - $190,300 per year
• Degree requirement: Bachelor's Degree
• Tech skills: Airflow, Amazon Redshift, Apache, AWS, BigQuery, Cloud, DynamoDB, GraphQL, Kubernetes, Python, Redis, Scala, Spark, SQL, Terraform, Go
• Location requirements: Hybrid, Santa Monica, United States

About the role

• Senior Data Engineer at Disney responsible for building solutions for data subject rights automation and privacy. Collaborating with analytics, data architecture, legal, and security partners.

Responsibilities

• Be a key player in a cross-functional team of engineers who build software for a large-scale data processing ecosystem, supporting real-time and batch data pipelines for analytics, data science, and operations
• Maintain data engineering and architecture best practices and standards within the team and wider organization, along with a culture of quality, innovation, and experimentation
• Evangelize and evolve the platform, best-practices, data driven decisions; identify new use cases and features and drive adoption
• Build out a robust observability, alerting, logging, and system control plane that allows easy diagnosis of any issues across all data pipelines
• Contribute to maintaining, updating, and expanding existing software deployments while maintaining strict uptime SLAs
• Maintain detailed documentation of your work and changes to support data quality and data governance requirements
• Be an active participant and advocate of agile/scrum ceremonies to collaborate and improve processes for the team
• Collaborate with product managers, architects, and other engineers to drive the success of the Foundational Platform

Requirements

• 5+ years of data engineering experience in software engineering in the data space
• Strong algorithmic problem-solving expertise
• Strong fundamental Scala and Python software programming skills
• Good understanding of AWS or other cloud provider resources (S3)
• Strong SQL skills and ability to creatively problem solve and dive deep into data and software ecosystem
• Hands-on production environment experience with distributed processing systems such as Apache Spark
• Hands-on production experience with workflow orchestration systems such as Airflow for creating and maintaining data pipelines
• Scripting language experience (Bash, PowerShell)
• Technologies such as OneTrust, Databricks, Jupyter, Snowflake, Redshift, Airflow, DynamoDB, Redis, Kubernetes, Kinesis, REST APIs, Terraform, Go SQL, Python, Scala, other computer software languages
• Willingness and ability to learn and pick up new skillsets
• Self-starting problem solver with an eye for detail and excellent analytical and communication skills
• Master's Degree in Computer Science, Information Systems preferred (Preferred Qual)
• Experience with at least one major Massively Parallel Processing (MPP) or cloud database technology (Snowflake, Redshift, Big Query) (Preferred Qual)
• Experience in developing APIs with GraphQL (Preferred Qual)
• Deep Understanding of AWS or other cloud providers as well as infrastructure as code (Preferred Qual)
• Familiarity with Data Modeling techniques and Data Warehousing standard methodologies and practices (Preferred Qual)
• Familiar with Scrum and Agile methodologies (Preferred Qual)
• Familiarity with privacy regulations and/or data subject rights (Preferred Qual)

Benefits

• Medical, financial, and/or other benefits depending on the level and position offered
• Bonus and/or long-term incentive units may be provided as part of the compensation package