Lead Azure Databricks Data Engineer implementing data solutions for data engineering projects at Ryan Specialty. Collaborating with stakeholders and mentoring junior staff on data pipelines and ETL processes.
TC
Hybrid Senior Data Engineer – Audience Manager Platform
Posted 3 months ago
About the role
- Senior Data Engineer building and maintaining Audience Manager Platform for Disney's media and advertising digital solutions. Collaborating with engineering teams on audience data initiatives.
Responsibilities
- Build and maintain audience platform initiatives to improve and expand audience targeting capabilities.
- Partner with technical and non-technical colleagues to understand audience data and targeting requirements.
- Work with engineering teams to collect required data from internal and external systems.
- Support Agile methodologies such as Scrum by actively participating in regular ceremonies such as stand-up, retrospectives and sprint planning.
- Design table structures and define ETL pipelines to build performant and scalable solutions
- Develop Data Quality checks
- Participate in on-call support
- Develop and maintain ETL routines using ETL and orchestration tools such as Airflow
- Perform ad hoc analysis and SQL and ETL tuning as necessary.
- Participate in code reviews and problem-solving.
Requirements
- 5+ years of big data engineering experience modeling and developing large data pipelines
- Hands-on experience with distributed systems such as Spark, Hadoop (HDFS, Hive, Presto, PySpark)
- Strong Python and SQL skills processing big datasets
- Experience with at least one major MPP or cloud database technology (Snowflake, Redshift, Big Query, Databricks)
- Familiarity with Data Modeling techniques and Data Warehousing standard methodologies and practices
- API and backend development experience
- Bachelor’s degree in Computer Science, Information Systems, Software, Electrical or Electronics Engineering, or comparable field of study, and/or equivalent work experience.
Benefits
- Health insurance
- 401(k) matching
- Flexible work hours
- Paid time off
- Bonuses and/or long-term incentive units dependent on position
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Lead Azure Databricks Data Engineer at Ryan Specialty focused on implementing data solutions and collaborating with cross - functional teams to enhance data architecture.
Senior Data Engineer designing and implementing sustainable data solutions for diverse clients. Collaborating closely with stakeholders to enhance data services and platforms in a hybrid environment.
Risk Data Engineer and Architect at Lincoln Financial supporting risk analytics through AWS data solutions. Building scalable data pipelines and collaborating with cross - functional teams.
Staff Data Engineer at Qualifinds building AI - driven valuation tools and leading data ingestion development for art and collectibles management.
Senior Data Engineer designing secure and scalable data systems for maritime and defense applications. Seeking experienced professional with strong expertise in AWS and Azure environments.
Senior Data Engineer role at AI & Data Engineering focused on Databricks engineering.
Senior Data Engineer at Yü Group responsible for leading data engineering team and optimizing data solutions within the energy sector.
Data Engineer managing payment processing and data accuracy while collaborating with financial teams. Building and optimizing data pipelines for transactional data in a hybrid work environment.
Data Engineer building analytical tools for Dry Bulk market data operations at Kpler. Join a team of over 700 experts transforming data into actionable strategies.