Manager of Data Engineering leading data assets and infrastructure initiatives at CLA. Collaborating with teams to enforce data quality standards and drive integration efforts.
About the role
- Senior Data Engineer at FanDuel building scalable data handling systems and collaborating with teams on data solutions. Ensuring reliable access to data for business applications across the company.
Responsibilities
- Build & Maintain Data Pipelines
- Design, build, and maintain scalable batch and stream data pipelines to support analytics and business operations that can easily support millions of transactions during peak business hours.
- Write clean, efficient, and well-documented code and test cases using tools like Python, SQL, and Spark.
- Ensure data is reliable, accurate, and delivered in a timely manner.
- Collaborate Across Teams
- Work with data analysts, data scientists, and product managers to understand requirements and deliver actionable data solutions
- Translate business questions into engineering tasks and contribute to technical planning.
- Participate in code reviews, sprint planning, and retrospectives as part of an agile team.
- Data Quality & Operations
- Monitor data pipelines and troubleshoot issues in a timely, systematic manner
- Implement data quality checks and contribute to observability and testing practices
- Document data sources, transformations, and architecture decisions to support long-term maintainability
Requirements
- 5+ years of experience writing Python scripts
- 5+ years' experience working SQL knowledge and experience working with relational databases
- Build processes supporting data transformation, data structures, metadata, dependency, and workload management
- Show proficiency understanding complex ETL processes
- Demonstrate the ability to optimize processes (ram vs io)
- Knowledge of data integrity and relational rules
- Experience in setting up self-healing and resilient data pipelines using Airflow, monitoring and alerting using Monte Carlo, PagerDuty and DataDog.
- Understanding of AWS and Google Cloud
- Ability to quickly learn new technologies is critical
- Proficiency with agile or lean development practices
Benefits
- We treat our team right
- Equal opportunities employer
- Committed to equal employment opportunity regardless of characteristics
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Data Engineer building modern Data Lake architecture on AWS and implementing scalable ETL/ELT pipelines. Collaborating across teams for analytics and reporting on gaming platforms.
Chief Data Engineer leading Scania’s Commercial Data Engineering team for growing sustainable transport solutions. Focused on data products and pipelines for BI, analytics, and AI.
Data Engineer designing and building scalable ETL/ELT pipelines for enterprise - grade analytics solutions. Collaborating with product teams to deliver high - quality, secure, and discoverable data.
Entry - Level Data Engineer at GM, focusing on building large scale data platforms in cloud environments. Collaborating with data engineers and scientists while migrating systems to cloud solutions.
Data Engineer responsible for data integrations with AWS technology stack for Adobe's Digital Experience. Collaborating with multiple teams to conceptualize solutions and improve data ecosystem.
People Data Architect designing and managing people data analytics for Gen, delivering actionable insights for HR. Collaborating across teams to enhance data - driven decision - making.
Data Engineer role focused on shaping future connectivity for customers at Vodafone. Involves solving complex challenges in a diverse and inclusive environment.
VP, Senior Data Engineer responsible for designing and developing cloud data solutions for insider risk in Information Security at SMBC. Collaborating with multiple teams to enhance cybersecurity data platform.
Data Engineer responsible for architecting, developing, and maintaining Allegiant’s enterprise data infrastructure. Overseeing transition to cloud hosted data warehouse and developing next - generation data tools.