Senior Data Engineer designing and building automated data platforms and pipelines for Coody clients. Delivering efficient solutions in a consultant role across exciting industries and companies.
About the role
- Senior Data Engineer at FanDuel building scalable data handling systems and collaborating with teams on data solutions. Ensuring reliable access to data for business applications across the company.
Responsibilities
- Build & Maintain Data Pipelines
- Design, build, and maintain scalable batch and stream data pipelines to support analytics and business operations that can easily support millions of transactions during peak business hours.
- Write clean, efficient, and well-documented code and test cases using tools like Python, SQL, and Spark.
- Ensure data is reliable, accurate, and delivered in a timely manner.
- Collaborate Across Teams
- Work with data analysts, data scientists, and product managers to understand requirements and deliver actionable data solutions
- Translate business questions into engineering tasks and contribute to technical planning.
- Participate in code reviews, sprint planning, and retrospectives as part of an agile team.
- Data Quality & Operations
- Monitor data pipelines and troubleshoot issues in a timely, systematic manner
- Implement data quality checks and contribute to observability and testing practices
- Document data sources, transformations, and architecture decisions to support long-term maintainability
Requirements
- 5+ years of experience writing Python scripts
- 5+ years' experience working SQL knowledge and experience working with relational databases
- Build processes supporting data transformation, data structures, metadata, dependency, and workload management
- Show proficiency understanding complex ETL processes
- Demonstrate the ability to optimize processes (ram vs io)
- Knowledge of data integrity and relational rules
- Experience in setting up self-healing and resilient data pipelines using Airflow, monitoring and alerting using Monte Carlo, PagerDuty and DataDog.
- Understanding of AWS and Google Cloud
- Ability to quickly learn new technologies is critical
- Proficiency with agile or lean development practices
Benefits
- We treat our team right
- Equal opportunities employer
- Committed to equal employment opportunity regardless of characteristics
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Senior Data Platform Consultant driving analytics solutions on Databricks for Snap's clients. Leading architecture and delivery while shaping Databricks capability growth within the team.
Data Engineer Associate developing and implementing data solutions within PNC's Asset Management Group. Collaborating on technical solutions using PySpark, Hadoop, and SQL for scalable data systems.
Senior Data Engineer at Assembly working on data integration, transformation, and analytics collaboration. Handling cloud services and data quality across data projects with cross - functional teams.
Senior Data Engineer developing scalable data pipelines and collaborating with cross - functional teams at Technis. Technical guidance in a hybrid work environment based in Lausanne, Switzerland.
Data Engineer designing and maintaining data pipelines for CIEE, a philanthropic institution supporting youth development. Collaborating with Data Analysts for data quality and reliability.
Senior Data Engineer responsible for designing and implementing data solutions at Harambee. Collaborating with various stakeholders to enhance technology supporting work - seekers' journeys.
Senior Consultant Data Engineer in a consultancy firm focusing on data engineering and platform development. Collaborating with diverse teams to deliver high - quality data solutions.
Senior Manager Data Engineer at Squarcle delivering technical leadership in data engineering and compliance with business objectives. Leading teams to optimize and develop data platforms for clients.
Data Engineer at Mobileye building robust data pipelines for data infrastructure. Collaborating with teams to deliver high - quality data solutions for dynamic environments.