Senior Data Engineer supporting AI - enabled financial compliance initiative with data pipelines and ingestion processes. Collaborating with diverse teams in a mission - critical regulated environment.
About the role
- Senior Data Engineer at FanDuel building scalable data handling systems and collaborating with teams on data solutions. Ensuring reliable access to data for business applications across the company.
Responsibilities
- Build & Maintain Data Pipelines
- Design, build, and maintain scalable batch and stream data pipelines to support analytics and business operations that can easily support millions of transactions during peak business hours.
- Write clean, efficient, and well-documented code and test cases using tools like Python, SQL, and Spark.
- Ensure data is reliable, accurate, and delivered in a timely manner.
- Collaborate Across Teams
- Work with data analysts, data scientists, and product managers to understand requirements and deliver actionable data solutions
- Translate business questions into engineering tasks and contribute to technical planning.
- Participate in code reviews, sprint planning, and retrospectives as part of an agile team.
- Data Quality & Operations
- Monitor data pipelines and troubleshoot issues in a timely, systematic manner
- Implement data quality checks and contribute to observability and testing practices
- Document data sources, transformations, and architecture decisions to support long-term maintainability
Requirements
- 5+ years of experience writing Python scripts
- 5+ years' experience working SQL knowledge and experience working with relational databases
- Build processes supporting data transformation, data structures, metadata, dependency, and workload management
- Show proficiency understanding complex ETL processes
- Demonstrate the ability to optimize processes (ram vs io)
- Knowledge of data integrity and relational rules
- Experience in setting up self-healing and resilient data pipelines using Airflow, monitoring and alerting using Monte Carlo, PagerDuty and DataDog.
- Understanding of AWS and Google Cloud
- Ability to quickly learn new technologies is critical
- Proficiency with agile or lean development practices
Benefits
- We treat our team right
- Equal opportunities employer
- Committed to equal employment opportunity regardless of characteristics
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Data Architect leading the definition and construction of cloud data architecture for Kyndryl. Participating in significant technological modernization initiatives, focusing on Google Cloud Platform.
Senior Data Engineer driving data intelligence requirements and scalable data solutions for a global consulting firm. Collaborating across functions to enhance Microsoft architecture and analytics capabilities.
Experienced AI Engineer designing and building production - grade agentic AI systems using generative AI and large language models. Collaborating with data engineers, data scientists in a tech - driven company.
Intermediate Data Engineer designing and building data pipelines for travel industry data management. Collaborating across teams to ensure reliable data for analytics and reporting.
Data Engineer managing and organizing datasets for AI models at Walaris, developing AI - driven autonomous systems for defense and security applications.
Data Engineer designing and maintaining data pipelines at Black Semiconductor. Collaborating with process, equipment, and IT teams to support manufacturing analytics and decision - making.
Junior Data Engineer role focusing on Business Intelligence and Big Data at Avanade. Collaborating on data analysis and SQL queries in a supportive learning environment.
GCP Data Engineer designing and developing data processing modules for Ki, an algorithmic insurance carrier. Working closely with multiple teams to optimize data pipelines and reporting.
Data Engineer at Securian Financial optimizing scalable data pipelines for AI and advanced analytics. Collaborating with teams to deliver secure and accessible data solutions.