Senior Data Engineer developing and supporting data integration and ETL solutions for Flutter UKI. Collaborating in an agile environment to deliver high-quality production code and data services.
Responsibilities
Be an effective team player of a Scrum Team - understanding and contributing to the agile delivery process and taking ownership of your team’s processes.
Create and promote the use of behaviour/test-driven development at multiple levels within the software by pairing with production code developers and product owners.
To deliver excellent production quality code and encourage and mentor other developers to do so.
To be proactive in identifying holistic approaches across diverse programs, projects and technologies.
To promote the production of reusable code and modules where appropriate with a view to maximizing effort and reducing development costs applying principles of Agile delivery.
To be proactive in the identification of opportunities to improve and rationalize applications and processes across the whole Data team, working in close collaboration with other Data team members and subject matter experts.
To liaise closely with other Data team members and subject experts to ensure that accurate and effective support documentation is maintained to reflect code development and changes.
To ensure risks and issues are identified in a timely manner and effectively communicated with proposed resolution and mitigation strategies to the Data Engineering Manager.
To be proactive and drive the building of effective relationships across Data and key areas of the Paddy Power Betfair business stakeholder community.
Write and maintain functional and technical specifications.
Monitor, optimize and trouble shoot database, microservice and stream and ML service performance.
Analyze code for problem resolution.
Thorough, demonstrable unit testing.
Requirements
Excellent SQL, preferably on both RDBMS and an MPP platform like Redshift or another big data platform like Hadoop.
Dimensional data modelling.
Demonstrable experience with high-volume data loads (terra bytes and above).
Knowledge of ETL from highly transactional (1000s records/second) OLTP systems.
Demonstrable experience of object oriented in Python.
A proven ability to influence technical decisions in a fast-moving commercial environment.
Demonstrates excellent people skills.
Demonstrates exceptional communication, interpersonal skills, and consistent high energy levels.
Proven development skills in at least one and preferably two or more of the following: Microservices, Kafka or another message based streaming platform, Machine learning and analytics in either Python or Sagemaker, Open source NoSQL technologies (e.g. MongoDB, CouchDB, ElasticSearch), ETL Tools such as Talend or Airflow, AWS (preferable) or experience of data engineering on another leading cloud vendor such as GCP or Azure.
Experience of database performance analysis and design.
Intermediate Data Engineer designing and building data pipelines for travel industry data management. Collaborating across teams to ensure reliable data for analytics and reporting.
Data Engineer managing and organizing datasets for AI models at Walaris, developing AI - driven autonomous systems for defense and security applications.
Data Engineer designing and maintaining data pipelines at Black Semiconductor. Collaborating with process, equipment, and IT teams to support manufacturing analytics and decision - making.
Junior Data Engineer role focusing on Business Intelligence and Big Data at Avanade. Collaborating on data analysis and SQL queries in a supportive learning environment.
GCP Data Engineer designing and developing data processing modules for Ki, an algorithmic insurance carrier. Working closely with multiple teams to optimize data pipelines and reporting.
Data Engineer at Securian Financial optimizing scalable data pipelines for AI and advanced analytics. Collaborating with teams to deliver secure and accessible data solutions.
IT Data Engineering Co‑Op at BlueRock Therapeutics supports development of scientific data systems. Collaboration on data workflows and foundational AWS data engineering tasks.
Data Engineer I building and operationalizing complex data solutions for Travelers' analytics using Databricks. Collaborating within teams to educate end users and support data governance.
Data Engineer shaping modern data architecture to drive golf’s digital transformation. Collaborating with teams to enhance data pipelines and insights for customer engagement and revenue growth.
Staff Data Engineer overseeing complex data systems for CITY Furniture. Responsible for architecting and optimizing data ecosystems in a hybrid work environment.