Senior Data Engineer developing and supporting data integration and ETL solutions for Flutter UKI. Collaborating in an agile environment to deliver high-quality production code and data services.
Responsibilities
Be an effective team player of a Scrum Team - understanding and contributing to the agile delivery process and taking ownership of your team’s processes.
Create and promote the use of behaviour/test-driven development at multiple levels within the software by pairing with production code developers and product owners.
To deliver excellent production quality code and encourage and mentor other developers to do so.
To be proactive in identifying holistic approaches across diverse programs, projects and technologies.
To promote the production of reusable code and modules where appropriate with a view to maximizing effort and reducing development costs applying principles of Agile delivery.
To be proactive in the identification of opportunities to improve and rationalize applications and processes across the whole Data team, working in close collaboration with other Data team members and subject matter experts.
To liaise closely with other Data team members and subject experts to ensure that accurate and effective support documentation is maintained to reflect code development and changes.
To ensure risks and issues are identified in a timely manner and effectively communicated with proposed resolution and mitigation strategies to the Data Engineering Manager.
To be proactive and drive the building of effective relationships across Data and key areas of the Paddy Power Betfair business stakeholder community.
Write and maintain functional and technical specifications.
Monitor, optimize and trouble shoot database, microservice and stream and ML service performance.
Analyze code for problem resolution.
Thorough, demonstrable unit testing.
Requirements
Excellent SQL, preferably on both RDBMS and an MPP platform like Redshift or another big data platform like Hadoop.
Dimensional data modelling.
Demonstrable experience with high-volume data loads (terra bytes and above).
Knowledge of ETL from highly transactional (1000s records/second) OLTP systems.
Demonstrable experience of object oriented in Python.
A proven ability to influence technical decisions in a fast-moving commercial environment.
Demonstrates excellent people skills.
Demonstrates exceptional communication, interpersonal skills, and consistent high energy levels.
Proven development skills in at least one and preferably two or more of the following: Microservices, Kafka or another message based streaming platform, Machine learning and analytics in either Python or Sagemaker, Open source NoSQL technologies (e.g. MongoDB, CouchDB, ElasticSearch), ETL Tools such as Talend or Airflow, AWS (preferable) or experience of data engineering on another leading cloud vendor such as GCP or Azure.
Experience of database performance analysis and design.
Data Architect designing and implementing data architectures supporting analytics and ML for federal clients. Collaborating with teams to translate mission needs into robust data solutions.
IT Data Engineer developing data pipelines and integrations for Scanfil Group's global IT organization. Collaborating across teams to enhance data solutions and reporting capabilities.
Data Engineer developing Azure data solutions at PwC New Zealand. Responsibilities include data quality monitoring, pipeline development, and collaboration with stakeholders in a supportive environment.
Senior Data Engineer designing and implementing the Enterprise Data Platform at Stellix. Focusing on analytics and insights with a growth path to Principal Data Engineer or Data Architect.
R&D Data Engineer at DXC, transforming complex data into digital assets for global analytics and Smart Lab solutions. Collaborating on ELN and LIMS tools for enhanced data management.
Senior Data Engineer at mobility AI company designing large - scale data processing pipelines. Leading technical decisions and mentoring junior engineers in data architecture.
Data Engineer role focusing on data pipelines and processing at 42dot, a mobility AI company. Responsibilities include data collection, schema management, and pipeline monitoring.
Senior Data Engineer at Booz Allen building advanced tech solutions for mission - driven projects. Utilizing data engineering activities, pipelines, and platforms for impactful data insights.
Senior Software Engineer contributing to Workday's AI/MLOps cloud ops platform. Involves data ingestion, computation, and generation of curated data sets with modern technologies.