Data Engineer developing and maintaining data pipelines using Talend and AWS. Collaborating with teams to ensure data quality and availability while working in a dynamic Agile environment.
Responsibilities
Build and support efficient ETL processes, primarily using Talend.
Design scalable data pipelines that deliver structured, high-quality data.
Monitor pipeline performance and ensure data integrity, security, and availability.
Collaborate with internal teams and third-party partners to resolve issues quickly.
Engage with business stakeholders from concept to delivery to meet their data needs.
Contribute to data policies, standards, and continuous process improvements.
Work within an Agile (Scrum) delivery environment, applying best practices in continuous integration and delivery.
Requirements
Proven experience in Data Engineering, specifically with Talend Data Integration.
Strong knowledge of AWS cloud services (S3, Glue, Redshift, Spectrum) and SQL.
Expertise in ETL design, data warehousing, and data governance principles.
Experience with REST and SOAP APIs for data extraction and integration.
Familiarity with ITIL or similar IT service management frameworks.
Proficiency in scripting languages (Shell, Python, PowerShell) is a plus.
Excellent problem-solving, analytical, and communication skills.
Ability to work effectively in a dynamic, fast-paced environment.
Experience working in Agile teams and delivering data-driven projects.
Bonus: Knowledge of Master Data Management, predictive analytics, or water industry regulatory reporting.
Benefits
Hybrid role, with the expectations of a minimum two days a week in the office in Hatfield
Annual leave from 26 days rising with length of service, and the option to purchase up to 5 extra days.
A ‘Celebration Day’ in addition to public holidays.
A generous 'double match pension scheme' that doubles the contributions you make (company contribution capped at 12%)
We offer a range of family benefits including enhanced Maternity, Adoption, Paternity, Shared Parental Leave, Fertility Support Leave and up to 5 full or 10 half days of paid Carers Leave.
Menopause policy and Reasonable Adjustment policy to help everyone perform at their best.
Access to our Wellbeing Centre with support for looking after your physical and mental health.
Discounts at a Range of Retail Outlets and on Dental and Medical Insurance through our Tap4Perks scheme.
Up to 4 Affinity days a year to volunteer in the community.
Intern Data Engineer at Flutter Studios learning to create applications in the gaming industry. Join a cross - functional team to implement a basic application in an Agile environment.
AI/Data Engineer at Comcast developing data pipelines and AI solutions for audit processes. Leading team efforts to ensure data quality and compliance with audit objectives across business units.
Senior Data Engineer involved in AWS Cloud and Big Data solutions for Financial Crime. Join CommBank's team to tackle complex data - centric problems with advanced technologies.
Senior Data Engineer leading and mentoring a team in building scalable data pipelines for digital transformation projects in an international software company.
Senior Data Operations Engineer at iKnowHow designing and implementing scalable data - driven applications. Focus on data pipelines, APIs, and collaboration across teams for project success.
Data/AI Engineer supporting innovations in corporate travel with AWS technologies at HRS Group. Collaborating with data teams to develop AI solutions and maintain data pipelines.
Data Engineer developing data solutions for reporting and analytics at Assurant. Implementing and optimizing Data Warehouse solutions in cloud and on - premise environments with Agile methodology.
AI Engineer developing AI - driven analytics for trading at Deloitte. Focusing on scalable data pipelines and collaboration with traders for actionable insights.
Data Engineer involved in delivering scalable enterprise systems and digital transformation platforms for Qualysoft. Collaborate with global teams across various industries and technologies.