AWS Data Engineer designing and maintaining scalable cloud-based data platforms within Banking and Financial Services at EXL. Collaborating across teams to enable data-driven decision-making through cloud technologies.
Responsibilities
Design, build and maintain scalable data pipelines and ETL/ELT processes using modern cloud data engineering practices
Develop and optimise data lake and data warehouse architectures on AWS
Ensure high standards of data quality, governance, security and accessibility across data platforms
Develop scalable data transformation logic using Python, SQL and Spark-based frameworks
Monitor pipeline performance and troubleshoot data workflows to ensure reliability and efficiency
Work closely with data scientists, analysts and engineering teams to support advanced analytics and reporting initiatives
Implement best practices for data modelling, metadata management and data lineage
Produce technical documentation including data architecture, pipeline design and data flow diagrams
Support continuous improvement of data platforms through optimisation, automation and performance tuning
Requirements
8+ years of experience in data engineering or data platform development within enterprise environments
Strong expertise in AWS data services (such as S3, Glue, Redshift, EMR, Athena, Lambda or similar)
Strong programming experience with Python and SQL
Hands-on experience with Spark or distributed data processing frameworks
Proven experience building and maintaining data pipelines, data lakes and data warehouses
Strong understanding of data modelling, metadata management and data governance principles
Experience working with large-scale distributed data systems and high-volume datasets
Familiarity with CI/CD, version control (Git) and modern development practices
Experience working in Agile delivery environments
Experience within the Banking or Financial Services domain
Knowledge of Enterprise Data Management (EDM) frameworks
Experience with data governance, lineage and metadata management tools
Exposure to multi-cloud environments (Azure or GCP)
Experience supporting advanced analytics, machine learning or AI data platforms
Benefits
A competitive salary with a generous bonus
Private healthcare
Critical illness life assurance at 4 x your annual salary
Income protection insurance
A rewarding pension
Cash back cards for discounts and promotions
Cycle Scheme for savings on bikes and cycling accessories
Professional and personal development opportunities
Learning initiatives including online courses and workshops
Senior Data Engineer designing and scaling advanced data platforms for 5G and future 6G innovations at Nokia. Building robust data pipelines while collaborating with Data Scientists and Engineers in a hybrid setting.
Senior Data Engineering Consultant at Gradion transforming data infrastructure for global clients. Modernizing legacy systems and operationalizing AI/ML solutions with cloud and AI consultants.
EU Commercial Data Engineer developing scalable data solutions for Genmab’s commercial teams. Collaborating with cross - functional teams to enhance business insights and decision making through reliable data.
Principal Data Engineer designing and developing innovative data analytical solutions for the gaming industry. Leading and mentoring while engaging with clients to fulfill their data engineering needs.
Specialist, Data Engineering at CoverMyMeds enhancing and expanding data platforms for commercial data products. Collaborating with multiple teams to design scalable data solutions from various sources.
Team Lead in Data Engineering at Avanquest mentoring data engineering team and ensuring efficient data management across platforms. Collaborating with departments to align solutions and optimize workflows.
Data Architect at RSM leading AI - driven data migration initiatives within Salesforce ecosystem. Implementing data governance and optimizing performance across complex datasets.
Senior Data Engineer at Capgemini designing and optimizing scalable data architectures on Databricks and GCP. Collaborating across teams to transform business needs into reliable technical solutions.
Data Engineer transforming legacy on - premises systems to cloud - native architectures for advanced data analytics. Collaborating with teams to build efficient data solutions using Python and AWS.