Lead Data Engineer responsible for designing and implementing data solutions. Work with AWS and Snowflake in a global data and AI company headquartered in New York.
Responsibilities
Lead the design, development, and implementation of data solutions using AWS and Snowflake.
Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
Develop and maintain data pipelines, ensuring data quality, integrity, and security.
Optimize data storage and retrieval processes to support data warehousing and analytics.
Provide technical leadership and mentorship to junior data engineers.
Ensure compliance with industry standards and best practices in data engineering.
Utilize knowledge of insurance, particularly claims and loss, to enhance data solutions.
Requirements
8+ years of relevant experience in Data Engineering and delivery.
5+ years of relevant work experience in Big Data Concepts.
Strong experience with SQL, Python and Pyspark
Good understanding of Data ingestion and data processing frameworks
Good experience in Snowflake, SQL, AWS (Glue, EMR, S3, Aurora, RDS)
Should be able to do coding, debugging, performance tuning, and deploying the apps to Production.
Experience working in Agile Methodology
Bachelor's or Master's degree in Computer Science, IT or related field.
Certification in AWS or Snowflake is a plus.
Experience in the insurance industry with knowledge of claims and loss processes is desirable.
Benefits
A competitive salary with a generous bonus
Private healthcare
Critical illness life assurance at 4 x your annual salary
Income protection insurance
A rewarding pension
EXL provides everyday financial well-being solutions, such as cash back cards
Cycle Scheme to save money on bikes and cycling accessories
Professional and personal development opportunities
A wide range of learning initiatives including online courses, seminars, and workshops.
Employee Stock Purchase Plan (ESPP)
Flexible hybrid working model that promotes a balanced lifestyle
Associate Data Engineer undergoing training in data engineering tools and collaborating with senior engineers on projects. Hands - on experience with real - world datasets and cloud - based platforms.
Data Engineer developing data infrastructures and pipelines for Motive's Enterprise clients. Collaborating across teams to enhance data processing with modern tools and frameworks.
Senior Data Engineer writing production code and maintaining data pipelines for commercial banking insights. Collaborating with other teams to deliver powerful data solutions.
Senior Data Engineer developing ingestion, ETL & ELT processes with Azure Synapse at Indra Group. Supporting data solutions and compliance in a collaborative hybrid work environment.
Senior Data Engineer building data pipelines for business intelligence at Getsafe. Involves designing and maintaining a Data Warehouse platform using tools like SQL and Python in a hybrid work environment.
Big Data Architect involved in the Data Engineering Team, drafting architectures and sizing efforts. Collaborating with key team members to ensure data platform efficiency and best practices.
Data Engineer developing automated data pipelines for Creditreform. Collaborating with Data Scientists and Analysts and ensuring data quality and consistency.
Data Engineer building and maintaining core data infrastructure for Aircall's AI customer communications platform. Support data reliability and scalability for high - impact use cases.
Senior Data Engineer shaping data landscape and leading ETL/ELT solutions for mission - critical engineering projects in the UK. Collaborating with teams to deliver high - quality data products.