Senior Data Engineer developing ingestion, ETL & ELT processes with Azure Synapse at Indra Group. Supporting data solutions and compliance in a collaborative hybrid work environment.
Responsibilities
Develop ingestion, ETL & ELT processes using Synapse pipelines.
Create and maintain SQL scripts (stored procedures) and PySpark notebooks.
Work with GitHub branches for version control.
Handle real-time data processing.
Write technical documentation.
Collaborate with stakeholders to ensure data solutions meet business requirements.
Ensure data security and compliance.
Optimise performance and manage data storage solutions.
Implement unit tests to validate data pipelines and transformations
Work with product management and business subject matter experts to translate business requirements into good database design
Support and guidance to the Azure Data Engineers team.
Management of Github branches
Management of CICD (continuous integration/continuous development) through Github actions.
Requirements
SQL scripts (store procedures) and pyspark notebooks.
Developing ingestion, ETL & ELT process.
Synapse pipelines.
Data modelling in the different storage systems chosen.
Working with Github branches.
Real-time data processing.
Technical documentation.
Agile methodology (scrum/kanban)
Benefits
Holidays: 25 days per annum + 8 days bank holidays (options to buy/sell days)
Pension – 4% employee and 4% employer
Private medical insurance (including dental & optical)
Director leading strategy, governance, and delivery of enterprise data platform at Phillips 66. Partnering with AI, Data Science, and business teams to enhance analytics and business systems.
Product Owner driving ERP data migration initiatives for BioNTech’s global landscape. Leading effective data management and ensuring compliance with regulatory standards in a fast - paced environment.
Data Engineer II leading development and delivery of data pipelines for Syneos Health. Collaborating with teams to optimize data processing and integrate solutions into production environments.
Lead Data Engineer overseeing data operations and analytics engineering teams for OneOncology. Focused on operational excellence in data platform and model reliability for cancer care improvement.
Senior AWS Software Data Engineer at Boeing focusing on AWS Data services to support digital analytics capabilities. Collaborating with cross - functional teams to design, develop, and maintain software data solutions.
Senior Data Engineer designing and improving software for business capabilities at Barclays. Collaborating with teams to build a data and intelligence platform for Equity Derivatives.
Senior AI & Data Engineer developing and implementing AI solutions in collaboration with clients and teams. Working on projects involving generative AI, predictive analytics, and data mastery.
Consultant driving IA business growth in Deloitte's Artificial Intelligence & Data team. Delivering innovative solutions using data analytics and automation technologies.
Data Engineer responsible for managing data architecture and pipelines at Snappi, a neobank. Collaborating with teams to enable data processing and analysis in innovative banking solutions.
Data Engineer at Destinus developing the data platform to support production and analytics needs. Involves migrating Excel sources to Lakehouse and integrating ERP systems in a hybrid role.