Associate Data Engineer undergoing training in data engineering tools and collaborating with senior engineers on projects. Hands - on experience with real - world datasets and cloud - based platforms.
About the role
- Senior Data Engineer developing ingestion, ETL & ELT processes with Azure Synapse at Indra Group. Supporting data solutions and compliance in a collaborative hybrid work environment.
Responsibilities
- Develop ingestion, ETL & ELT processes using Synapse pipelines.
- Create and maintain SQL scripts (stored procedures) and PySpark notebooks.
- Work with GitHub branches for version control.
- Handle real-time data processing.
- Write technical documentation.
- Collaborate with stakeholders to ensure data solutions meet business requirements.
- Ensure data security and compliance.
- Optimise performance and manage data storage solutions.
- Implement unit tests to validate data pipelines and transformations
- Work with product management and business subject matter experts to translate business requirements into good database design
- Support and guidance to the Azure Data Engineers team.
- Management of Github branches
- Management of CICD (continuous integration/continuous development) through Github actions.
Requirements
- SQL scripts (store procedures) and pyspark notebooks.
- Developing ingestion, ETL & ELT process.
- Synapse pipelines.
- Data modelling in the different storage systems chosen.
- Working with Github branches.
- Real-time data processing.
- Technical documentation.
- Agile methodology (scrum/kanban)
Benefits
- Holidays: 25 days per annum + 8 days bank holidays (options to buy/sell days)
- Pension – 4% employee and 4% employer
- Private medical insurance (including dental & optical)
- Life assurance
- Income protection
- Employee assistance programs
- Flexible/remote working options
- Charitable initiatives
- Social events (formal & informal)
- Learning and development programs
- Travel & expense allowances
- Innovative & collaborative work environment
- Hybrid working subject to project needs
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Data Engineer developing data infrastructures and pipelines for Motive's Enterprise clients. Collaborating across teams to enhance data processing with modern tools and frameworks.
Senior Data Engineer writing production code and maintaining data pipelines for commercial banking insights. Collaborating with other teams to deliver powerful data solutions.
Lead Data Engineer responsible for designing and implementing data solutions. Work with AWS and Snowflake in a global data and AI company headquartered in New York.
Data Engineer designing and optimizing ETL workflows using Snowpark. Collaborating with the CTO to enhance parcel shipping analytics software.
Senior Data Engineer building data pipelines for business intelligence at Getsafe. Involves designing and maintaining a Data Warehouse platform using tools like SQL and Python in a hybrid work environment.
Big Data Architect involved in the Data Engineering Team, drafting architectures and sizing efforts. Collaborating with key team members to ensure data platform efficiency and best practices.
Data Engineer developing automated data pipelines for Creditreform. Collaborating with Data Scientists and Analysts and ensuring data quality and consistency.
Data Engineer building and maintaining core data infrastructure for Aircall's AI customer communications platform. Support data reliability and scalability for high - impact use cases.
Senior Data Engineer shaping data landscape and leading ETL/ELT solutions for mission - critical engineering projects in the UK. Collaborating with teams to deliver high - quality data products.