Senior Data Engineer designing and improving software for business capabilities at Barclays. Collaborating with teams to build a data and intelligence platform for Equity Derivatives.
About the role
- Migration Engineer leading data migrations to GiG’s CoreX platform with a focus on data integrity and collaboration.
Responsibilities
- Data Pipeline Design & Implementation: Design, develop, and maintain robust data pipelines for the extraction, transformation, and loading (ETL) of large volumes of structured and unstructured data, ensuring scalability and efficiency.
- Migration Execution & Validation: Lead the execution of data migrations, including data extraction, transformation, schema mapping, validation, and cutover, ensuring data integrity and consistency.
- Collaboration & Stakeholder Engagement: Work closely with product, technology, delivery, and compliance teams to gather migration requirements, align on data definitions, and ensure successful migration outcomes.
- Automation & Optimization: Implement automation solutions for ETL/migration processes to improve efficiency and reduce manual intervention.
- Monitoring & Troubleshooting: Monitor and troubleshoot migration pipelines, addressing issues promptly to ensure smooth operations.
- Documentation & Process Improvement: Document migration processes, contribute to process improvement initiatives, and ensure adherence to best practices.
- Technical Support & Incident Resolution: Provide technical support during incident resolution related to migration pipelines and data discrepancies.
- Agile Participation: Actively participate in all agile scrum meetings such as daily standups, refinement sessions, and retrospectives.
- Innovation & Continuous Improvement: Propose and implement new ideas to improve existing products and services, fostering a culture of innovation.
- Code Review & Mentorship: Perform code reviews for other engineers, ensuring code quality and knowledge sharing within the team.
- Stakeholder Communication: Effectively communicate with respective stakeholders, ensuring that all information is transmitted correctly and to the right audience.
Requirements
- Bachelor’s/Master’s in Computer Science, Engineering, or related field.
- 3+ years of experience in data engineering, ETL processes, or data migration.
- Strong SQL skills and experience working with structured and unstructured datasets.
- Knowledge of data governance, compliance, and data quality assurance.
- Solution-oriented mindset with the ability to troubleshoot and resolve issues.
- Strong experience with Big Data and streaming technologies including ClickHouse, Kafka and NiFi
- Strong knowledge of Microservices, APIs, GraphQL
- Experience in the iGaming industry or regulated markets.
- Experience with automation of ETL/migration processes.
Benefits
- Great career development opportunities
- Hybrid working model
- International Health Insurance
- Health and Wellbeing Package (350 EUR per year)
- Birthday Day Off
- Me Time - 1 day off per year
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Senior AI & Data Engineer developing and implementing AI solutions in collaboration with clients and teams. Working on projects involving generative AI, predictive analytics, and data mastery.
Consultant driving IA business growth in Deloitte's Artificial Intelligence & Data team. Delivering innovative solutions using data analytics and automation technologies.
Data Engineer responsible for managing data architecture and pipelines at Snappi, a neobank. Collaborating with teams to enable data processing and analysis in innovative banking solutions.
Data Engineer at Destinus developing the data platform to support production and analytics needs. Involves migrating Excel sources to Lakehouse and integrating ERP systems in a hybrid role.
Senior Data Engineer developing solutions within the Global Specialty portfolio at an insurance company. Engaging with diverse business partners to ensure high quality data reporting.
Data Engineer at UBDS Group focusing on designing and optimizing modern data platforms. Collaborating in a multidisciplinary team to develop reliable data assets for analytics and operational use cases.
Data Engineer (dbt) at SDG Group involved in all phases of data projects. Collaborate on data ingestion, transformation, and visualization in a hybrid environment.
Data Consultant at SDG Group specializing in Data & Analytics projects. Collaborate on technical - functional definitions, ETL, data modeling, and visualization for cloud solutions.
Senior Data Engineer responsible for growing customer - defined targeting calculations and developing key/value databases for real - time data processing.