Migration Engineer for GiG’s Migrations Team managing and executing data migrations and ensuring data integrity. Collaborating with various stakeholders on the CoreX platform migrations.
Responsibilities
Data Pipeline Design & Implementation: Design, develop, and maintain robust data pipelines for the extraction, transformation, and loading (ETL) of large volumes of structured and unstructured data, ensuring scalability and efficiency.
Migration Execution & Validation: Lead the execution of data migrations, including data extraction, transformation, schema mapping, validation, and cutover, ensuring data integrity and consistency.
Collaboration & Stakeholder Engagement: Work closely with product, technology, delivery, and compliance teams to gather migration requirements, align on data definitions, and ensure successful migration outcomes.
Automation & Optimization: Implement automation solutions for ETL/migration processes to improve efficiency and reduce manual intervention.
Monitoring & Troubleshooting: Monitor and troubleshoot migration pipelines, addressing issues promptly to ensure smooth operations.
Documentation & Process Improvement: Document migration processes, contribute to process improvement initiatives, and ensure adherence to best practices.
Technical Support & Incident Resolution: Provide technical support during incident resolution related to migration pipelines and data discrepancies.
Agile Participation: Actively participate in all agile scrum meetings such as daily standups, refinement sessions, and retrospectives.
Innovation & Continuous Improvement: Propose and implement new ideas to improve existing products and services, fostering a culture of innovation.
Code Review & Mentorship: Perform code reviews for other engineers, ensuring code quality and knowledge sharing within the team.
Stakeholder Communication: Effectively communicate with respective stakeholders, ensuring that all information is transmitted correctly and to the right audience.
Requirements
Bachelor’s/Master’s in Computer Science, Engineering, or related field.
3+ years of experience in data engineering, ETL processes, or data migration.
Strong SQL skills and experience working with structured and unstructured datasets.
Knowledge of data governance, compliance, and data quality assurance.
Solution-oriented mindset with the ability to troubleshoot and resolve issues.
Strong experience with Big Data and streaming technologies including ClickHouse, Kafka and NiFi
Strong knowledge of Microservices, APIs, GraphQL
Preferred Skills
Experience in the iGaming industry or regulated markets.
Experience with automation of ETL/migration processes.
Senior Data Engineer developing solutions within the Global Specialty portfolio at an insurance company. Engaging with diverse business partners to ensure high quality data reporting.
Data Engineer at UBDS Group focusing on designing and optimizing modern data platforms. Collaborating in a multidisciplinary team to develop reliable data assets for analytics and operational use cases.
Data Engineer (dbt) at SDG Group involved in all phases of data projects. Collaborate on data ingestion, transformation, and visualization in a hybrid environment.
Data Consultant at SDG Group specializing in Data & Analytics projects. Collaborate on technical - functional definitions, ETL, data modeling, and visualization for cloud solutions.
Senior Data Engineer responsible for growing customer - defined targeting calculations and developing key/value databases for real - time data processing.
Data Engineer developing and maintaining the Data Lakehouse platform using Microsoft Azure technology stack at RBC. Collaborating with business and technology teams to enhance data ingestion and modeling processes.
Data Engineer focused on creating a data platform for automated cyber insurance. Collaborating with stakeholders to deliver data processing capabilities and governance.
Data Engineer building and maintaining data platform solutions for clients at Dignify. Designing, developing, and optimising data models and pipelines with a focus on Google BigQuery.
Data Engineer designing and developing data solutions using AI and machine learning for marketing applications. Collaborating in teams to create impactful data - driven solutions for clients across various industries.
Senior Data Engineer developing scalable data solutions for electric vehicle market at Kempower. Collaborating with cross - functional teams to enhance data engineering processes.