Principal Data Engineer driving modernization from legacy systems to cloud - native platforms at Mastercard. Architecting and developing ETL platforms with AI integration and establishing data - driven strategies.
About the role
- Report to the Technical Project Lead
- Plan, execute, monitor, and validate data migrations between eCommerce platforms (Shopify, Magento, BigCommerce, WooCommerce)
- Examine data setup and identify potential migration issues
- Create and use migration plans including data cleaning and post-migration verification
- Utilize tools and methods to extract, transform, and load data into target systems
- Build scripts to automate the migration process (Python/JavaScript)
- Ensure data accuracy, completeness, and minimal business disruption
- Identify and resolve issues arising during migration
- Collaborate with website building team and project leaders to ensure smooth migration
- Create and maintain documentation for migration processes and procedures
- Describe migration process steps, timelines, and results
- Continuously learn and improve migration methods and tools
- Perform data mapping analysis between source and target systems
- Develop and execute data validation test cases
- Provide estimates for migration timelines and resource requirements
- Handle post-migration audits and reconciliation
Requirements
- Minimum Experience: Mid-level
- Good understanding of how e-commerce sites' information is organized
- Good knowledge of Microsoft Excel/Google Sheets and CSV files
- Good programming skills (Python/JavaScript) to build scripts and automate processes
- Familiarity with tools and steps for extracting, modifying, and inserting information
- Strong attention to detail and troubleshooting/debugging mindset
- Ability to work independently and collaboratively with teams
- Good organizational and time-management skills
- Strong verbal and written communication skills
- Fast learner
- Preferred: experience with Python, JavaScript, PHP
- Preferred: Knowledge of simple MySQL queries to pull data from the database
- Preferred: Familiarity with data security and compliance (GDPR, PCI, HIPAA if relevant)
- Preferred: Ability to work with large datasets efficiently
- Preferred: Stakeholder communication skills (explaining timelines, risks, tradeoffs)
- Preferred: Experience with eCommerce platform APIs (Shopify Admin API, Magento REST/SOAP, BigCommerce API)
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
No Education Requirement
Tech skills
Location requirements
Principal Data Engineer modernizing cloud - native platforms for AI - powered solutions at Mastercard. Leading teams to enhance data processing efficiency and reliability across global operations.
IN
Data Engineer creating data pipelines for Santander's card transactions. Collaborating with an agile team in strategic projects involving Databricks and PySpark.
SA
Sabiá AdministraçãoSenior Data Engineer
Data Engineer designing, implementing, and maintaining data pipelines at Sabiá Gaming. Focused on high - quality data access and integration for enhanced decision - making.
MA
MassMutualQuantitative Data Engineer
Quantitative Data Engineer developing data solutions and automations for MassMutual's investment management. Working with data orchestration tools within a collaborative team environment.
Senior Data Engineer designing and scaling data infrastructure for analytics, machine learning, and business intelligence in a software supply chain security company.
NI
NinjaTraderSenior Data Engineer
Data Engineer developing architecture and pipelines for data analytics at NinjaTrader. Empowering analysts and improving business workflows through data - driven solutions.
SP
SpecsaversData Engineer
Data Engineer designing and developing data solutions at Specsavers. Collaborating on data pipelines and migrations with analysts and stakeholders.
AL
AlterricData Engineer
Data Engineer joining Alterric to collaborate on data platform projects and analytics solutions. Working with Azure Cloud technologies to ensure data quality and integrity for informed decision - making.
KY
KyndrylELK Data Engineer
Data Engineer at Kyndryl transforming raw data into actionable insights using ELK Stack. Responsible for developing, implementing, and maintaining data pipelines and processing workflows.