Data Migration Engineer facilitating data migration to AWS S3 buckets for key Government repository. Collaborating with stakeholders to ensure data integrity and accessibility in a high-tech environment.
Responsibilities
Assess and inventory existing legacy data in shared folders and shared drives.
Assess the quality, completeness, and relevance of data to be migrated.
Identify and document data dependencies, redundancies, and inconsistencies.
Collaborate with stakeholders to understand data structures, relationships, and required formats for successful migration.
Develop a comprehensive data migration plan that outlines steps, timelines, and resource requirements for the migration process.
Identify potential challenges and propose solutions to mitigate risks associated with data migration.
Migrate legacy data to AWS S3 buckets, ensuring data integrity and security throughout the process.
Implement indexing strategies for the migrated data, enabling seamless access and retrieval.
Conduct thorough testing of the migrated data to ensure accuracy, completeness, and successful integration.
Create validation reports and document any discrepancies, working closely with stakeholders to resolve issues.
Collaborate with software engineers, database administrators, and development teams to ensure compatibility and alignment with the overall architecture.
Maintain effective communication with project stakeholders to provide updates on migration progress and gather feedback.
Create and maintain technical documentation related to data migration processes, procedures, and system configurations.
Generate reports on migration progress, data quality metrics, and issue resolution.
Provide user guides and training materials to assist end-users with accessing and utilizing the newly migrated data.
Requirements
Bachelor’s degree in Computer Science, Information Technology, Data Science, or a related field.
Previous experience as a Database Engineer and proven experience in data migration, particularly with legacy systems and cloud environments.
Proficiency in data migration tools and ETL processes (e.g., Talend, Informatica, SSIS, or similar).
Strong knowledge of database management systems (e.g., SQL Server, Oracle, MySQL, PostgreSQL).
Experience with scripting languages (e.g., Python, SQL, PowerShell) for data transformation and automation.
Strong knowledge of AWS, specifically S3, and experience with data storage and retrieval solutions.
Familiarity with indexing and data accessibility in software applications.
U.S. Citizen with active TS/SCI clearance (with CI Polygraph).
Digital Analytics Capability - Adobe Data Engineer helping Bankwest with analytical foundations for digital experiences. Implementing and maintaining Adobe Experience Cloud applications for customer engagement.
AWS Data Architect overseeing enterprise data platform architecture for Signet Jewelers. Guiding engineering teams and ensuring data solutions are reliable and aligned with enterprise strategy.
MDM Data Engineer managing Profisee MDM platform and ensuring data quality in enterprise systems at Pacific Life. Collaborating with data stewards and integrating with upstream and downstream systems.
Senior/Lead Data Engineer at HOLYWATER TECH managing infrastructure for analytical platforms like BigQuery and data integration. Involves collaborations with Data Product Owners and significant engineering responsibilities.
Process Mining Data Engineer implementing Celonis across business units at LSEG. Collaborating with executives and teams to optimize operations and drive business outcomes.
Senior Data Engineer focusing on Retrieval - Augmented Generation (RAG) and AI solutions at LexisNexis. Collaborating with teams to integrate AI into existing systems and optimizing models for performance.
Senior Data Engineer on CNN's AI Enablement & Machine Learning team optimizing ML and AI experiences. Collaborating with engineers to enhance data pipelines and integrate features into platforms.
Data Engineer at Sand Cherry Associates with expertise in ETL, Python, and SQL. Responsible for designing data structures and maintaining accuracy for client projects.
Data Engineer responsible for creating and maintaining ETL pipelines at Sand Cherry Associates. Requires strong expertise in Redshift SQL, Python, and DBT with hybrid work structure.