Senior Data Engineer supporting AI - enabled financial compliance initiative with data pipelines and ingestion processes. Collaborating with diverse teams in a mission - critical regulated environment.
About the role
- Data Migration Engineer facilitating data migration to AWS S3 buckets for key Government repository. Collaborating with stakeholders to ensure data integrity and accessibility in a high-tech environment.
Responsibilities
- Assess and inventory existing legacy data in shared folders and shared drives.
- Assess the quality, completeness, and relevance of data to be migrated.
- Identify and document data dependencies, redundancies, and inconsistencies.
- Collaborate with stakeholders to understand data structures, relationships, and required formats for successful migration.
- Develop a comprehensive data migration plan that outlines steps, timelines, and resource requirements for the migration process.
- Identify potential challenges and propose solutions to mitigate risks associated with data migration.
- Migrate legacy data to AWS S3 buckets, ensuring data integrity and security throughout the process.
- Implement indexing strategies for the migrated data, enabling seamless access and retrieval.
- Conduct thorough testing of the migrated data to ensure accuracy, completeness, and successful integration.
- Create validation reports and document any discrepancies, working closely with stakeholders to resolve issues.
- Collaborate with software engineers, database administrators, and development teams to ensure compatibility and alignment with the overall architecture.
- Maintain effective communication with project stakeholders to provide updates on migration progress and gather feedback.
- Create and maintain technical documentation related to data migration processes, procedures, and system configurations.
- Generate reports on migration progress, data quality metrics, and issue resolution.
- Provide user guides and training materials to assist end-users with accessing and utilizing the newly migrated data.
Requirements
- Bachelor’s degree in Computer Science, Information Technology, Data Science, or a related field.
- Previous experience as a Database Engineer and proven experience in data migration, particularly with legacy systems and cloud environments.
- Proficiency in data migration tools and ETL processes (e.g., Talend, Informatica, SSIS, or similar).
- Strong knowledge of database management systems (e.g., SQL Server, Oracle, MySQL, PostgreSQL).
- Experience with scripting languages (e.g., Python, SQL, PowerShell) for data transformation and automation.
- Strong knowledge of AWS, specifically S3, and experience with data storage and retrieval solutions.
- Familiarity with indexing and data accessibility in software applications.
- U.S. Citizen with active TS/SCI clearance (with CI Polygraph).
Benefits
- healthcare
- wellness
- financial
- retirement
- family support
- continuing education
- time off benefits
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Data Architect leading the definition and construction of cloud data architecture for Kyndryl. Participating in significant technological modernization initiatives, focusing on Google Cloud Platform.
Senior Data Engineer driving data intelligence requirements and scalable data solutions for a global consulting firm. Collaborating across functions to enhance Microsoft architecture and analytics capabilities.
Experienced AI Engineer designing and building production - grade agentic AI systems using generative AI and large language models. Collaborating with data engineers, data scientists in a tech - driven company.
Intermediate Data Engineer designing and building data pipelines for travel industry data management. Collaborating across teams to ensure reliable data for analytics and reporting.
Data Engineer managing and organizing datasets for AI models at Walaris, developing AI - driven autonomous systems for defense and security applications.
Data Engineer designing and maintaining data pipelines at Black Semiconductor. Collaborating with process, equipment, and IT teams to support manufacturing analytics and decision - making.
Junior Data Engineer role focusing on Business Intelligence and Big Data at Avanade. Collaborating on data analysis and SQL queries in a supportive learning environment.
GCP Data Engineer designing and developing data processing modules for Ki, an algorithmic insurance carrier. Working closely with multiple teams to optimize data pipelines and reporting.
Data Engineer at Securian Financial optimizing scalable data pipelines for AI and advanced analytics. Collaborating with teams to deliver secure and accessible data solutions.