Data Migration Specialist handling large - scale data migration from legacy to enterprise PLM platform. Analyzing data structures, developing strategies, and ensuring integrity across systems.
About the role
- Senior Data Engineer designing and maintaining data processing pipelines for analytics and machine learning in a fast-paced startup. Collaborating with cross-functional teams to ensure data accuracy and security.
Responsibilities
- Design, develop, and maintain scalable data processing pipelines and workflows using frameworks such as Apache Spark, PySpark, and Apache Beam.
- Build and maintain microservices in Python that serve data-driven features in production.
- Develop internal tools to support CI/CD pipelines, experiment tracking, and data versioning.
- Collect, process, and integrate large datasets from multiple sources, including databases, file systems, and APIs.
- Ensure data integrity, consistency, and quality through robust validation and monitoring processes.
- Optimize data systems for performance, scalability, and high availability.
- Implement best practices for data security, access control, and privacy.
- Collaborate with data scientists, analysts, and engineers to support analytics and ML workflows.
Requirements
- 5+ years of professional experience in software engineering or data engineering.
- Strong software engineering skills with Python in large-scale, high-performance production environments.
- Hands-on experience with Spark/PySpark and other big data frameworks.
- Expertise in data modeling and working with both structured and unstructured data.
- Hands-on experience with streaming data platforms, particularly Apache Kafka.
- Strong understanding of distributed systems and modern data architectures.
- Experience working with cloud platforms, preferably GCP (BigQuery, Dataflow, Pub/Sub, Dataproc).
- Excellent problem-solving and communication skills.
Benefits
- Office Snacks and Activities: Fuel your work with various snacks and enjoy fun activities that keep our team spirit high. Whether it's a darts match, board games, or yoga, we believe a happy team is productive.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Director leading strategy, governance, and delivery of enterprise data platform at Phillips 66. Partnering with AI, Data Science, and business teams to enhance analytics and business systems.
Product Owner driving ERP data migration initiatives for BioNTech’s global landscape. Leading effective data management and ensuring compliance with regulatory standards in a fast - paced environment.
Data Engineer II leading development and delivery of data pipelines for Syneos Health. Collaborating with teams to optimize data processing and integrate solutions into production environments.
Lead Data Engineer overseeing data operations and analytics engineering teams for OneOncology. Focused on operational excellence in data platform and model reliability for cancer care improvement.
Senior AWS Software Data Engineer at Boeing focusing on AWS Data services to support digital analytics capabilities. Collaborating with cross - functional teams to design, develop, and maintain software data solutions.
Senior Data Engineer designing and improving software for business capabilities at Barclays. Collaborating with teams to build a data and intelligence platform for Equity Derivatives.
Senior AI & Data Engineer developing and implementing AI solutions in collaboration with clients and teams. Working on projects involving generative AI, predictive analytics, and data mastery.
Consultant driving IA business growth in Deloitte's Artificial Intelligence & Data team. Delivering innovative solutions using data analytics and automation technologies.
Data Engineer responsible for managing data architecture and pipelines at Snappi, a neobank. Collaborating with teams to enable data processing and analysis in innovative banking solutions.