Data Migration Specialist handling large - scale data migration from legacy to enterprise PLM platform. Analyzing data structures, developing strategies, and ensuring integrity across systems.
About the role
- Data Engineer developing core algorithms and back-end pipelines for cargo tracking at Kpler. Collaborating with data engineers and scientists to optimize system performance and data quality.
Responsibilities
- Working alongside data engineers, data scientists and product managers, take responsibility for the development and implementation of our core algorithms and back-end data pipelines, based on project requirements and design specifications.
- Help clients and internal users benefit from the highest cargo tracking data quality by adding new features and reviewing pipelines and integrations with our datastores.
- Help to optimise system performance, maintain features, troubleshoot issues, and ensure high availability.
- Demonstrate strong analytical and debugging skills with a proactive approach to learning.
Requirements
- Have hands-on experience with **Python**. Experience with **Flask** or **SQLALchemy** is a plus.
- Solid **SQL** skills for querying and managing relational databases.
- Knowledge of streaming and big data technologies (such as** Kafka or Spark**).
- Comfortable working with **Git**, code reviews, and **Agile methodologies**.
- Have an understanding of containerisation and orchestration tools (e.g., **Docker, Kubernetes**).
- Are eager to learn new languages and technologies.
- Have worked with **AWS **(or another cloud provider), using **Terraform**.
- Have experience with Scala or other **JVM Languages**.
- Exposure to **Elasticsearch.**
Benefits
- Health insurance
- Professional development opportunities
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
No Education Requirement
Tech skills
Location requirements
Director leading strategy, governance, and delivery of enterprise data platform at Phillips 66. Partnering with AI, Data Science, and business teams to enhance analytics and business systems.
Product Owner driving ERP data migration initiatives for BioNTech’s global landscape. Leading effective data management and ensuring compliance with regulatory standards in a fast - paced environment.
Data Engineer II leading development and delivery of data pipelines for Syneos Health. Collaborating with teams to optimize data processing and integrate solutions into production environments.
Lead Data Engineer overseeing data operations and analytics engineering teams for OneOncology. Focused on operational excellence in data platform and model reliability for cancer care improvement.
Senior AWS Software Data Engineer at Boeing focusing on AWS Data services to support digital analytics capabilities. Collaborating with cross - functional teams to design, develop, and maintain software data solutions.
Senior Data Engineer designing and improving software for business capabilities at Barclays. Collaborating with teams to build a data and intelligence platform for Equity Derivatives.
Senior AI & Data Engineer developing and implementing AI solutions in collaboration with clients and teams. Working on projects involving generative AI, predictive analytics, and data mastery.
Consultant driving IA business growth in Deloitte's Artificial Intelligence & Data team. Delivering innovative solutions using data analytics and automation technologies.
Data Engineer responsible for managing data architecture and pipelines at Snappi, a neobank. Collaborating with teams to enable data processing and analysis in innovative banking solutions.