Full - Stack Data Engineer designing and optimizing complex data solutions for automotive content. Collaborating with teams to enhance user experience across MOTOR's product lines.
About the role
- Senior Data Engineer responsible for building and maintaining core datasets and APIs for global trade information. Join Kpler to leverage innovation for impactful results in commodities and maritime sectors.
Responsibilities
- Build and maintain Kpler's core datasets (vessels characteristics, companies, geospatial data).
- Responsible for creating and maintaining REST APIs, streaming pipelines (Kafka Stream), and Spark batch pipelines.
- Responsible for end-to-end ownership of development work, beginning with a clear understanding of assigned tickets and requirements.
- Designing and implementing functionality across APIs and data processing components.
- Ensuring deployments to development environments are tested and reviewed by peers and product stakeholders.
- Emphasize strong testing practices through unit, integration, and functional tests aligned with defined scenarios.
- Monitor performance, alerts, and SLOs to ensure the functionality operates reliably and optimally in production.
Requirements
- 6-8 years of experience in data-focused software engineering roles.
- Strong programming skills in Scala (or JVM) experience with Python preferred.
- Proven experience designing and operating RESTful APIs, including secure and versioned interfaces.
- Solid understanding of data modeling, schema evolution, versioning and serialization technologies such as Avro or Protobuf.
- Hands-on experience with SQL and NoSQL databases, including query optimization and performance tuning.
- Experience building and maintaining batch or streaming data systems, with knowledge of streaming patterns and reliability concerns.
- Familiarity with caching strategies, CI/CD pipelines, and modern monitoring and alerting practices.
- Proficiency with Git-based workflows, code reviews, and Agile development methodologies.
- Strong sense of ownership, with pragmatic problem-solving skills, constructive critique and the ability to deliver end-to-end solutions.
- Excellent communication skills and fluency in English, with the ability to collaborate effectively across product and engineering teams.
Benefits
- Professional development opportunities
- Flexible working hours
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Principal Data Engineer designing and evolving enterprise data platform. Collaborating with analytics teams to enable AI and data products at American Tower.
BI Data Engineer II supporting scalable Lakehouse data pipelines at Boston Beer Company. Collaborating with stakeholders to drive data ingestion and maintain enterprise data quality.
Senior Data Engineer at A Kube Inc responsible for building and maintaining data pipelines for product performance. Collaborating with product, engineering, and analytics teams to ensure data quality and efficiency.
Data Engineer designing and building data pipelines at LexisNexis. Collaborating with partners for high - quality analytics and AI - ready data.
Data Engineer implementing data pipelines on Snowflake platform with a focus on innovation and collaboration for Zurich's data projects.
Data Engineer engineering DUAL Personal Lines’ strategic data platforms for global insurance group. Providing technical expertise in data engineering and collaborating with internal teams for solution delivery.
Data Engineer role focused on creating and monitoring data pipelines in an innovative energy company. Collaborate with IT and departments to ensure quality data availability in a hybrid work environment.
SQL Migration Data Engineer at Auxo Solutions focusing on Azure SQL/Fabric Lakehouse migrations and building data pipelines. Collaborating on technical designs and data governance for modernization initiatives.
Data Engineer developing cloud solutions and software tools on Microsoft Azure big data platform. Collaborating with various teams for data analysis and visualization in healthcare.