Chief Data Engineer leading Scania’s Commercial Data Engineering team for growing sustainable transport solutions. Focused on data products and pipelines for BI, analytics, and AI.
About the role
- Data Warehouse Developer responsible for developing and maintaining an open-source Data Lakehouse at Uni Systems. Involves designing data pipelines and ensuring data quality across multiple sources.
Responsibilities
- Development and maintenance of a fully open-source Data Lakehouse.
- Design and development of data pipelines for scalable and reliable data workflows to transform extensive quantities of both structured and unstructured data.
- Data integration from various sources, including databases, APIs, data streaming services and cloud data platforms.
- Optimisation of queries and workflows for increased performance and enhanced efficiency.
- Writing modular, testable and production-grade code.
- Ensuring data quality through monitoring, validation and data quality checks, maintaining accuracy and consistency across the data platform.
- Elaboration of test programs.
- Document processes comprehensively to ensure seamless data pipeline management and troubleshooting.
- Assistance with deployment and configuration of the system.
- Participation in meetings with other project teams.
Requirements
- Bachelor degree in IT or related field and 13 years of professional experience in IT.
- Excellent knowledge of data warehouse and/or data lakehouse design & architecture.
- Excellent knowledge of open-source, code-based data transformation tools such as dbt, Spark and Trino.
- Excellent knowledge of SQL.
- Good knowledge of Python.
- Good knowledge of open-source orchestration tools such as Airflow, Dagster or Luigi.
- Experience with AI-powered assistants like Amazon Q that can streamline data engineering processes.
- Good knowledge of relational database systems.
- Good knowledge of event streaming platforms and message brokers like Kafka and RabbitMQ.
- Extensive experience in creating end-to-end data pipelines and the ELT framework.
- Understanding of the principles behind storage protocols like Apache Iceberg or Delta Lake.
- Proficiency with Kubernetes and Docker/Podman.
- Good knowledge of data modelling tools.
- Good knowledge of online analytical data processing (OLAP) and data mining tools.
- Fluent in English at least at a level C1.
Benefits
- At Uni Systems, we are providing equal employment opportunities and banning any form of discrimination on grounds of gender, religion, race, color, nationality, disability, social class, political beliefs, age, marital status, sexual orientation or any other characteristics.
- Take a look at our Diversity, Equality & Inclusion Policy for more information.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Data Engineer designing and building scalable ETL/ELT pipelines for enterprise - grade analytics solutions. Collaborating with product teams to deliver high - quality, secure, and discoverable data.
Entry - Level Data Engineer at GM, focusing on building large scale data platforms in cloud environments. Collaborating with data engineers and scientists while migrating systems to cloud solutions.
Data Engineer responsible for data integrations with AWS technology stack for Adobe's Digital Experience. Collaborating with multiple teams to conceptualize solutions and improve data ecosystem.
People Data Architect designing and managing people data analytics for Gen, delivering actionable insights for HR. Collaborating across teams to enhance data - driven decision - making.
Data Engineer role focused on shaping future connectivity for customers at Vodafone. Involves solving complex challenges in a diverse and inclusive environment.
VP, Senior Data Engineer responsible for designing and developing cloud data solutions for insider risk in Information Security at SMBC. Collaborating with multiple teams to enhance cybersecurity data platform.
Data Engineer responsible for architecting, developing, and maintaining Allegiant’s enterprise data infrastructure. Overseeing transition to cloud hosted data warehouse and developing next - generation data tools.
Senior Data Engineer developing Azure - based data solutions for clients in the Data & AI department. Collaborating with architects and consultants to enhance automated decision making.
Data Engineer II focusing on strategic ingestion product for Travelers. Building data solutions and collaborating across teams to support analytic transformation.