Lead Data Engineer overseeing engineers and advancing the data platform at American Family Insurance. Creating tools and infrastructure to empower teams across the company.
About the role
- Senior Data Engineer responsible for BI products development with a focus on data engineering and analytics. Join global logistics firm during its digital transformation process from Matosinhos, Portugal.
Responsibilities
- Design end-to-end Lakehouse architectures (Bronze/Silver/Gold) using Databricks and Delta Lake.
- Define reference architectures for batch, streaming, and near-real-time workloads.
- Ensure scalability, security, cost optimization, and high availability across environments.
- Build and optimize ETL/ELT pipelines using Spark (PySpark / SQL).
- Implement ingestion from APIs, event streams, files, databases, and message brokers.
- Define data quality rules, validation frameworks, and monitoring.
- Integrate Databricks with cloud services (Azure, AWS and GCP).
- Enable model curated datasets for BI, analytics, and ML use cases.
- Act as technical lead for data engineering teams.
Requirements
- Expert knowledge of Microsoft’s BI stack, namely Azure SQL Database/Azure Synapse, Azure Analysis Services, ADF, Databricks, DevOps.
- Expertise with Delta Lakes, PowerBI, and Python preferred.
- Capable of systematically and rationally analyzing the root cause of problems.
- Experienced with Agile methodology, and the promotion & facilitation of respective technical deliveries.
- Self-starter, takes responsibility for driving his/her portfolio of tasks and projects.
- Bachelor’s or Master’s degree in Computer Sciences
- 6-10 years of experience in BI projects, preferably in the Logistics industry.
- Proficient Level of English (spoken and written).
Benefits
- Permanent contract (with basic salary in 14 installments per year)
- Private medical care
- English courses - financial or co-financed by company
- Food allowance (EUR 10.20, per working day)
- Work schedule 35h/week
- Hybrid and flexible work (3 days in a week at the office)
- Comprehensive onboarding program
- Buddy
- Good access to public transports
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Working Student contributing to data engineering projects for AI/ML workflows while gaining hands - on experience with data pipelines and tools.
Data Architect designing end - to - end Snowflake data solutions and collaborating with technical stakeholders at Emerson. Supporting the realization of Data and Digitalization Strategy.
Manager of Data Engineering leading data assets and infrastructure initiatives at CLA. Collaborating with teams to enforce data quality standards and drive integration efforts.
Data Engineer building modern Data Lake architecture on AWS and implementing scalable ETL/ELT pipelines. Collaborating across teams for analytics and reporting on gaming platforms.
Chief Data Engineer leading Scania’s Commercial Data Engineering team for growing sustainable transport solutions. Focused on data products and pipelines for BI, analytics, and AI.
Entry - Level Data Engineer at GM, focusing on building large scale data platforms in cloud environments. Collaborating with data engineers and scientists while migrating systems to cloud solutions.
Data Engineer designing and building scalable ETL/ELT pipelines for enterprise - grade analytics solutions. Collaborating with product teams to deliver high - quality, secure, and discoverable data.
Data Engineer responsible for data integrations with AWS technology stack for Adobe's Digital Experience. Collaborating with multiple teams to conceptualize solutions and improve data ecosystem.
People Data Architect designing and managing people data analytics for Gen, delivering actionable insights for HR. Collaborating across teams to enhance data - driven decision - making.