Data Engineer responsible for building and maintaining data solutions on AWS and GCP. Focus on Lakehouse architecture to support analytics, reporting, and AI/ML use cases.
About the role
- Data Engineer at dsm-firmenich designing and maintaining robust data pipelines. Collaborating on impactful projects centered around data for health, nutrition, and beauty.
Responsibilities
- Provide technical recommendations and evaluate project feasibility and workloads.
- Design and implement efficient pipeline architectures for data ingestion, transformation, and storage.
- Develop modular, efficient code for data transformation and integration, ensuring adherence to modern development practices.
- Perform data ingestion from source systems, including ETL processes, when tables are not available on the data platform.
- Conduct regular pipeline maintenance and upgrades, troubleshooting and resolving issues to ensure optimal performance.
- Implement data quality testing and validation to maintain high standards of data integrity and reliability.
Requirements
- Expert knowledge in SAP, SQL, Python, Spark, Git, Databricks, and dbt.
- Strong problem-solving skills.
- 5+ years’ experience in creating and maintaining data pipelines.
- Ability to closely collaborate with data modelers to ensure seamless data integration and transformation.
- Proficiency in modern development practices and data quality testing.
- Commitment to continuous learning and improvement.
Benefits
- Unique career paths across health, nutrition and beauty, explore what drives you and get the support to make it happen
- A chance to impact millions of consumers every day, sustainability embedded in all we do
- A science-led company, cutting edge research and creativity everywhere, from biotech breakthroughs to sustainability game-changers, you’ll work on what’s next
- Growth that keeps up with you, you join an industry leader that will develop your expertise and leadership
- A culture that lifts you up, with collaborative teams, shared wins, and people who cheer each other on.
- A community where your voice matters, it is essential to serve our customers well.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Data Engineer for Verity, a digital transformation consultancy, designing data architectures and building scalable pipelines. Collaborates on data quality and analytical dataset structuring.
Data Engineer Pleno at Verity focusing on building data pipelines and analytics frameworks. Engage with teams to ensure data quality and enhance cloud - based solutions.
Data Engineer at GFT managing data systems and workflows, focusing on data engineering and data science collaboration. Leveraging technologies like Python, Airflow, and AWS.
Senior Data Engineer at Shopmonkey building and maintaining data infrastructure. Driving strategic decisions for tools and processes while ensuring data quality across platforms.
Data Scientist developing customer - focused data products to improve customer journey at Noibu. Collaborating with teams to analyze feedback data and shape analytics strategies.
Data Engineer at fundcraft ensuring seamless data movement and storage. Focus on data migrations, ETL maintenance, and collaboration with the Product team for insights.
Databricks Data Engineer developing scalable data pipelines within the insurance domain. Building ETL workflows on Azure and Databricks for analytics and business decision - making.
Senior Engineer with expertise in AWS, Microsoft Fabric, and Purview at EXL. Leading development of scalable cloud and data governance solutions while mentoring engineering teams.
Senior Engineer with expertise in AWS, Microsoft Fabric, and Purview at EXL. Driving architecture, development, and implementation of scalable cloud and data governance solutions.