Data Engineer designing and implementing data foundations for automation and AI solutions at RHI Magnesita. Collaborating with technical experts and ensuring data quality with occasional project - based travel.
About the role
- Senior Data Engineer enhancing data infrastructure using Databricks and GCP. Managing data pipelines and collaboration with data scientists for innovative solutions.
Responsibilities
- Design and implement robust data pipelines using Databricks and integrate these with Delta Lake for efficient data storage and management.
- Manage end-to-end data workflows from ingestion to insights, utilizing FiveTran for seamless data integration and GCP for scalable cloud solutions.
- Administer Databricks environments, ensuring optimal configuration, security, and performance across all data operations.
- Utilize Unity Catalog to manage data governance across all Databricks workspaces, ensuring compliance with data privacy and security policies.
- Develop and maintain scalable and efficient data models and architecture, supporting the strategic goals of the organization.
- Collaborate with data scientists and analysts to deploy machine learning models and complex analytical projects.
Requirements
- Bachelor’s degree in computer science, engineering, information technology or related field or four (4) years of relevant experience in lieu of degree.
- Minimum of five (5) years of experience [nine (9) years for non-degreed candidates] in a data engineering role with significant exposure to Databricks, Delta Lake, and cloud platforms like GCP.
- Proven expertise in Databricks administration and managing large-scale data environments.
- Strong experience with SQL, Python, and other scripting languages commonly used in data engineering.
- Familiarity with Fivetran or similar data integration tools and understanding of ETL processes.
Benefits
- Health insurance
- Professional development opportunities
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Data Warehouse Tech Lead leading GCP data projects at Derevo. Collaborating with internal teams to deliver high - quality data solutions in a hybrid role.
Senior Data Engineer transforming core business processes for Ørsted commodity trading. Developing data pipelines and working with a globally distributed team in IT and digital solutions.
Data Architect at Sabesp defining and documenting software architectures, system integration strategies and ensuring security and scalability.
Analytics Data Engineer supporting IHIE's data roadmap by designing pipelines and optimizing datasets. Requires collaboration with teams to enhance healthcare data analytics in Indiana.
Data Architecture Manager shaping enterprise data architecture for Anglian Water. Leading a team to drive data governance, integration, and AI - readiness across the organisation.
SAP Analyst in charge of SAP Data Migration solutions with a focus on business growth. Engaging clients and advising on leading practices to drive SAP success.
Designing, building, and operating data architecture on AWS for Bring! Labs. Leading data migration efforts and collaborating with product and operations teams.
Senior Data Engineer responsible for building data pipelines and infrastructure for AI integration in European companies. Join our team to shape exciting projects in a collaborative environment.
Data Engineer developing and maintaining data ingestion pipelines for an AI startup in public affairs. Collaborating with engineers to enhance data systems for expanded market reach.