Data Engineer developing ETL processes and BI solutions for RUF Lebensmittelwerk. Collaborating on data models in a cloud environment with Microsoft technologies.
About the role
- Senior Data Engineer enhancing data infrastructure using Databricks and GCP. Managing data pipelines and collaboration with data scientists for innovative solutions.
Responsibilities
- Design and implement robust data pipelines using Databricks and integrate these with Delta Lake for efficient data storage and management.
- Manage end-to-end data workflows from ingestion to insights, utilizing FiveTran for seamless data integration and GCP for scalable cloud solutions.
- Administer Databricks environments, ensuring optimal configuration, security, and performance across all data operations.
- Utilize Unity Catalog to manage data governance across all Databricks workspaces, ensuring compliance with data privacy and security policies.
- Develop and maintain scalable and efficient data models and architecture, supporting the strategic goals of the organization.
- Collaborate with data scientists and analysts to deploy machine learning models and complex analytical projects.
Requirements
- Bachelor’s degree in computer science, engineering, information technology or related field or four (4) years of relevant experience in lieu of degree.
- Minimum of five (5) years of experience [nine (9) years for non-degreed candidates] in a data engineering role with significant exposure to Databricks, Delta Lake, and cloud platforms like GCP.
- Proven expertise in Databricks administration and managing large-scale data environments.
- Strong experience with SQL, Python, and other scripting languages commonly used in data engineering.
- Familiarity with Fivetran or similar data integration tools and understanding of ETL processes.
Benefits
- Health insurance
- Professional development opportunities
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Manager leading data and analytics projects to enhance client operations across multiple states at PwC. Focusing on strategic planning, mentoring junior staff, and project success.
Data Engineer II specializing in automated systems for data processing and analysis in property taxation. Collaborating across teams to ensure accuracy and deliver timely solutions.
Data Architect leading scalable cloud - based architectures at Fidelity. Collaborating with cross - functional teams to modernize brokerage recordkeeping systems and ensure data compliance.
Salesforce Solutions Architect specializing in Data Engineering at Pottencial, integrating Salesforce with analytical platforms. Leading governance and scalable solutions in CRM environments.
Data Engineer developing complex software systems for a multinational IT services company in Switzerland. Utilizing data engineering techniques and high - level programming languages.
Senior Data Management Engineer at a leading IT Consulting firm. Designing enterprise data solutions ensuring data quality and governance using Informatica tools.
Senior Data Management Engineer designing and implementing enterprise data solutions for a global IT leader. Collaboration with stakeholders to ensure data quality and scalability.
Senior Data Management Engineer designing and implementing data solutions for a global IT consulting leader. Collaborating with teams to ensure data accessibility, quality, and governance.
Data Architect responsible for designing data systems architecture at Amoddex, a consulting firm specialized in IT strategy and transformation. Collaborate on various data projects to enhance organization processes.