Senior Data Engineer developing and optimizing data pipelines on Databricks for healthtech company. Collaborating with stakeholders and ensuring data integrity through efficient processing.
Responsibilities
Develop, manage, and optimize data pipelines on the Databricks platform.
Debug and troubleshoot Spark applications to ensure reliability and performance.
Implement best practices for Spark compute and optimize workloads.
Write clean, efficient, and reusable Python code using object-oriented programming principles.
Design and build APIs to support data integration and application needs.
Develop scripts and tools to automate data processing and workflows.
Integrate, query, and manage data within MongoDB.
Ensure efficient storage and retrieval processes tailored to application requirements.
Optimize MongoDB performance for large-scale data handling.
Work closely with data scientists, analysts, and other stakeholders to understand data needs and deliver solutions.
Proactively identify and address technical challenges related to data processing and system design.
Requirements
Proven experience working with Databricks and Spark compute.
Proficient in Python, including object-oriented programming and API development.
Familiarity with NoSQL (MongoDB preferred), including querying, data modeling, and optimization.
Strong problem-solving skills and ability to debug and optimize data processing tasks.
Experience with large-scale data processing and distributed systems.
Staff Backend Engineer developing backend services for Tonal's fitness platform. Collaborate with cross - functional teams to create innovative fitness technology and solutions.
Web Engineer for regulated environments in aerospace sector. Handling web platforms with a balance of technology and user interaction in an agile context.
Dynamics Power Platforms CE Technical Architect at KPMG focusing on delivering Microsoft Dynamics 365 solutions through client engagement. Involving in business processes, solution design and team collaboration.
Full Stack Angular & Node.js Engineer developing robust software solutions for digital commerce at BAUHAUS. Collaborating within an agile team to enhance customer shopping experiences.
Backend Software Engineer developing systems for AI - powered shopping assistant, Project Sparky. Designing and scaling distributed backend systems and collaborating with cross - functional teams.
Intern in frontend or backend development projects at agile IT consultancy for Audi and Capgemini. Gain experience with modern technologies while working closely with experienced colleagues.
Intern supporting software development team for 3 - 6 months, contributing to research projects and programming. Join Gauselmann Group delivering innovative entertainment devices.
Senior Python Developer focusing on AI and GenAI solutions for corporate cybersecurity. Implementing scalable AI systems and automating solutions within a collaborative team.
Developing medical technology solutions for chronic dialysis products. Collaborating across disciplines to create reliable medical devices adhering to strict regulatory standards.
Staff Backend Engineer focused on building foundational backend systems for Cloudinary’s platform. Collaborating with cross - functional teams for reliable and high - impact solutions.