Apache Spark Specialist responsible for architecting and managing Spark environments on Nebul's AI cloud. Focus on performance, security, and solution innovation within a hybrid work environment.
Responsibilities
Architect, deploy, and operate scalable Apache Spark environments on Nebul’s sovereign AI cloud
Design and optimize Spark workloads for GPU-accelerated and distributed performance
Define and implement best practices for security, monitoring, governance, and data protection
Partner closely with product, engineering, and customer teams to shape our managed Spark offering
Evaluate and integrate complementary technologies (e.g., Delta Lake, Lakehouse components, tooling)
Support early customer pilots and translate feedback into roadmap improvements
Develop automation and CI/CD deployment models to ensure reliability, repeatability, and efficiency
Document architectures, operational procedures, and performance benchmarks
Requirements
4–7 years of experience working with Apache Spark in production environments
Strong deep-dive knowledge of Spark internals: performance tuning, partition strategies, caching, and shuffle management
Hands-on deployment experience in Kubernetes, cloud infrastructure, or on-prem clusters
Solid understanding of distributed data platforms (e.g., Databricks, EMR, Hadoop, Lakehouse architectures)
Strong scripting and automation skills (Python / Scala preferred)
Ability to translate client needs into technical architectures and operational models
Familiarity with cloud-security principles and infrastructure-as-code practices
Valid EU work permit (no sponsorship currently available)
Lead Data Engineer overseeing data operations and analytics engineering teams for OneOncology. Focused on operational excellence in data platform and model reliability for cancer care improvement.
Senior AWS Software Data Engineer at Boeing focusing on AWS Data services to support digital analytics capabilities. Collaborating with cross - functional teams to design, develop, and maintain software data solutions.
Senior Data Engineer designing and improving software for business capabilities at Barclays. Collaborating with teams to build a data and intelligence platform for Equity Derivatives.
Senior AI & Data Engineer developing and implementing AI solutions in collaboration with clients and teams. Working on projects involving generative AI, predictive analytics, and data mastery.
Consultant driving IA business growth in Deloitte's Artificial Intelligence & Data team. Delivering innovative solutions using data analytics and automation technologies.
Data Engineer responsible for managing data architecture and pipelines at Snappi, a neobank. Collaborating with teams to enable data processing and analysis in innovative banking solutions.
Data Engineer at Destinus developing the data platform to support production and analytics needs. Involves migrating Excel sources to Lakehouse and integrating ERP systems in a hybrid role.
Senior Data Engineer developing solutions within the Global Specialty portfolio at an insurance company. Engaging with diverse business partners to ensure high quality data reporting.
Data Engineer at UBDS Group focusing on designing and optimizing modern data platforms. Collaborating in a multidisciplinary team to develop reliable data assets for analytics and operational use cases.
Data Consultant at SDG Group specializing in Data & Analytics projects. Collaborate on technical - functional definitions, ETL, data modeling, and visualization for cloud solutions.