Apache Spark Specialist responsible for architecting and managing Spark environments on Nebul's AI cloud. Focus on performance, security, and solution innovation within a hybrid work environment.
Responsibilities
Architect, deploy, and operate scalable Apache Spark environments on Nebul’s sovereign AI cloud
Design and optimize Spark workloads for GPU-accelerated and distributed performance
Define and implement best practices for security, monitoring, governance, and data protection
Partner closely with product, engineering, and customer teams to shape our managed Spark offering
Evaluate and integrate complementary technologies (e.g., Delta Lake, Lakehouse components, tooling)
Support early customer pilots and translate feedback into roadmap improvements
Develop automation and CI/CD deployment models to ensure reliability, repeatability, and efficiency
Document architectures, operational procedures, and performance benchmarks
Requirements
4–7 years of experience working with Apache Spark in production environments
Strong deep-dive knowledge of Spark internals: performance tuning, partition strategies, caching, and shuffle management
Hands-on deployment experience in Kubernetes, cloud infrastructure, or on-prem clusters
Solid understanding of distributed data platforms (e.g., Databricks, EMR, Hadoop, Lakehouse architectures)
Strong scripting and automation skills (Python / Scala preferred)
Ability to translate client needs into technical architectures and operational models
Familiarity with cloud-security principles and infrastructure-as-code practices
Valid EU work permit (no sponsorship currently available)
Entry - Level Data Engineer at GM, focusing on building large scale data platforms in cloud environments. Collaborating with data engineers and scientists while migrating systems to cloud solutions.
Data Engineer designing and building scalable ETL/ELT pipelines for enterprise - grade analytics solutions. Collaborating with product teams to deliver high - quality, secure, and discoverable data.
Data Engineer responsible for data integrations with AWS technology stack for Adobe's Digital Experience. Collaborating with multiple teams to conceptualize solutions and improve data ecosystem.
People Data Architect designing and managing people data analytics for Gen, delivering actionable insights for HR. Collaborating across teams to enhance data - driven decision - making.
Data Engineer role focused on shaping future connectivity for customers at Vodafone. Involves solving complex challenges in a diverse and inclusive environment.
VP, Senior Data Engineer responsible for designing and developing cloud data solutions for insider risk in Information Security at SMBC. Collaborating with multiple teams to enhance cybersecurity data platform.
Data Engineer responsible for architecting, developing, and maintaining Allegiant’s enterprise data infrastructure. Overseeing transition to cloud hosted data warehouse and developing next - generation data tools.
Senior Data Engineer developing Azure - based data solutions for clients in the Data & AI department. Collaborating with architects and consultants to enhance automated decision making.
Data Engineer II focusing on strategic ingestion product for Travelers. Building data solutions and collaborating across teams to support analytic transformation.
Data Engineer at Tatum focusing on scalable data solutions and blockchain technology. Collaborating with teams to ensure data integrity and manage data infrastructure in a hybrid setup.