Databricks Senior DevOps Engineer designing and operating platforms on AWS and Databricks for Financial Crime. Focused on platform infrastructure, governance, security, and operations.
Responsibilities
Architect, build, and operate end-to-end data and ML platforms on AWS and Databricks.
Own and administer Databricks workspaces for the Financial Crime platform.
Lead DevSecOps and DataOps practices, including infrastructure-as-code (IaC) and CI/CD pipelines for data and ML workflows.
Configure and optimize Databricks compute clusters (job clusters and all-purpose clusters) for performance, scalability, and cost efficiency.
Manage and enforce governance through Unity Catalog, including access control, security policies, data lineage, and isolation.
Build and operate ML infrastructure, including model deployment and serving endpoints.
Integrate AWS services (e.g., S3, Redshift, Kinesis, Lambda, EKS/ECS) with Databricks runtime and Delta Lake.
Implement platform security best practices, including secrets management, audit logging, and compliance controls.
Optimize system performance and diagnose large-scale production issues.
Mentor engineering teams and define architectural best practices for high-scale data and ML systems.
Requirements
7+ years of experience in data platform architecture, cloud infrastructure, or ML platform engineering.
Strong enterprise-level experience with Databricks and AWS.
Deep expertise in Unity Catalog governance and security models.
Hands-on experience designing, deploying, and operating Databricks clusters in production.
Experience managing Model Serving / ML deployment infrastructure.
Strong implementation mindset — able to design, build, deploy, and operate platforms end-to-end.
Experience operating in regulated environments (banking/fintech preferred).
Site Reliability Engineer Intern at Tencent working on gaming services and cloud native solutions. Collaborating with global teams to eliminate toil and enhance reliability.
Cloud/DevOps Specialist at N5X managing and optimizing critical cloud infrastructures for Brazilian energy trading. Collaborating with a multidisciplinary team to ensure high availability and performance.
Cloud/Devops Specialist responsible for designing a hybrid architecture combining cloud and on - premises infrastructure for energy trading systems. Collaborating with a multidisciplinary team in a dynamic environment.
Reliability Engineering Specialist utilizing reliability tools and models to improve asset performance at Enbridge. Collaborating across teams to guide investment decisions for safe operations.
DevOps Engineer responsible for structuring and supporting cloud DevOps architecture in Brazil. Working strategically on automation and CI/CD practices with development teams in Pernambuco.
DevSecOps Software Engineer developing secure CI/CD pipelines for Boeing's military software systems. Collaborate with cross - functional teams and implement automation and security best practices.
DevOps Manager responsible for managing a team for multi - cloud solutions supporting the USAF Cloud One project. Focus on scalable cloud - native solutions and CI/CD practices.
Lead Site Reliability Engineer overseeing SRE practices across Azure and GCP platforms. Driving reliability improvements and leading a team at Lloyds Banking Group.
DevOps Engineer responsible for managing Microsoft Intune operations at Bundesdruckerei GmbH. Focused on ensuring secure digital solutions for identity and data protection in Berlin.
Senior Site Reliability Engineer driving observability and reliability for business - critical systems at Incedo. Collaborating with engineering teams to enhance system resilience and performance.