Seeking a Senior/Lead Platform Engineer responsible for architecting and implementing scalable data and ML platforms. Focusing on AWS and Databricks, while leading DevSecOps practices.
Responsibilities
Architect and implement end-to-end data and ML platforms: data lakes, warehouses, streaming and batch pipelines, model training/deployment infrastructure, on AWS + Databricks.
Lead DevSecOps and DataOps practices: infrastructure as code (IaC), CI/CD pipelines for data & ML workflows, secure multi-account/multi-region cloud operations.
Integrate AWS services (e.g., S3, Redshift, Kinesis, Lambda, EKS/ECS) with Databricks runtime, Delta Lake, Unity Catalog etc to build scalable, performant pipelines.
Build and operate ML infrastructure: training clusters, model versioning, MLOps toolchain (e.g., MLflow), model monitoring and observability, automatic retraining workflows.
Establish data governance, lineage, quality, observability standards across data pipelines and ML workflows.
Mentor engineering teams, define architectural best practices and guide implementation of high-scale data/ML systems.
Optimize system performance, cost and scalability; diagnose and resolve large-scale production issues.
Continuously evaluate new tools and technologies in the areas of cloud, data platform, DevSecOps, ML infrastructure and apply them to drive innovation.
Requirements
7+ years of experience in data platform architecture, cloud/ML infrastructure engineering or related roles.
Deep technical expertise in **Databricks and AWS**: demonstrated ability to design, integrate and operate solutions spanning both platforms.
Strong hands-on implementation skills: you will not just design but build, deploy and operate the platform.
Proven track record of building and operating scalable ML/AI platforms in production (model training & deployment).
Expertise in Apache Spark, Delta Lake, modern data pipeline frameworks (batch + streaming).
Strong background in infrastructure as code (Terraform, CloudFormation), CI/CD for data/ML, and DevSecOps practices.
Proficiency in Python and SQL; familiarity with Scala or equivalent is a plus.
Experience with data governance, data lineage, observability and MLOps frameworks (e.g., MLflow, Airflow, dbt).
Bonus: Experience in fintech, regulated industries or high-security environments.
Principal Platform Engineer leading platform architecture and operations at Automata, transforming lab automation through integrated technology solutions in a hybrid work model.
Power Platform Engineer developing solutions using PowerPlatform at knowmad mood. Collaborating with multidisciplinary teams in Madrid for quality project delivery in a hybrid mode.
Cloud Operations Engineer responsible for ensuring operational stability of Saviynt’s cloud platform. Collaborating with teams to troubleshoot issues and implement improvements in a dynamic environment.
Platform Engineer working at Qodea to design and implement cloud solutions using Google Cloud for global leaders. Collaborating with teams to ensure optimal cloud performance and security.
Senior Platform Engineer creating scalable and efficient cloud systems for clients. Join Qodea's Professional Services team focused on innovation at the intersection of technology and design.
Engineer, Platform Engineering responsible for developing requirements, testing, and deploying VSAT platforms and modems. Collaborating across SES departments and with Platform Vendors.
Senior Platform Engineer in Crypto Security Engineering Team at TransUnion. Building secure, scalable infrastructure and collaborating with teams to maintain cryptographic services.
Platform Engineer at Radiance Technologies responsible for designing and implementing a Kubernetes platform. Collaborating to enhance scalability, security, and reliability of deployments while streamlining processes.
AI Agent Platform Engineer creating and maintaining infrastructure for AI agents at Binance. Focused on automation across trading, compliance, and customer service.
Data Platform Engineer developing cloud solutions for a leading retail company in Portugal and Spain. Collaborating on data pipelines and optimizing data integration solutions in a hybrid work environment.