Contract Data Platform Engineer focusing on Spark and ETL at a data services company. Designing scalable systems and collaborating with data scientists and engineers.
Responsibilities
Design and develop scalable, distributed, and resilient software systems.
Build, test, and optimize Spark-based ETL pipelines in Scala or Python.
Collaborate with researchers and data scientists to deliver production-ready data and models.
Participate in architecture discussions, peer reviews, and deployment processes.
Define and monitor technical and operational metrics to ensure system health and performance.
Continuously identify areas for optimization and efficiency improvements across services.
Mentor junior engineers and contribute to engineering best practices.
Drive innovation by staying current with emerging tools and technologies.
Requirements
5+ years of software engineering experience
Strong programming skills in Scala, Python, or Java
Spark experience for building and optimizing ETL jobs
Experience with Databricks (DBX) – workflows, data development, and debugging
Solid understanding of microservices architecture and distributed systems
Experience with AWS, Docker, and Kubernetes
Familiarity with Spring Boot, Terraform, and infrastructure-as-code
Platform Engineer leading lifecycle management of MOM and AMHS systems across Kubernetes clusters in semiconductor industry. Collaborating with internal teams to ensure operational reliability in manufacturing.
Own product platform and release - quality systems for AI SaaS startup. Implement analytics, build dashboards, and ensure safe releases while maintaining high quality standards.
Principal Cloud Security Design Engineer defining and engineering cloud security architecture. Leading technical initiatives in Azure and AWS environments for financial services company.
Mid - level Platform Engineer for FAA modernization project at OCH Technologies. Responsible for designing, implementing, and managing secure automated platform environments supporting aviation systems.
Hands - on engineer designing, building, and maintaining core backend systems at MyFunded Futures. Leading technical architecture and mentoring the engineering team in a fintech environment.
Software Engineer developing advanced trading applications for professional derivatives traders at TT. Collaborate with the team to enhance the award - winning trading platform.
Senior Platform Engineer helping design, scale, and harden Pivotal’s AI - driven platform. Collaborating closely with engineering teams to improve reliability, security, and scalability.
Senior technical authority at Smarsh managing large - scale distributed data platforms. Leading architectural design, influencing engineering standards, and mentoring engineers across the organization.
AI Platform Engineer building post - RPA automation platforms for enterprises. Collaborating on AI - driven solutions across UIs and APIs with a focus on governance and outcomes.