Machine Learning Engineer designing and implementing AI systems focused on Japanese language challenges at Woven by Toyota. Involves technical R&D, system design, and collaboration with cross - functional teams.
About the role
- Senior ML Platform Engineer at GEICO focusing on building scalable machine learning infrastructure and managing AI applications. Responsible for design, implementation, and mentoring within the ML team.
Responsibilities
- Design and implement scalable infrastructure for training, fine-tuning, and serving open source LLMs (Llama, Mistral, Gemma, etc.)
- Architect and manage Kubernetes clusters for ML workloads, including GPU scheduling, autoscaling, and resource optimization
- Design, implement, and maintain feature stores for ML model training and inference pipelines
- Build and optimize LLM inference systems using frameworks like vLLM, TensorRT-LLM, and custom serving solutions
- Ensure 99.9%+ uptime for ML platforms through robust monitoring, alerting, and incident response procedures
- Design and implement ML platforms using DataRobot, Azure Machine Learning, Azure Kubernetes Service (AKS), and Azure Container Instances
- Develop and maintain infrastructure using Terraform, ARM templates, and Azure DevOps
- Implement cost-effective solutions for GPU compute, storage, and networking across Azure regions
- Ensure ML platforms meet enterprise security standards and regulatory compliance requirements
- Evaluate and potentially implement hybrid cloud solutions with AWS/GCP as backup or specialized use cases
- Mentor junior engineers and data scientists on platform best practices, infrastructure design, and ML operations
- Lead comprehensive code reviews focusing on scalability, reliability, security, and maintainability
- Design and deliver technical onboarding programs for new team members joining the ML platform team
- Work closely with data scientists to understand requirements and optimize workflows for model development and deployment
Requirements
- Bachelor’s degree in computer science, Engineering, or related technical field (or equivalent experience)
- 8+ years of software engineering experience with focus on infrastructure, platform engineering, or MLOps
- 3+ years of hands-on experience with machine learning infrastructure and deployment at scale
- 2+ years of experience working with Large Language Models and transformer architectures
- Proficient in Python; strong skills in Go, Rust, or Java preferred
- Proven experience working with open source LLMs (Llama 2/3, Qwen, Mistral, Gemma, Code Llama, etc.)
- Proficient in Kubernetes including custom operators, helm charts, and GPU scheduling
- Deep expertise in Azure services (AKS, Azure ML, Container Registry, Storage, Networking)
- Experience implementing and operating feature stores (Chronon, Feast, Tecton, Azure ML Feature Store, or custom solutions)
- Hands-on experience with inference optimization using vLLM, TensorRT-LLM, Triton Inference Server, or similar
- Advanced experience with Azure DevOps, GitHub Actions, Jenkins, or similar CI/CD platforms
- Proficiency with Terraform, ARM templates, Pulumi, or CloudFormation
- Deep understanding of Docker, container optimization, and multi-stage builds
- Experience with Prometheus, Grafana, ELK stack, Azure Monitor, and distributed tracing
- Knowledge of both SQL and NoSQL databases, data warehousing, and vector databases
- Demonstrated track record of mentoring engineers and leading technical initiatives
- Experience leading design reviews with focus on compliance, performance, and reliability
Benefits
- Comprehensive Total Rewards program that offers personalized coverage tailor-made for you and your family’s overall well-being.
- Financial benefits including market-competitive compensation; a 401K savings plan vested from day one that offers a 6% match; performance and recognition-based incentives; and tuition assistance.
- Access to additional benefits like mental healthcare as well as fertility and adoption assistance.
- Supports flexibility- We provide workplace flexibility as well as our GEICO Flex program, which offers the ability to work from anywhere in the US for up to four weeks per year.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Principal Software Engineer leading MLOps within Analytics Platform at Sun Life. Focused on AWS and machine learning operations, collaborating across technical and business teams.
Machine Learning Engineer designing and optimizing deep learning models for safety - critical environments at Destinus. Shaping the future of high - speed, autonomous flight technologies.
Machine Learning Engineer optimizing personalization systems for Spotify's audio streaming service. Collaborating with cross - functional teams to enhance user experience and deliver recommendations.
Principal Machine Learning Engineer developing ML and GenAI solutions in a cloud - native environment at Flexera. Leading a high - impact team and driving operational excellence for ML infrastructure.
Senior ML Platform/Ops Engineer building AI - powered ML pipelines for a dynamic Ed - Tech company. Collaborating with ML scientists and engineers to ensure reliable deployment and observability.
Senior ML Platform/Ops Engineer building ML systems for AI - powered learning at Preply. Productionizing machine learning with high reliability, performance, and observability in a hybrid environment.
Senior ML Platform/Ops Engineer at Preply building and maintaining ML pipelines, collaborating with ML Scientists and Data Engineers.
Machine Learning Engineer developing advanced Deep Learning models for autonomous driving technology at Mobileye. Collaborating in a high - end algorithmic engineering team on critical computer vision challenges.
Machine Learning Engineer focusing on vulnerabilities and security of AI systems at Carnegie Mellon University. Collaborating with a team to build robust prototypes and provide solutions for government sponsors.