Senior LLMOps Engineer developing and managing LLMOps infrastructure for AI Care Partner at Heidi. Collaborating with engineers and researchers to optimize model deployment and automation.
Responsibilities
Lead the architecture, design, and implementation of our end-to-end LLMOps platform, from data ingestion and model training pipelines to production deployment and monitoring.
Build and maintain robust CI/CD/CT (Continuous Integration/Continuous Delivery/Continuous Training) pipelines to automate the testing, validation, and deployment of large language models.
Engineer highly available and scalable model serving solutions using modern infrastructure like Kubernetes, ensuring low latency and high throughput for our production services.
Collaborate closely with AI research and engineering teams to understand their needs, streamline workflows, and create the tooling that accelerates their development cycles.
Champion and implement best practices for model versioning, experiment tracking, monitoring, and governance across the organization.
Mentor mid-level and junior engineers, sharing your deep expertise in infrastructure, automation, and operational excellence to foster a culture of reliability and scalability.
Requirements
You’ve a proven track record of designing, building, and maintaining MLOps or LLMOps infrastructure in a production environment.
You’ve previous hands-on experience building scalable, cloud-native infrastructure and platforms.
You’ve deployed and managed large-scale machine learning models in a production environment, with a deep understanding of the associated challenges.
You are considered an expert in Python, cloud platforms (AWS, GCP, or Azure), containerization (Docker, Kubernetes), and Infrastructure as Code (e.g., Terraform, CloudFormation).
You have a deep and practical understanding of the entire machine learning lifecycle and the specific operational challenges of large language models.
You have the ability to translate complex engineering and research requirements into concrete, robust, and automated platform solutions.
A Bachelor's or Master's degree in Computer Science, Engineering, or a related field, or equivalent practical experience.
Benefits
Flexible hybrid working environment, with 3 days in the office.
A generous personal development budget of $500 per annum
Learn from some of the best engineers and creatives, joining a diverse team
Become an owner, with shares (equity) in the company, if Heidi wins, we all win
The rare chance to create a global impact as you immerse yourself in one of Australia’s leading healthtech startups
If you have an impact quickly, the opportunity to fast track your startup career!
Client Operations Manager at Pave Bank responsible for managing client relationships and operations. Focused on operational excellence and collaboration with multiple teams in fintech.
Betriebsleiter Ackerbau overseeing agricultural operations at WM AGRAR with a focus on sustainable production. Responsible for leading, organizing, and developing the agricultural site strategically.
Betriebsleiter in der Schweineproduktion bei WM AGRAR. Verantwortung für die Leitung, Organisation und Entwicklung des Betriebszweiges in der Landwirtschaft.
Gerontopsychiatrische Pflegefachkraft bei Haus Edelberg. Sicherstellung der Lebenszufriedenheit unserer Bewohner durch individuelle Pflege und Betreuung.
Nursing professional ensuring the quality of life and care for residents at a retirement center. Involves individual and holistic care, collaboration, and documentation of processes.
Head of Operations overseeing production and engineering services at TAKASAGO Europe GmbH. Leading over 200 employees towards operational excellence and compliance.
Gerontopsychiatrische Fachkraft managing care for elderly individuals with mental health issues at 'Haus Vivere'. Focused on empathetic support and medical assistance in a modern care facility.