Hybrid AI DevOps Engineer

at osapiens

• Job title: AI DevOps Engineer
• Job type: Full Time
• Experience level: Mid level, Senior
• Salary: Not specified
• Degree requirement: No Education Requirement
• Tech skills: AWS, Azure, Cloud, Docker, Google Cloud Platform, Java, Kubernetes, Python, TypeScript
• Location requirements: Hybrid, Mannheim, Germany

About the role

• AI Development Operations Engineer responsible for the internal AI infrastructure empowering developers. Integrating AI systems into engineering workflows for efficient software design and maintenance.

Responsibilities

• Develop reusable agent skills for architecture reasoning, secure coding, test generation, debugging and more.
• Maintain and evolve a skill library aligned with engineering needs and platform adoption.
• Automate code review, CI checks and troubleshooting with LLM-based workflows.
• Provide context aware knowledge retrieval across codebases, logs, docs, incidents and design artifacts.
• Define guidelines for prompt engineering, model evaluation and cost optimization.
• Implement monitoring, audit logging, performance tracking and access controls.
• Partner closely with engineering, product and qa-teams.
• Communicate platform strategy and progress to leadership.
• Support developers in adopting and maximizing AI based workflows.

Requirements

• Strong software engineering background (Python + one systems language like Typescript / Java).
• Experience with LLM APIs (OpenAI, Claude, Gemini) and agent frameworks (LangChain, LlamaIndex).
• DevOps/MLOps expertise: Kubernetes, Docker, CI/CD, observability.
• Cloud architecture experience (AWS/GCP/Azure) optimized for AI workloads.
• Hands-on knowledge of retrieval systems and vector databases (Pinecone, Weaviate, etc.).
• Solid understanding of security, compliance and safe AI usage.
• Experience with knowledge graphs, largescale ingestion pipelines, finetuning or advanced prompting.
• Background in developer experience, internal platforms or productivity engineering.
• Proven technical leadership and strong cross functional collaboration skills.

Benefits

• A purpose-driven mission tackling complex sustainability challenges while working alongside global industry pioneers at a fast-growing unicorn company
• Room for creativity through collaborative teamwork and an open communication culture
• Flexibility and team bonding with our hybrid work options
• Fuel for your growth journey, both personally and professionally
• Sustainable mobility options, promoting eco-friendly commuting solutions
• Fun team events and outings with our global teams
• Inspiring workspaces in Mannheim, Munich and Madrid