Hybrid AI Platform Engineer – LLM, RAG

at INTERGATOR SMART SEARCH by interface projects GmbH

• Job title: AI Platform Engineer – LLM, RAG
• Job type: Full Time
• Experience level: Mid level, Senior
• Salary: Not specified
• Degree requirement: Bachelor's Degree
• Tech skills: Python
• Location requirements: Hybrid, Dresden, Germany

About the role

• AI Platform Engineer focusing on LLM and RAG implementation for INTERGATOR platform. Involved in evaluation, quality assurance, and integration in a hybrid work environment.

Responsibilities

• Maintain the technical foundation for deploying large language models and embedding models within the enterprise search and AI platform
• Evaluate new LLMs, embedding models, and, prospectively, multimodal models (e.g., vision)
• Perform qualitative and reproducible assessments of model quality in the context of real enterprise data (RAG scenarios)
• Evaluate, integrate, and update LLM runtime and inference components (e.g., vLLM, TEI, LangChain, or comparable frameworks)
• Maintain and enhance the technical LLM platform (compatibility, stability, updates)
• Develop internal tools and utilities for model, prompt, and quality evaluation
• Prompt engineering and prompt tuning for various models and use cases
• Evaluate and implement integration and interface concepts (e.g., MCP or similar standards)
• Documentation, testing, and internal technical support for other development and product teams

Requirements

• Passion for developing and operating technical platforms in AI / LLM / RAG
• University degree in (business) computer science, mathematics, natural sciences, or a comparable field
• Practical experience with Large Language Models and/or embedding models
• Experience with Retrieval-Augmented Generation (RAG)
• Experience with LLM frameworks and inference or serving components
• Proficient in Python and experienced in developing robust software components
• Strong understanding of quality, explainability, and limitations of AI systems
• Structured, independent, and responsible way of working
• Excellent German and English skills, both written and spoken (native German speaker or at least level C)

Benefits

• A thorough and structured onboarding process
• Continuous training and extensive development opportunities
• Collaboration within an experienced, collegial team with high technical expertise
• Flexible working hours and excellent work–life balance
• Flexible working hours without core hours
• Option for up to 2 days of home office per week
• Freedom to contribute ideas and take on responsibility
• Regular team events & outdoor activities
• Beverage flat rate (coffee, water, and tea)
• Convenient location – our offices are well connected to DVB (bus & tram)
• Job bike (JobRad)
• Training and development offerings