Hybrid Backend AI Developer – MLOps

at ONTEC AG

• Job title: Backend AI Developer – MLOps
• Job type: Full Time
• Experience level: Mid level, Senior
• Salary: €55,000 per year
• Degree requirement: Bachelor's Degree
• Tech skills: Azure, Docker, Jenkins, Kubernetes, NoSQL, Postgres, Python, SQL
• Location requirements: Hybrid, Vienna, Austria

About the role

• Backend AI-Developer responsible for backend development and MLOps at ONTEC. Building and maintaining AI systems while ensuring smooth deployments and operations.

Responsibilities

• As our Backend AI Developer with a touch of MLOps, you will play a key role in building and maintaining the backbone of our AI systems.
• Your focus is on backend development, but you will also support MLOps and DevOps tasks to ensure smooth operation and seamless deployments.
• Backend development: Build and maintain backend services in Python (FastAPI) to support AI tools and systems.
• Prompt engineering: Develop and optimize prompts for AI models to improve performance and usability.
• Working with embeddings: Use embeddings to enhance AI features, such as search and recommendation systems.
• Database management: Configure and maintain databases (PostgreSQL) for efficient data storage and processing.
• Containerization: Deploy applications in Docker containers and manage them with Portainer or similar tools.
• CI/CD pipeline management: Assist in designing, implementing, and maintaining CI/CD pipelines with tools like GitLab and Jenkins.
• Hosting LLMs: Host and optimize large language models (LLMs) on GPUs (NVIDIA).
• Document extraction: Develop solutions to extract content from various document formats (e.g., PDF, MS Office).
• Testing and quality control: Perform automated and manual tests to verify the quality of search and LLM outputs.
• Collaboration: Work closely with the AI team to integrate and deploy machine learning models into existing systems.
• Support and troubleshooting: Assist in resolving technical issues during development and integration of AI tools and models.
• Optional: Train models using sample datasets.

Requirements

• Backend development: Strong Python skills, particularly with FastAPI.
• CI/CD knowledge: Experience with CI/CD tools like GitLab and Jenkins and the ability to support and maintain pipelines.
• Database know-how: Experience with SQL and NoSQL databases, especially PostgreSQL.
• Docker skills: Ability to build and optimize Docker containers.
• Hosting LLMs: Familiarity with hosting and optimizing large language models on GPUs (NVIDIA).
• Prompt engineering: Experience developing and optimizing prompts for AI models.
• Working with embeddings: Experience using embeddings for tasks like semantic search and recommendations.
• Azure knowledge: Experience with Azure Kubernetes Service (AKS) and Azure OpenAI Services.
• Testing: Solid experience performing automated and manual tests.
• Language skills: Excellent written and spoken English.

Benefits

• Option for a 4-day workweek
• Trust-based working hours
• Home-office-first work model
• Additional vacation days
• Public transport pass or, subject to availability, a company parking spot
• Employee health and preventive insurance
• Excellent training and development opportunities
• Lots of fun
• Various company events
• After-work sessions
• And more