Senior Software Engineer developing and testing AI/ML software tools for Red Hat's Llama Stack. Collaborating with engineering teams to enhance performance, reliability, and innovation.
Responsibilities
Collaborate with Staff Engineers, Engineering, Product Management, and User Experience to define customer needs and use cases.
Develop and implement comprehensive unit, integration, and end-to-end tests to guarantee the reliability and performance in the upstream project, maintaining CI/CD workflows in GitHub, and ensuring downstream quality.
Create robust AI/ML software tools to enable AI Application development and contribute to a healthy open source community.
Participate in AI-assisted code reviews, utilizing tools that provide real-time feedback, identify potential bugs, security vulnerabilities, and adherence to coding standards, contributing to a more thorough and efficient review process.
Proactively utilize AI-assisted development tools (e.g., GitHub Copilot, Cursor, Claude Code) for code generation, auto-completion, and intelligent suggestions to accelerate development cycles and enhance code quality.
Create and maintain clear, concise upstream technical documentation including API references and user guides and collaborating with our internal tech writers to create robust downstream documentation.
Evaluate and integrate the latest advancements in AI/ML technologies and toolkits to improve existing systems and develop new innovative solutions.
Requirements
7 years of advanced Python development experience as a Software Engineer in Open Source communities with focus in DevOps or CI and experience in AI/ML
Advanced knowledge developing unit, functional, and end-to-end (E2E) test cases and automation.
Advanced knowledge designing and exercising robust and scalable APIs used in highly scaled and performant Distributed Systems
Advanced knowledge creating automation for GitHub, using GitHub Actions or related continuous integration tools.
Experience with AI and Machine Learning platforms, tools, and frameworks, such as LlamaStack, LangChain, PyTorch, LLaMA.cpp, vLLM, LangGraph, and Kubeflow.
Experience developing, deploying or maintaining On-prem or Cloud Infrastructure
Ability to quickly learn and use new tools and technologies.
Staff Software Engineer driving systemic impact and technical strategy at Standard Bots. Leading complex engineering challenges to elevate capabilities and standards across teams.
Senior Software Engineer developing software solutions for robotics at Standard Bots. Driving high impact projects and mentoring engineers in a collaborative tech environment.
Technical Leader for Power Platform at SONDA ensuring quality service delivery and client management. Leading technical efforts in developing, maintaining, and optimizing Power Platform solutions.
Senior Software Engineer building and releasing the Red Hat AI Inference Server. Working across the full stack from C++/CUDA kernel compilation to Kubernetes - orchestrated model serving.
Senior Software Engineer focusing on backend web and API development at Red Hat. Collaborating on expanding enterprise Ansible offering and improving automation tools across the organization.
GO Developer in Schwarz Group developing and supporting applications in a cross - functional team. Engaging in planning, implementation, and optimization of applications and their architectures.
Software Engineer Trainee developing computer vision systems for an international company committed to sustainable development. Engaging in software design, implementation, and collaborative workflows.
Full Stack Software Engineer developing Java software at Boeing for space mission systems. Involves software development lifecycle management and agile practices in a collaborative environment.
Software Engineer role at Caterpillar developing software applications using agile methods. Involves programming, automation optimization, and working with testing tools.