Senior Software Engineer building and improving AI management systems for healthcare startup. Collaborating with cross - functional teams to address high - level engineering challenges.
About the role
- Senior Software Engineer developing and releasing the Red Hat AI Inference Server. Collaborating with technical and research teams on machine learning products and operational automation.
Responsibilities
- Collaborate with research and product development teams to scale machine learning products for internal and external applications
- Actively contribute to managing and releasing upstream and midstream product builds
- Test to ensure correctness, responsiveness, and efficiency
- Troubleshoot, debug and upgrade Dev & Test pipelines
- Identifying and deploying cybersecurity measures by continuously performing vulnerability assessment and risk management
- Collaborate with a cross-functional team about market requirements and best practices
- Keep abreast of the latest technologies and standards in the field
Requirements
- 2+ years of experience in MLOps, DevOps, Automation and/or modern Software Deployment practices
- Experience with Release Engineering
- Experience evaluating LLMs for performance and accuracy (think HellaSwag, MMLU, Chatbot Arena, TruthfulQA, etc.)
- Being super comfortable with Python and PyTest is a must
- Strong experience with Git, Github Actions including self-hosted runners, BuildKite, Terraform, Jenkins, Ansible, and/or other common technologies for automation and monitoring
- Experienced with administering Kubernetes/OpenShift and/or docker/podman
- Experience with Cloud Computing using at least one of the following Cloud infrastructures: AWS, GCP, Azure, or IBM Cloud
- Familiar with Agile development methodology
- Solid troubleshooting skills
- Ability to interact comfortably with the other members of a large, geographically dispersed team
- Experience maintaining an infrastructure and ensuring stability
- While a Bachelor’s degree or higher in computer science, mathematics, or a related discipline is valued, we prioritize technical prowess, initiative, problem solving, and practical experience
- Familiarity with contributing to the vLLM CI community is a big plus
Benefits
- Comprehensive medical, dental, and vision coverage
- Flexible Spending Account - healthcare and dependent care
- Health Savings Account - high deductible medical plan
- Retirement 401(k) with employer match
- Paid time off and holidays
- Paid parental leave plans for all new parents
- Leave benefits including disability, paid family medical leave, and paid military leave
- Additional benefits including employee stock purchase plan, family planning reimbursement, tuition reimbursement, transportation expense account, employee assistance program, and more!
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Senior Software Engineer responsible for designing solutions with Python and Django for a Fintech platform. Collaborating with teams to ensure quality and scalability while managing large datasets.
Senior Software Engineer responsible for Health Information Exchanges development at Contexture. Collaborating on secure development and software lifecycle processes while mentoring junior developers.
Build AI - powered product experiences in a fast - growing startup focused on authentic social interactions and community trust. Mentor engineers and shape app quality with high user engagement.
Backend - focused Software Engineer stabilizing and scaling core systems for fintech startup. Building reliable solutions to real - world problems in the debt management space.
Engineers building the AI - powered revenue platform for modern finance teams. Join a lean team to take ownership of ambitious projects and innovate revenue - critical infrastructure.
Tech Lead providing architectural guidance and focusing on sustainable solutions at GFT France. Involved in evolving development practices amidst a dynamic technical environment.
Software Engineer developing ML and geospatial systems for climate action startup. Improving data pipelines and cloud infrastructure for soil carbon quantification.
Senior Software Engineer developing embedded software for next - generation automotive systems. Collaborating with cross - functional teams to design and validate robust solutions that meet industry standards.
Mid - level or Senior Fullstack Engineer developing AI features for healthcare organization. Collaborating with clinical teams to optimize care delivery using technology.