Software quality engineer ensuring quality in AI applications at a generative AI startup. Working on building and deploying AI agents within a collaborative engineering team.
Responsibilities
Define and implement comprehensive quality assurance strategies and test plans for our AI agents and LLM-powered applications, ensuring exceptional product reliability and performance.
Designing and developing automation frameworks: creating robust, scalable, and maintainable automated test frameworks from scratch or enhancing existing ones. You’ll need proficiency in at least one language like Typsecript, Python, or Scala.
Collaborate closely with product managers, machine learning engineers, and data scientists to understand complex AI features and model behaviors, translating them into effective test cases and validation criteria.
Drive the continuous improvement of our testing processes and infrastructure, integrating automated checks within our CI/CD pipelines to ensure rapid, high-quality releases.
Identify, document, and track software defects and inconsistencies, performing root cause analysis to provide actionable feedback to development teams.
Monitor production systems and AI model performance, proactively identifying potential issues and contributing to post-release quality validation.
Champion quality best practices across engineering teams, fostering a culture of ownership and continuous improvement in delivering world-class AI solutions.
Requirements
5+ years of hands-on experience in software quality assurance or engineering, with a strong focus on testing complex distributed systems or AI/ML applications.
Proficiency in programming languages like Python or Typescript for test automation, and experience with modern testing frameworks such as Playwright.
Solid understanding of AI/ML concepts, including model evaluation metrics, data pipelines, and the unique challenges of testing generative AI outputs.
Experience with cloud platforms (AWS, Azure, GCP) and containerization technologies (Docker, Kubernetes) in a CI/CD environment is a big plus.
Exceptional analytical skills to dissect complex problems and a keen eye for detail, ensuring no bug goes unnoticed.
A collaborative spirit that helps you Connect cross-functional teams to common quality goals, Challenge existing assumptions to build better systems, and Own the end-to-end quality of our products.
Demonstrated ability to drive initiatives independently and thrive in a fast-paced, evolving startup environment.
Benefits
Generous PTO, plus company holidays
Comprehensive medical and dental insurance
Paid parental leave for all parents (12 weeks)
Fertility and family planning support
Early-detection cancer testing through Galleri
Competitive pension scheme and company contribution
Annual work-life stipends for:
Wellness stipend for gym, massage/chiropractor, personal training, etc.
Learning and development stipend
Company-wide off-sites and team off-sites
Competitive compensation and company stock options
Quality Engineer intern coordinating quality activities at Arquus in Limoges. Joining a highly qualified team in the development and manufacturing of all - terrain armored vehicles.
Quality Assurance & Regulatory Affairs Specialist supporting Demant's 3rd - party business partners. Handling documentation, audits, and regulatory coordination within an international organization.
Senior Quality Engineer working in a dynamic environment with a focus on product quality for hearing impaired. Opportunities for professional growth and exciting projects.
QA Tester validating software quality at innovative technology company. Designing and executing test strategies while collaborating with international teams in a dynamic environment.
Senior Frontend Entwickler und QA - Engineer in der Softwareentwicklung bei Creditreform. Verantwortlich für die Entwicklung von Web - Frontends und Gewährleistung hoher Softwarequalität in Neuss.
Software Testautomatisierer developing and maintaining automated test solutions in hybrid working conditions at medium - sized IT firm Mentopolis Consulting & Software Concepts GmbH.
Design Quality Assurance Engineer responsible for managing product design and compliance in medical technology industry. Collaborating across departments to meet regulatory standards and improve quality processes.
Quality Engineer II at Heraeus Medevio developing engineering solutions for manufacturing complaints and quality issues. Leading teams to improve product and process quality in Cartago, Costa Rica.
Lead QA processes in the software factory of Blue Technology, focusing on quality and automation. Collaborate with teams to ensure excellence in deliverables and continuous improvement.
Quality Assurance Analyst ensuring quality of software solutions developed for air traffic control systems. Responsible for testing and defect management in a hybrid work setting.