Software quality engineer ensuring the reliability and performance of AI applications at WRITER. Collaborate with cross-functional teams to implement quality assurance strategies and testing frameworks.
Responsibilities
Define and implement comprehensive quality assurance strategies and test plans for our AI agents and LLM-powered applications, ensuring exceptional product reliability and performance.
Designing and developing automation frameworks: creating robust, scalable, and maintainable automated test frameworks from scratch or enhancing existing ones. You’ll need proficiency in at least one language like Typsecript, Python, or Scala.
Collaborate closely with product managers, machine learning engineers, and data scientists to understand complex AI features and model behaviors, translating them into effective test cases and validation criteria.
Drive the continuous improvement of our testing processes and infrastructure, integrating automated checks within our CI/CD pipelines to ensure rapid, high-quality releases.
Identify, document, and track software defects and inconsistencies, performing root cause analysis to provide actionable feedback to development teams.
Monitor production systems and AI model performance, proactively identifying potential issues and contributing to post-release quality validation.
Champion quality best practices across engineering teams, fostering a culture of ownership and continuous improvement in delivering world-class AI solutions.
Requirements
5+ years of hands-on experience in software quality assurance or engineering, with a strong focus on testing complex distributed systems or AI/ML applications.
Proficiency in programming languages like Python or Typescript for test automation, and experience with modern testing frameworks such as Playwright.
Solid understanding of AI/ML concepts, including model evaluation metrics, data pipelines, and the unique challenges of testing generative AI outputs.
Experience with cloud platforms (AWS, Azure, GCP) and containerization technologies (Docker, Kubernetes) in a CI/CD environment is a big plus.
Exceptional analytical skills to dissect complex problems and a keen eye for detail, ensuring no bug goes unnoticed.
A collaborative spirit that helps you Connect cross-functional teams to common quality goals, Challenge existing assumptions to build better systems, and Own the end-to-end quality of our products.
Demonstrated ability to drive initiatives independently and thrive in a fast-paced, evolving startup environment.
Benefits
Generous PTO, plus company holidays
Medical, dental, and vision coverage for you and your family
Paid parental leave for all parents (12 weeks)
Fertility and family planning support
Early-detection cancer testing through Galleri
Flexible spending account and dependent FSA options
Health savings account for eligible plans with company contribution
Annual work-life stipends for:
Wellness stipend for gym, massage/chiropractor, personal training, etc.
Learning and development stipend
Company-wide off-sites and team off-sites
Competitive compensation, company stock options and 401k
Senior Quality Engineer supporting supplier management, CAPA, and project ownership for a medical device startup. Collaborating with teams to ensure quality and regulatory compliance in shoulder replacements.
Mystery Shopper conducting evaluations to enhance customer service across various sectors in Vorarlberg. Engaging with teams to discuss insights and areas for improvement.
IT Quality Engineering Manager leading transformation of quality engineering and software delivery at Westfield. Collaborating with teams to build a robust QA framework and ensuring compliance with standards and technology.
Quality Engineering Manager leading aerospace structures quality activities. Managing QE teams to ensure regulatory compliance and structural integrity.
QA Engineer ensuring quality and performance in iGaming solutions for EveryMatrix. Applying best practices in testing across development environments with a focus on QA methodologies.
Quality Assurance Electrician for energy systems at Alexander Bürkle panel solutions. Focused on testing and wiring low - voltage main distributions in a structured environment.
Senior Manager Quality leading regional quality activities across Third Party Manufacturers and logistics network. Ensuring compliance with Cosmetic GMP and quality standards for Wella Company in the Americas.
Transmission Line Design QA/QC Engineer focusing on reviewing and ensuring compliance of transmission line designs. Supporting modeling and analysis activities using industry - standard tools in Mesa, AZ.
Senior QA Engineer working on automation - related projects for NetBrain's network automation platform. Collaborating on a hybrid schedule in Toronto, ON office with a passion for software development and automation.
Lead product release execution and data management related to food safety at Chobani's Twin Falls site. Manage microbiological testing programs ensuring compliance and timely product disposition.