Automation QA Engineer responsible for manual and automated testing in a consulting environment. Collaborating with teams to design and integrate test automation frameworks and strategies.
About the role
- Intermediate AI Software QA ensuring reliability of AI-driven platforms at Delta Controls. Testing multi-agent services and collaborating with developers for quality assurance in hybrid work environment.
Responsibilities
- Develop and maintain test plans for multi-agent, LLM-driven features and workflows
- Design and execute functional, integration, end-to-end, and regression tests for cloud-based AI services
- Validate retrieval pipelines, embeddings, knowledge-base updates, and AWS Bedrock/serverless integrations
- Build automated test suites (Python preferred) for backend workflows and microservices
- Collaborate with developers to define quality criteria, ensure testability, and troubleshoot APIs, agents, and cloud infrastructure
- Contribute to documentation for test cases, quality processes, and release readiness
Requirements
- 3+ years of QA or software engineering experience
- Strong proficiency in Python scripting and experience working with BDD frameworks and tools including Pytest-BDD, Playwright, and Gherkin (or similar)
- Experience with LLMs, model inference workflows, or prompt evaluation
- Familiarity with RAG concepts, retrieval pipelines, embeddings, or vector search
- Strong analytical thinker with excellent attention to detail
- Clear communicator, comfortable working independently
- Cloud Experience (Asset): Exposure to AWS Lambda or serverless applications, experience testing services integrated with AWS Bedrock, familiarity with cloud databases such as DynamoDB or Aurora, knowledge of S3, CloudWatch, IAM, and distributed service debugging; experience with Terraform or CloudFormation is a plus
Benefits
- Employee & safety centric culture with the possibility of remote work
- Flexible hours and scheduling available
- Competitive total compensation along with generous vacation allowances
- Vacation leaves
- Wellness - onsite fitness center & company reimbursement for personal gym memberships
- Internal Recognition
- Employee Referral bonuses
- Transit accessible with free onsite parking
- Regular company events such as "Food Truck Fridays", Lunch & Learn and other planned activities
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
QA Lab Technician handling administrative and laboratory duties at Vibrant Ingredients. Responsible for sample preparation, testing, and reporting results in a laboratory setting.
Group Technology Manager overseeing Technology Delivery Quality Assurance & Risk Governance at Truist. Responsible for technology governance and compliance activities across the organization.
QA Tester enhancing quality in games at FuturLab, an award - winning game studio. Focus on executing tests, logging defects, and improving user experience.
Senior QA Engineer with strong test automation expertise for financial technology solutions. Join a company valuing innovative and collaborative problem - solving in QA methodologies.
Admissions Team Lead overseeing operations in Cedars - Sinai Patient Access Contact Center. Coaching team members and ensuring quality of patient registration and flow.
Analyst in Quality Assurance supporting Quality Assurance activities within Information Technology at Fulton Bank. Collaborating with stakeholders to review requirements and assess the quality of solutions.
Quality Engineer responsible for supplier performance monitoring and compliance audits. Collaborating with suppliers to ensure quality standards in automotive sector.
Intermediate QA ensuring accuracy and reliability of integrations in foodservice technology for healthcare. Collaborating with teams to validate data flows and improve reporting processes.
Quality Assurance Analyst helping Patreon improve content moderation and creator safety. Supporting a platform where creators earn through memberships and direct sales.