Be part of a team supporting the development of an AI/ML platform that will leverage generative AI to relieve user burden across the Centers for Medicare and Medicaid Services (CMS)
Design and maintain robust, scalable automated test frameworks for web apps, APIs, and AI-driven features
Develop automated pipelines for model validation, bias detection, and drift monitoring in ML-based systems
Define and execute test plans that include functional, regression, performance, and AI-specific testing strategies
Partner with AI/ML engineers to create test datasets and simulate real-world user behavior and edge cases
Implement CI/CD-integrated quality gates to ensure AI releases meet defined reliability and fairness metrics
Mentor junior engineers and help establish best practices in intelligent automation and AI testing
Advocate for ethical AI standards and contribute to cross-functional discussions about responsible AI
Requirements
3-5 years of experience in software QA/automation engineering, with at least 1 year focused on AI/ML product testing
Strong proficiency in at least one automation framework (e.g., Selenium, Cypress, Playwright) and scripting language (Python preferred)
Hands-on experience with testing AI models, including validation metrics, dataset versioning, and model explainability
Familiarity with tools like MLflow, TensorBoard, or similar for AI observability
Understanding of model bias, fairness audits, and compliance considerations in government or regulated environments
Experience working in Agile DevSecOps environments with modern CI/CD tooling (Jenkins, GitHub Actions, GitLab, etc.)
Strong collaboration skills with clear communication across engineering, data science, and product teams
Ability to obtain and maintain a Public Trust security clearance
Offers of employment are contingent upon acceptable results of a background investigation
Benefits
Medical, dental, vision insurance (fully paid for employees)
15 days of paid leave
7 days of sick leave
2 days bereavement leave
11 paid Federal holidays
Up to 40 hours for jury duty
401K with 4% employer contribution (and no vesting period)
Up to 4 weeks of paid paternity and maternity leave
Company provided laptop
$5,000 per year for professional development
$600 per year for technical supplies and equipment
$2,000 referral bonus
Life and disability insurance
HSA and FSA
Legal Shield and ID Shield Voluntary Benefits
Flexible working hours and remote opportunities to help maintain a healthy work-life balance
Opportunity to work in a collaborative, motivated team focused on modernizing government services with cutting-edge technology
Automation Engineer at CMC programming and debugging PLCs while developing control systems. Working with electrical schematics and modern HMI interfaces for automated manufacturing.
Microsoft 365 Automation Engineer designing and maintaining internal solutions in the Microsoft 365 ecosystem. Driving automation, efficiency, and integration across business functions with Power Platform tools.
Mainframe Automation Engineer focusing on automation solutions to improve system reliability. Working at BetaNXT to enhance wealth management infrastructure solutions from Bengaluru.
Associate Consultant focusing on automation, AI - driven solutions, and workplace orchestration for enterprise workflows. Responsibilities include developing automation workflows and creating AI agents to enhance productivity.
Integrating cutting - edge automation technologies with IT and OT systems, ensuring data flow for Novartis. Empowering global manufacturing operations to achieve stability, scalability, and compliance.
Senior Security Automation Engineer at RBC's Data Security Team focusing on incident response automation. Integrating and optimizing SOAR workflows while collaborating with global security teams.
Electrical & Automation Engineer Apprentice at Nestlé Malaysia assisting with Manufacturing Execution Systems and ensuring operational performance. Role focuses on health, safety, and product quality while providing hands - on experience.
FPGA Test Automation Developer contributing to the technology of the future at OPAL - RT Technologies. Involves developing testing strategies and maintaining test platforms for simulation tools.
Industrial Automation Engineer developing and maintaining Ignition platform solutions for Saab's defense and security technology. Collaborating with cross - functional teams on industrial process optimizations and software support.
AI Automation Engineer developing and deploying automations and AI agents at Ansira. Focusing on efficiency improvements and collaboration across teams in the Delivery & Operations organization.