Hybrid Senior Test Analyst

at ATech

• Job title: Senior Test Analyst
• Job type: Full Time
• Experience level: Senior
• Salary: Not specified
• Degree requirement: Bachelor's Degree
• Tech skills: Cypress, Java, Jenkins, JMeter, NoSQL, Selenium, SQL
• Location requirements: Hybrid, Sao Paulo, Brazil

About the role

• Senior Test Analyst focused on AI-MS project in Defense area with Embraer, collaborating on automation and validation of AI models and systems.

Responsibilities

• Act as a Senior Test Analyst on the AI-MS project in the Defense area, in partnership with a Dutch company and Embraer. The professional will be responsible for:
• Defining and implementing test strategies for distributed systems based on Java and service-oriented architectures;
• Designing automated and manual test plans and scenarios, covering backend applications, REST APIs and AI interfaces;
• Testing and validating Machine Learning models and LLMs, evaluating accuracy, performance and reliability in real-world scenarios;
• Automating regression, load and security tests using frameworks such as Selenium, Cypress, JMeter and Postman;
• Validating CI/CD pipelines, ensuring continuous integration of code and AI models with quality and security;
• Performing exploratory testing and identifying critical failures, with a focus on usability, security and performance;
• Ensuring systems and models comply with regulatory requirements and security standards for the Defense sector;
• Collaborating with developers and AI analysts to debug and continuously improve solutions;
• Preparing quality reports, tracking performance metrics and test coverage.

Requirements

• Bachelor’s degree in Computer Science, Software Engineering, Information Systems or related fields;
• Solid experience (5+ years) in software testing, including agile methodologies (Scrum, Kanban) and QA techniques;
• API test automation using Postman, RestAssured or Karate;
• Functional and non-functional testing, with focus on security, performance and scalability;
• Experience testing AI models, including validation of accuracy and fairness in LLMs and Machine Learning systems;
• Proficiency in automation tools such as Selenium, Cypress, Playwright;
• Knowledge of CI/CD tools such as GitLab CI/CD, Jenkins or similar;
• Load and stress testing using JMeter, Locust or K6;
• Experience with SQL and NoSQL databases, ensuring data integrity in test scenarios;
• Intermediate English for reading and technical communication.

Benefits

• Meal and food allowance — Swile credit card;
• Transportation allowance;
• Gift voucher and birthday day off;
• Bradesco medical and dental plan — to take care of your health and your family (direct dependents);
• Gympass (Wellhub) — to support your physical health and energy;
• Health and well-being program: +Saúde;
• Quick massage at the office;
• Childcare assistance for children up to 71 months;
• Hybrid work model and flexible hours;
• PLR (Profit Sharing Program);
• Payroll-deductible credit;
• Private pension;
• Life insurance.