Hybrid Automation QA Engineer – 新銀行プロジェクト

at PayPay Corporation

• Job title: Automation QA Engineer – 新銀行プロジェクト
• Job type: Full Time
• Experience level: Mid level, Senior
• Salary: Not specified
• Degree requirement: Bachelor's Degree
• Tech skills: Microservices, Selenium
• Location requirements: Hybrid, Japan

About the role

• Automation QA Engineer developing testing processes for PayPay's New Bank Project. Collaborating with in-house engineers to ensure high-quality software delivery in a dynamic environment.

Responsibilities

• Analyze testing requirements to develop comprehensive test scenarios for various test levels
• Design and create detailed test cases that validate conformance to functional and non-functional requirements
• Prepare and manage essential test data, tools, and environments for test execution
• Execute test cases and scripts, meticulously documenting results
• Drive quality improvement with a strong focus on test automation, while also taking ownership of comprehensive validation activities that include manual testing
• Log, track, and verify defects, ensuring accurate documentation and timely resolution
• Collect, organize, and analyze test results to provide thorough reports on all QA activities
• Analyze testing outcomes and recommend effective solutions for identified issues
• Maintain and update comprehensive test documentation, ensuring coverage for new features and robust regression testing
• Support knowledge management and foster collaboration by actively participating in testing discussions and contributing to continuous improvement through lessons learned
• Act as a Subject Matter Expert (SME) for designated modules, providing critical domain knowledge and support to the QA team
• Provide guidance and support to junior QA engineers, including onboarding and training
• Leverage AI tools such as NotebookLM, Gemini, Cursor AI, GitHub Copilot, and OpenAI APIs to accelerate test case design, automation, and exploratory testing
• Apply prompt engineering and RAG (Retrieval-Augmented Generation) techniques to validate LLM-driven applications, ensuring accuracy, reliability, and robustness
• Work with OpenAI keys, LLM models, and MCP server integrations, automating API-based interactions and securing AI workflows
• Test and monitor AI/ML systems for issues such as bias, drift, hallucinations, and performance deviations

Requirements

• Minimum 3+ years of experience in developing, executing, and maintaining automated test cases for mobile applications, web applications, and/or APIs
• Proven professional experience with at least one of the following automation frameworks/tools: Appium (for mobile), Playwright/Selenium (for web), or Rest-Assured (for APIs)
• Proficient in utilizing Cucumber for defining and executing test cases
• Well-versed in Continuous Integration/Continuous Deployment (CI/CD) tools such as Github actions, Bitrise, or similar platforms
• Basic understanding of microservices architecture and its associated testing challenges
• Strong ability to analyze technical requirements, design comprehensive test strategies, and create detailed, effective test cases
• Exceptional analytical and problem-solving skills, coupled with a meticulous attention to detail
• Excellent communication skills, a team-oriented mindset, and the ability to work effectively both independently and collaboratively
• Hands-on experience with AI productivity tools (NotebookLM, Gemini, Cursor AI, GitHub Copilot)
• Knowledge of OpenAI API usage, key management, embeddings, and LLM integration workflows
• Familiarity with MCP server concepts and their integration in test automation pipelines
• Understanding of AI system validation techniques, including testing for bias, hallucinations, drift, and robustness
• Business level of English.

Benefits

• Social Insurance (health insurance, employee pension, employment insurance and compensation insurance)
• 401K
• Translation/Interpretation support
• VISA sponsor + Relocation support