Hybrid Senior AI Quality Engineer

at Hostinger International

• Job title: Senior AI Quality Engineer
• Job type: Full Time
• Experience level: Senior
• Salary: €4,000 per month
• Degree requirement: Bachelor's Degree
• Tech skills: Cypress, Selenium
• Location requirements: Hybrid, Vilnius, Lithuania

About the role

• Quality Engineer shaping AI product quality by defining criteria and strategies at Hostinger. Collaborating in an innovative team exploring and building AI-powered products with no established playbooks.

Responsibilities

• Define success criteria for AI-driven features where no industry standards exist, and clarify what “correct” truly means.
• Design and execute testing strategies for AI tools, including exploratory and adversarial testing to uncover failure modes.
• Develop evaluation frameworks to measure AI behavior - accuracy, consistency, hallucination rate, edge-case handling, and stability.
• Build and maintain testing datasets, validation pipelines, and experimentation frameworks.
• Identify patterns in AI behavior, developing intuition around its strengths, weaknesses, and risk areas.
• Act as the voice of quality strategy, bridging the gap between what we build and how we know it’s truly good.

Requirements

• 4+ years of experience in software quality engineering (experience with AI-powered products is a strong plus).
• Strong critical thinking - you reason from first principles, not templates.
• Experience in web testing and automation (Playwright, Cypress, Selenium, or similar), and confidence working with APIs, logs, debugging tools, and data.
• Ability to define and measure quality beyond “it works,” including meaningful metrics and evaluation criteria.
• Strong interest in how AI systems work under the hood, with the curiosity to quickly learn new tools and technologies.
• Comfortable operating in ambiguity - no documentation, no prior art, no one to ask.
• Proactive, analytical, and persistent, with strong communication skills in English (Lithuanian is a plus).

Benefits

• **🚀 360 Growth:** We provide limitless learning opportunities: access to platforms like Reforge and CoachHub, global conferences, physical and digital libraries, feedback culture, and mentoring through TesoXchange. Advance your career with internal mobility and grow with a team eager to share knowledge and support your success.
• **🎯 Freedom & responsibility:** Work on your terms: from modern offices in Kaunas and Vilnius, the comfort of home, or anywhere in the world. Enjoy flexibility in managing your schedule and bring your ideas to life in a fast-paced, dynamic environment.
• **💪Wellness simplified:** Your health comes first with insurance from Day 1, gym memberships, recharge leave, Headspace subscriptions, and regular health checks. Join our wellbeing-dedicated events, sports, arts, and hobby clubs, or simply enjoy the balance of a lifestyle that prioritizes wellness.
• **🎉 Work hard – play hard:** Celebrate your achievements with company events like Summerfest & Winterfest, Town Hall, Meet the Client initiatives, team-buildings, and workations. Enjoy access to the Žalgiris Arena VIP Lounge and celebrate life’s big moments with milestone gifts for weddings, new parenthood, and graduations.