About the role

  • Quality Engineer shaping AI product quality by defining criteria and strategies at Hostinger. Collaborating in an innovative team exploring and building AI-powered products with no established playbooks.

Responsibilities

  • Define success criteria for AI-driven features where no industry standards exist, and clarify what “correct” truly means.
  • Design and execute testing strategies for AI tools, including exploratory and adversarial testing to uncover failure modes.
  • Develop evaluation frameworks to measure AI behavior - accuracy, consistency, hallucination rate, edge-case handling, and stability.
  • Build and maintain testing datasets, validation pipelines, and experimentation frameworks.
  • Identify patterns in AI behavior, developing intuition around its strengths, weaknesses, and risk areas.
  • Act as the voice of quality strategy, bridging the gap between what we build and how we know it’s truly good.

Requirements

  • 4+ years of experience in software quality engineering (experience with AI-powered products is a strong plus).
  • Strong critical thinking - you reason from first principles, not templates.
  • Experience in web testing and automation (Playwright, Cypress, Selenium, or similar), and confidence working with APIs, logs, debugging tools, and data.
  • Ability to define and measure quality beyond “it works,” including meaningful metrics and evaluation criteria.
  • Strong interest in how AI systems work under the hood, with the curiosity to quickly learn new tools and technologies.
  • Comfortable operating in ambiguity - no documentation, no prior art, no one to ask.
  • Proactive, analytical, and persistent, with strong communication skills in English (Lithuanian is a plus).

Benefits

  • **🚀 360 Growth:** We provide limitless learning opportunities: access to platforms like Reforge and CoachHub, global conferences, physical and digital libraries, feedback culture, and mentoring through TesoXchange. Advance your career with internal mobility and grow with a team eager to share knowledge and support your success.
  • **🎯 Freedom & responsibility:** Work on your terms: from modern offices in Kaunas and Vilnius, the comfort of home, or anywhere in the world. Enjoy flexibility in managing your schedule and bring your ideas to life in a fast-paced, dynamic environment.
  • **💪Wellness simplified:** Your health comes first with insurance from Day 1, gym memberships, recharge leave, Headspace subscriptions, and regular health checks. Join our wellbeing-dedicated events, sports, arts, and hobby clubs, or simply enjoy the balance of a lifestyle that prioritizes wellness.
  • **🎉 Work hard – play hard:** Celebrate your achievements with company events like Summerfest & Winterfest, Town Hall, Meet the Client initiatives, team-buildings, and workations. Enjoy access to the Žalgiris Arena VIP Lounge and celebrate life’s big moments with milestone gifts for weddings, new parenthood, and graduations.

Job title

Senior AI Quality Engineer

Job type

Experience level

Senior

Salary

€4,000 per month

Degree requirement

Bachelor's Degree

Tech skills

Location requirements

Report this job

See something inaccurate? Let us know and we'll update the listing.

Report job