AI Quality Assurance Program Manager

tripadvisorLondonNew today
HybridPermanentFull-timeFunctional Testing

Job description

<p>AI Quality Assurance Program Manager I Tripadvisor</p> <p><strong>About Tripadvisor&nbsp;</strong></p> <p>The Tripadvisor Group connects people to experiences worth sharing, and aims to be the world’s most trusted source for travel and experiences. We leverage our brands, technology, and capabilities to connect our global audience with partners through rich content, travel guidance, and two-sided marketplaces for experiences, accommodations, restaurants, and other travel categories. The subsidiaries of Tripadvisor, Inc. (Nasdaq: TRIP), include a portfolio of travel brands and businesses, including Tripadvisor, Viator, and TheFork.</p> <p data-pm-slice="1 1 []">The AI Quality Assurance Program Manager ensures that all artificial intelligence systems across Tripadvisor’s Travel Experiences execute reliably, accurately, and aligned with business goals. Positioning yourself at the intersection of AI performance, traveler satisfaction, and product development, you will establish testing frameworks, audit AI outputs, and turn quality findings into actionable operational insights. You will drive performance tracking, unblock cross-functional teams, and regularly report AI accuracy, success metrics, and enhancement roadmaps to executive leadership.</p> <p><em>Job Location: Hybrid</em></p> <p><em>This role is a hybrid position that requires 2/3 days per week/month in our London Office.</em></p> <p data-pm-slice="1 3 []"><strong>Key Responsibilities</strong></p> <ul> <li> <p><strong>Define the AI-Era Quality Strategy:</strong><span class="Apple-converted-space">&nbsp;</span>Establish the end-to-end quality framework across human agents and AI agents, evolving QA from traditional sample-based auditing toward continuous, AI-enabled quality management.</p> </li> <li> <p><strong>Establish AI Quality &amp; Testing Frameworks:</strong><span class="Apple-converted-space">&nbsp;</span>Design and maintain comprehensive evaluation benchmarks, testing protocols, and human-in-the-loop (HITL) workflows to verify AI agents, support bots, and recommendation engines operate as intended.</p> </li> <li> <p><strong>Audit AI Outputs &amp; Traveler Interactions:</strong><span class="Apple-converted-space">&nbsp;</span>Continuously evaluate AI-generated outputs (e.g., automated support chats, tour recommendation accuracy, and booking updates) for intent fulfillment, safety, tone, and hallucination prevention.</p> </li> <li> <p><strong>Drive Business Updates &amp; Insights:</strong><span class="Apple-converted-space">&nbsp;</span>Deliver executive-ready reporting that translates complex QA evaluation data, model accuracy rates, and error trends into strategic recommendations for business leaders.</p> </li> <li> <p><strong>Lead Cross-Functional AI Improvements:</strong><span class="Apple-converted-space">&nbsp;</span>Partner closely with Data Science, AI Engineering, Product, and CX teams to turn QA findings into prompt refinements, model fine-tuning, and updated knowledge base inputs.</p> </li> <li> <p><strong>Maintain Release Momentum:</strong><span class="Apple-converted-space">&nbsp;</span>Track project timelines for new AI deployments, manage QA regression testing schedules, and hold technical teams accountable to quality standards before full traveler rollout.</p> </li> </ul> <p><strong>Qualifications</strong></p> <ul> <li> <p><strong>Experience:</strong><span class="Apple-converted-space">&nbsp;</span>4–6 years in technical program management, QA management, or AI/ML product operations focused on system reliability and evaluation.</p> </li> <li> <p><strong>AI Evaluation Expertise:</strong><span class="Apple-converted-space">&nbsp;</span>Strong operational knowledge of AI/LLM testing methodologies, prompt evaluation, intent recognition accuracy, and AI safety guardrails.</p> </li> <li> <p><strong>Data-Driven Insight Delivery:</strong><span class="Apple-converted-space">&nbsp;</span>Proven ability to analyze AI logs, leverage analytics tools, and turn quality metrics into clear, executive-ready presentations and dashboards.</p> </li> <li> <p><strong>Cross-Functional Collaboration:</strong><span class="Apple-converted-space">&nbsp;</span>Exceptional track record of bridging technical AI engineering teams with business stakeholders and front-line traveler support operations.</p> </li> <li> <p><strong>Domain Empathy:</strong><span class="Apple-converted-space">&nbsp;</span>Deep interest in online travel, traveler behavior, and maintaining high trust across consumer-facing AI interactions.</p> </li> </ul> <p><strong>Preferred Qualifications</strong></p> <ul> <li> <p>Hands-on experience with modern LLM evaluation tools, annotation platforms, or customer service AI tools (e.g., Zendesk AI, Intercom, Salesforce).</p> </li> <li> <p>Background in travel tech, e-commerce marketplaces, or fast-scaling consumer platforms.</p> </li> </ul> <p><strong>What We Offer&nbsp;</strong></p> <ul> <li>Competitive compensation packages (routinely benchmarked against the latest industry data), including base salary and annual bonuses</li> <li>“Work your way” with flexibility to suit your lifestyle. Tripadvisor Group takes a remote-friendly approach to collaboration across a worldwide team, with the option to join on-site as often as you’d like or as required by your team.</li> <li>Flexible schedule. Work-life balance is ingrained in our culture by design. Trust and accountability make it work.</li> <li>Donation matching. Give back? Give more! We match qualifying charitable donations annually.</li> <li>Tuition assistance. Want to level up your career? We love to hear it! Receive annual support for qualified programs.</li> <li>Lifestyle benefit. An annual benefit to spend on yourself. Use it on travel, wellness, or whatever suits you.</li> <li>Travel perks. We believe that travel is employee development, so we provide discounts and more.</li> <li>Employee assistance program. We’re here for you with resources and programs to help you through life’s challenges.</li> <li>Health benefits. We offer great coverage and competitive premiums.</li> <li>Generous referral scheme. Help us grow and be rewarded with generous awards for referring successful candidates.</li> </ul> <p><strong>Our Cultural Pillars:</strong></p> <p><strong>Traveler first</strong></p> <p>We exist to create value for our customer, the traveler. We enable our suppliers and partners to unlock this value. Their collective behaviors and insights are what drives us.&nbsp;</p> <p><strong>Execution is our edge</strong></p> <p>We act fast, experiment, learn from failure, iterate, and improve the solutions of tomorrow across every aspect of our business. Our execution is agile, data-driven, prioritised, and built to scale. We assume no problem is someone else’s problem and finish what can be done today, knowing tomorrow will bring fresh challenges.&nbsp;</p> <p><strong>We succeed together</strong></p> <p>The best outcomes are driven by empathic, humble, and diverse subject matter experts working toward shared goals. We collaborate relentlessly, challenge assumptions, give actionable feedback, and set each other up for success through empowered teams with a clear charter. We transparently take ownership of our growth, individually and as a team. We celebrate the quality of our effort, our learnings, and our collective achievements.</p> <p>We strive to create an accessible and inclusive experience for all candidates. If you need a reasonable accommodation during the application or the recruiting process, please make sure to reach out to your individual recruiter or our team at ----- <p>If you have any additional questions about careers at Tripadvisor you can email us at ----- We have all the answers!</p> <p>&nbsp;</p> <p>&nbsp;</p> <p>#LI-WR1</p> <p>&nbsp;</p> Find more English Speaking Jobs in United Kingdom on Arbeitnow

This vacancy was published on Arbeitnow. Applications are handled entirely by the original publisher.

Similar QA jobs

UK - London - ADS - Test Engineer

JobpostsLondon, Greater London
NewNew today
On-sitePermanentFull-time

<p><span class="author-8908051321 font-color-000000 font-size-medium">Thank you for your application for a role at Alpha Financial Markets </span><span class="author-17078097523 font-color-000000 font-size-medium">C</span><span class="author-8908051321 font-co

Source: ArbeitnowView Job

Supplier Quality Engineer

TeslaUnited Kingdom
Yesterday
On-sitePermanentFull-time

...Mission and role details: The Supplier Quality Engineer (SQE/SQD) is responsible for ensuring that all battery-related components, raw... ...cleanliness requirements (VDA 19.1 / VDA 19.2).

Source: JoobleView Job

Test Engineer (Software)

TeslaUnited Kingdom
Yesterday
On-sitePermanentFull-time

...We are looking for a proactive and detail-oriented Test Engineer (Software) to work Working within the Engineering team and reporting... ...documentation and test reports, and keep records in line with quality and company procedures Support NPD with test sc

Source: JoobleView Job

QA Engineer

Pearson CarterUK
Yesterday
On-sitePermanentFull-timeManual Testing

30000 - 40000 per year

QA Engineer Pearson Carter are currently working with a growing organisation that is investing heavily in its in-house technology team. Due to continued expansion, they are looking to appoint a QA Engineer to join their team, with a primary focus on applicatio

Source: AdzunaView Job