**This role requires fluency (speaking, reading, and writing) in one or more European languages — French, German, Dutch, Polish, Turkish, or Portuguese — as you'll drive quality across Alexa+'s multilingual experience in 100+ countries.**
Come join us to launch Alexa+ globally to millions of customers across 100+ countries, solving hard challenges in multilingual, conversational CX evaluation across multimodal experiences spanning text, voice, and visual across many device surfaces. We are solving hard challenges in validation across speech, visual, conversational quality, locale cultural, and linguistic dimensions -building agentic automation tooling that spans the full quality spectrum from synthetic test generation, to LLM-as-a-Judge evaluation, to visual validation using AI, to cultural relevancy classification powered by machine learning.
As a Sr. Quality Assurance Engineer in the Alexa Global Quality (AGQ) team, you will own the end-to-end quality of Alexa+ ensuring millions of customers receive a culturally relevant, high-quality experience spanning voice, text, and visual modalities.
You'll tackle complex challenges in multilingual conversational CX evaluation — building agentic automation tooling that spans the full quality spectrum from synthetic test generation, to LLM-as-a-Judge evaluation, to visual validation using AI, to cultural relevancy classification powered by machine learning. Our team focuses on expanding Alexa+ globally while maintaining the cultural and linguistic nuances that matter to our diverse customer base. You'll define global test strategies, architect AI-powered evaluation frameworks, and shape how quality is measured across multiple features, endpoints, and languages.
Key job responsibilities
You will own the end-to-end quality strategy for Alexa's multi-locale experience, defining and driving global test approaches that assess quality across multiple features, endpoints, and languages. Working closely with engineers, you'll architect the best technical design and testing approach for internationalisation (i18n), and drive the evolution of agentic quality evaluation frameworks — encompassing synthetic test case generation, multimodal response validation, and automated cultural and linguistic correctness assessment.
Your work will span both strategic and hands-on execution. You'll run end-to-end test suites autonomously and manually, monitor production trends, and take decisive action to improve the customer experience. You'll create metrics and reports on quality status, technical operations, and system performance across all locales, driving towards quality bars that are consistent yet culturally appropriate per market.
You'll also develop automation and quality tooling that improves test efficiency across a global organisation, and collaborate effectively with product managers, Country Product Managers, designers, engineering, locale experts, and business teams to deliver the best overall experience — factoring in financial goals, usability targets, and locale-specific customer expectations.
A day in the life
As a Sr. QAE on the AGQ team, your day will involve reviewing automated test results across multiple locales, triaging quality signals from production, and collaborating with engineers and locale experts to resolve issues. You'll balance strategic work — refining evaluation frameworks and driving tooling improvements — with hands-on testing of new Alexa+ features before they reach customers worldwide.
About the team
The Alexa Global Quality team ensures Alexa+ delivers an exceptional, culturally authentic experience to customers in every supported locale. We combine deep linguistic expertise with Niche AI-powered evaluation to scale quality at pace. Our culture values ownership, curiosity, and a genuine passion for delighting customers across cultures and languages.
Future Tech Jobs
:quality(80))
:quality(80))
:quality(80))
