Your browser does not support javascript! Please enable it, otherwise web will not work for you.

QA Engineering Lead (AI)

Home > Python programming jobs

QA Engineering Lead (AI) in USA new

  • Menlo Park, CA

Responsibilities

  • Own the end-to-end quality strategy for a GenAI product area from development and model evaluation through launch and product improvements.
  • Perform hands-on testing of consumer-facing and business-facing applications, APIs, AI models, backend systems, and infrastructure.
  • Design and maintain AI model evaluation processes using representative datasets, weighted scoring, automated evaluations, human review, and regression coverage.
  • Establish product-specific standards for model correctness, relevance, safety, and robustness.
  • Plan and execute functional, integration, end-to-end, performance, stress, and cross-platform testing.
  • Build reusable test automation and evaluation tooling and integrate quality checks into development workflows.
  • Define quality metrics, analyze failures and coverage gaps, and drive improvements in testing effectiveness and product quality.
  • Lead cross-team quality projects, advise on release readiness, investigate root causes, and prevent recurring defects.
  • Mentor QA engineers in test design, automation, and AI evaluation.

Requirements

  • Bachelor’s degree in Computer Science, Computer Engineering, a relevant technical field, or equivalent practical experience; the degree must be completed before joining Meta.
  • At least 7 years of experience in quality assurance and test engineering for software products or services.
  • At least 2 years of experience in AI model testing or evaluation, including developing evaluation methods and defining model quality standards.
  • Experience independently leading quality engineering for a complex product or system and delivering measurable improvements.
  • Experience developing test automation or evaluation tooling in Python, PHP, Java, C/C++, or an equivalent programming language.
  • Hands-on experience testing and debugging web or mobile applications, APIs, backend services, and AI models.
  • Experience with test planning, test design and execution, performance and stress testing, and client and server test automation.
  • Experience using metrics and failure analysis to prioritize improvements and inform release decisions.
  • Experience coordinating work across engineering and cross-functional partners, communicating technical risks and trade-offs, and mentoring engineers.
  • Preferred experience includes building reusable testing or evaluation frameworks, responsible AI practices, human and automated model evaluation, frontier model evaluation, multimodal model testing, prompt/context engineering, agent orchestration, and partnering with AI research teams.

Benefits

  • $138,000/year to $191,000/year plus bonus, equity, and benefits.

Salary: $138k - $191k/yr

Meta

Meta builds social platforms and communication apps—including Facebook, Instagram, WhatsApp, and Messenger—and develops AR/VR hardware and software such as Quest to power immersive computing. It monetizes primarily through advertising tools for businesses, with additional revenue from devices and...

Similar positions

Lead Data Engineer

  • Oddball
  • Full time
  • USA
  • 11/06/2026
  • Salary: $110k-$145k
  • Remote

Software Engineering Intern - Waterloo University

  • Brave
  • Contract
  • Canada
  • 11/06/2026
  • Salary: $6.0k per month
  • Remote

Senior Security QA Engineer, Cloud

  • Qualys, Inc.
  • Full time
  • Others
  • 11/06/2026
  • Pune, India

Staff Engineer - Cloud Backend Engineering

  • Coupang
  • Full time
  • Others
  • 11/06/2026
  • Bengaluru, India

Lead Backend Developer, Distributed Systems

  • Movable Ink
  • Full time
  • Remote
  • 11/06/2026
  • Salary: $105k-$137k
  • Canada