Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Applied AI Engineer, Evals

Home > Other programming jobs

Applied AI Engineer, Evals in USA

  • San Francisco, CA

Responsibilities

  • Design evaluations for voice, vision, and browser use to guide improvements in the agent, context, and models.
  • Build and maintain internal benchmarks and simulations.
  • Develop systems to score customer-specific scenarios and identify gaps in current capabilities.
  • Use evaluation findings to optimize the agent, context, and models.

Requirements

  • Engineering experience with statistics and/or applied machine learning.
  • Comfort working in a production codebase.
  • Prior experience with evaluations, voice, realtime systems, or browser/computer-use agents is a bonus.

Sable

Sable empowers businesses to unlock their full potential through innovative technology solutions and strategic consulting. By blending deep industry expertise with a customer‑centric approach, we help organizations streamline operations, accelerate growth, and stay ahead of market trends. Our col...

Similar positions

AWS Cloud Security & Guardrails Engineer

  • Virtual Service Operations, Inc.
  • Full time
  • USA
  • 10/31/2026
  • Salary: $165k - $210k/yr
  • Herndon, VA

Senior Ai/ML Engineer

  • Redhorse Corporation
  • Full time
  • USA
  • 10/31/2026
  • Salary: $180k - $200k/yr
  • Remote

Software Engineer, Foundation

  • Clera
  • Full time
  • Others
  • 10/31/2026
  • Berlin, Germany

Staff Product Engineer, Backend (LATAM)

  • Moxie
  • Full time
  • Remote
  • 10/31/2026
  • Salary: USD 97,000 - 170,000
  • South America

Staff+ Software Engineer, AI

  • Aleph
  • Full time
  • Remote
  • 10/31/2026
  • Salary: $130k-$350k
  • Americas