Applied AI Engineer, Evals

Home > Other programming jobs

Applied AI Engineer, Evals in USA new

Sable
Full time
Email

USA
09/16/2026
Report

San Francisco, CA

Responsibilities

Design evaluations for voice, vision, and browser use to guide improvements in the agent, context, and models.
Build and maintain internal benchmarks and simulations.
Develop systems to score customer-specific scenarios and identify gaps in current capabilities.
Use evaluation findings to optimize the agent, context, and models.

Requirements

Engineering experience with statistics and/or applied machine learning.
Comfort working in a production codebase.
Prior experience with evaluations, voice, realtime systems, or browser/computer-use agents is a bonus.

Sable

Sable empowers businesses to unlock their full potential through innovative technology solutions and strategic consulting. By blending deep industry expertise with a customer‑centric approach, we help organizations streamline operations, accelerate growth, and stay ahead of market trends. Our col...

Similar positions

Security Engineer, Compliance Penetration Testing

Amazon
Full time

USA
09/16/2026
Salary: $159k - $202k/yr

Remote

Senior Backend Software Engineer, LiveOps

BRINC
Full time

USA
09/16/2026
Salary: $142k - $265k/yr

Seattle, WA

Principal Engineer, Search Platform

Atlassian
Full time

Remote
09/15/2026

India

Senior Backend Engineer, AMER

GitLab
Full time

Remote
09/15/2026
Salary: $139k-$235k

Canada, USA

Senior Software Engineer, Streaming Platform

Robinhood
Full time

USA
09/15/2026
Salary: $196k - $230k/yr

Bellevue, WA