Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Member of Technical Staff, Agents

Home > Python programming jobs

Member of Technical Staff, Agents in USA new

  • Palo Alto, CA

Responsibilities

  • Build autonomous agents that complete delegated work end to end without requiring users to check each step.
  • Define measurable success criteria and evaluation methods for agent performance across tasks.
  • Develop and evaluate agent capabilities before releasing them to users.
  • Investigate production failures, identify underlying causes, and deliver durable fixes.
  • Build systems using Braintrust and Raindrop to detect known and unpredictable failure patterns at scale.
  • Improve agent recovery when tools or websites fail.
  • Create repeatable evaluation workflows for measuring the impact of engineering changes.

Requirements

  • At least 3 years of data science or machine learning experience building evaluation systems, metrics, or product-quality measurement.
  • Production-quality Python and SQL skills for analysis, large datasets, and automated pipelines.
  • Experience designing evaluation frameworks, representative datasets, meaningful metrics, and realistic end-to-end simulations.
  • Track record delivering production AI, ML, agent, or agent-evaluation systems for real users and measuring their impact.
  • Experience improving agent reliability, owning systems end to end, and using statistics and experiment design to evaluate changes.
  • Experience with Django, React, and TypeScript.
  • Familiarity with post-training, fine-tuning, or reinforcement learning is useful.
  • Demonstrated progression and sustained experience in a role, with comfort working in a fast-moving, ambiguous environment.

Benefits

  • On-site work in Palo Alto, California.
  • Visa sponsorship is not available.

Salary: $200k - $300k/yr

Clera

Clera harnesses the power of artificial intelligence to match high-growth startups with exceptional talent, streamlining the entire headhunting process. This innovative approach simplifies the job search for candidates while providing startups with access to a curated pool of skilled professional...

Similar positions

Software Engineer, Datacenter Server Lifecycle

  • Anthropic
  • Full time
  • USA
  • 11/18/2026
  • Salary: $405k - $485k/yr
  • Remote

Infrastructure - Intermediate Software Engineer

  • Sony Pictures Imageworks
  • Full time
  • Canada
  • 11/18/2026
  • Vancouver

Senior Software Engineer, Simulator Platform

  • Waymo
  • Full time
  • USA
  • 11/18/2026
  • Salary: $213k - $263k/yr
  • Mountain View, CA

Associate Software Engineer

  • Sony Pictures Imageworks
  • Full time
  • Canada
  • 11/18/2026
  • Vancouver

Senior Software Engineer, Agentic AI

  • Clover Health
  • Full time
  • USA
  • 11/18/2026
  • Salary: $169k - $220k/yr
  • Remote