Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Member of Technical Staff, Agents

Home > Python programming jobs

Member of Technical Staff, Agents in USA new

  • Palo Alto, CA

Responsibilities

  • Build autonomous agents that complete delegated work end to end.
  • Design evaluation frameworks, success measures, representative datasets, benchmarks, and metrics for real-world agent tasks.
  • Develop agent capabilities for tools used by executives and verify readiness before launch.
  • Investigate production failures, identify root causes, and deliver preventative fixes.
  • Build scalable failure detection using evaluation and monitoring tools.
  • Improve agent recovery from tool and website failures.
  • Create repeatable workflows to measure whether agent changes improve performance.

Requirements

  • At least 3 years of experience in data science or machine learning roles building or delivering evaluation systems, metrics, or product-quality measurement.
  • Production-level Python and SQL skills for analysis, large datasets, and automated pipelines.
  • Experience designing evaluation frameworks with success criteria, representative datasets, appropriate metrics, and trustworthy benchmarks.
  • Experience with statistics, experiment design, and realistic end-to-end simulations for evaluating agent changes.
  • Experience building or operating agents for real users and improving their reliability.
  • Post-training, fine-tuning, or reinforcement learning experience is valuable.
  • Experience owning and shipping systems to users with demonstrated impact.
  • Familiarity with Django, React, and TypeScript.
  • Demonstrated sustained contribution and growth, such as through role progression, founding a startup, or earning a promotion.

Benefits

  • Base salary of $200,000 to $300,000 annually.
  • On-site in Palo Alto, California, with four days per week in the office.
  • Visa sponsorship is not available.

Salary: $200k - $300k/yr

Clera

Clera harnesses the power of artificial intelligence to match high-growth startups with exceptional talent, streamlining the entire headhunting process. This innovative approach simplifies the job search for candidates while providing startups with access to a curated pool of skilled professional...

Similar positions

Member of Technical Staff

  • Clera
  • Full time
  • USA
  • 10/31/2026
  • Salary: $130k - $220k/yr
  • San Francisco, CA

Principal Software Engineer

  • Akamai
  • Full time
  • USA
  • 10/31/2026
  • Salary: $169k - $305k/yr
  • Remote

Software Developer in Observability

  • Canonical
  • Full time
  • Remote
  • 10/31/2026
  • EMEA, Americas

Senior Member of Technical Staff

  • Clera
  • Full time
  • USA
  • 10/31/2026
  • Salary: $150k - $215k/yr
  • San Francisco, CA

Software Engineer (L1)

  • Twilio
  • Full time
  • Remote
  • 10/31/2026
  • Salary: Competitive
  • India