Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Senior Software Engineer, Model Evaluation

Home > Other programming jobs

Senior Software Engineer, Model Evaluation in USA new

  • Remote

Responsibilities

  • Design benchmarks and evaluation suites for manufacturing and supply chain workflows.
  • Work with domain experts to define tasks, reference answers, rubrics, and graders.
  • Train and fine-tune models using evaluation results to guide experiments.
  • Identify agent failures, develop improvements, and validate them with measured results.
  • Help establish research and evaluation practices as an early team member.

Requirements

  • At least 3 years of experience with senior- or staff-level capability.
  • Experience designing and writing benchmarks or evaluations.
  • Experience authoring tasks, defining scope, creating reference solutions or rubrics, and checking task quality.
  • Hands-on experience training and fine-tuning models beyond using models through APIs.
  • Ability to collaborate with non-ML domain experts and translate their knowledge into measurable tasks.
  • Supply chain, procurement, manufacturing, or early-stage startup experience is a plus.

Benefits

  • Fully remote within the United States.
  • Equity included.

Salary: $180k - $250k/yr

Clera

Clera harnesses the power of artificial intelligence to match high-growth startups with exceptional talent, streamlining the entire headhunting process. This innovative approach simplifies the job search for candidates while providing startups with access to a curated pool of skilled professional...

Similar positions

Principal Software Engineer

  • Urrly
  • Full time
  • Remote
  • 11/21/2026
  • Salary: $220k
  • United States

Staff IT Engineer, Security & GRC

  • SecurityScorecard
  • Full time
  • Remote
  • 11/21/2026
  • Salary: USD 65,000 - 75,000
  • US, South America

Principal Engineer, Security

  • Reddit
  • Full time
  • USA
  • 11/21/2026
  • Salary: $269k - $401k/yr
  • Remote

Senior Infrastructure Software Engineer

  • Exowatt
  • Full time
  • USA
  • 11/20/2026
  • Salary: Competitive
  • Austin, TX

Finder Files Senior Software Engineer

  • Apple
  • Full time
  • USA
  • 11/20/2026
  • Cupertino, CA