Lead Research Engineer, Data Quality

Home > Python programming jobs

Lead Research Engineer, Data Quality in USA

Clera
Full time
Email

USA
10/06/2026
Report

San Francisco, CA

Responsibilities

Lead development of systems for evaluating tasks across reinforcement learning environments, synthetic data, benchmarks, and domain-specific workflows.
Define quality standards, metrics, experiments, and processes for assessing AI-agent outputs.
Develop scalable synthetic-data validation methods, including failure analysis, task mutation checks, and trajectory audits.
Partner with research engineers, domain experts, and data vendors to diagnose issues and improve data-generation workflows.
Build production tools, dashboards, validation pipelines, and feedback loops from research insights.
Mentor research engineers and promote technical rigor and clear communication.

Requirements

At least 5 years of research or engineering experience building AI or machine-learning data evaluation and quality systems.
Experience leading technical teams or projects from problem definition through implementation and iteration.
Advanced proficiency in Python, Docker, and Linux, with a technical education or background.
Strong understanding of AI evaluations, post-training, and the qualities of realistic, learnable, diverse, and reliable agent-training data.
Experience building evaluation infrastructure, benchmarks, synthetic-data pipelines, or validation workflows.
Ability to translate domain expertise and research insights into scalable review systems and production data pipelines.
Strong written communication and ability to work independently in an early-stage startup environment.

Benefits

Salary range of $150,000 to $180,000 annually.
Visa sponsorship is available.
On-site role in San Francisco, California, United States.

Salary: $150k - $180k/yr

Clera

Clera harnesses the power of artificial intelligence to match high-growth startups with exceptional talent, streamlining the entire headhunting process. This innovative approach simplifies the job search for candidates while providing startups with access to a curated pool of skilled professional...

Similar positions

Core Services Data Operations

FICO
Full time

Remote
10/15/2026
Salary: Competitive

Mexico

Senior Data Scientist

DuckDuckGo
Full time

Remote
10/15/2026
Salary: USD 178,500

Worldwide

Lead Engineer, Machine Learning

Bjak
Full time

Remote
10/15/2026

Worldwide

Deployed Engineer, Professional Services

LangChain
Full time

Remote
10/15/2026
Salary: Competitive

Singapore, US

Tech Lead

The Motley Fool
Full time

USA
10/15/2026
Salary: $200k-$230k

Remote