Sr Staff Machine Learning Systems

Home > Python programming jobs

Sr Staff Machine Learning Systems in USA

Hims & Hers
Full time
Email

USA
08/19/2026
Report

Remote

Responsibilities

Set technical direction for evaluation systems, including metric, judge, scorer, statistical regression, and failure-tracking design
Design and scale ingestion, transformation, dataset-versioning, labeling, and calibration pipelines for evaluation and data science
Define evaluation approaches for new AI services and lead multi-team initiatives to replace manual reviews with automated statistical gates
Own adversarial and red-team evaluation programs, including test suites and failure taxonomies for safety and edge-case risks
Lead ambiguous, cross-team projects from initial concept through production and drive alignment across engineering, product, AI, clinical, legal, and platform stakeholders
Originate reusable evaluation methodologies and lead major platform improvements with organization-wide impact
Share evaluation and data pipeline expertise through internal talks and written guidance
Mentor engineers, including experienced engineers, and raise technical and statistical standards

Requirements

10+ years of experience in ML infrastructure, data engineering, or evaluation/testing systems
Hands-on experience designing and calibrating LLM judges and scorers, statistically sound regression testing, human-label agreement measurement, and adversarial or red-team evaluations
Hands-on experience with dataset versioning, feature and benchmark pipelines, labeling and calibration workflows, and high-throughput ingestion and transformation systems
Demonstrated impact beyond a single team or project and a history of establishing standard approaches for broader groups
Experience leading multi-team projects to completion and resolving significant technical disagreements
Experience mentoring engineers, including senior engineers, and raising the technical and statistical bar of teams
Excellent communication and ability to build support across varied audiences before launch
Strong Python skills and sufficient statistical fluency to design and defend production testing frameworks
Preferred: experience with Databricks, MLflow, Unity Catalog, or similar data and evaluation platforms
Preferred: experience building reporting tools such as automated Slack digests or spreadsheet reports for non-technical teams
Preferred: experience in a regulated industry such as healthcare, fintech, or life sciences
Preferred: company-wide talks or write-ups that changed how other teams approached a problem

Benefits

Competitive salary and equity compensation for full-time roles
Unlimited paid time off, company holidays, and quarterly mental health days
Medical, dental, vision, and parental leave benefits
Employee Stock Purchase Program (ESPP)
401(k) with employer matching contribution
Offsite team retreats
Flexible and remote work approach

Salary: $240k - $265k/yr

Hims & Hers

Hims & Hers Health, Inc. (better known as Hims & Hers) is a multi-specialty telehealth platform building a virtual front door to the healthcare system. We connect consumers to licensed healthcare professionals, enabling people to access high-quality medical care—from wherever is most convenient—f...

Similar positions

Research Scientist - Machine Learning

ISEE
Full time

USA
09/13/2026

Remote

Staff Backend Engineer - Submission Processing

Kalepa
Full time

Remote
09/13/2026
Salary: $100k-$185k

Europe

Senior/Staff Full Stack Engineer

Workstream
Full time

Canada
09/13/2026
Salary: Competitive

Vancouver

Senior Machine Learning Engineer

Entefy
Full time

USA
09/13/2026

Remote

Senior Machine Learning Engineer - Fraud

Plaid
Full time

USA
09/13/2026
Salary: $229k - $315k/yr

Seattle, WA