Member of Technical Staff

Home > Python programming jobs

Member of Technical Staff in USA new

Hark
Full time
Email

USA
10/13/2026
Report

San Jose, CA

Responsibilities

Build and own end-to-end evaluation suites for LLM capabilities, including task specifications, grading logic, and researcher dashboards.
Operate evaluation harnesses as production services with sandboxed execution, tool calling, multi-turn and agentic tasks, deterministic replay, and caching.
Own data pipelines for collection, filtering, deduplication, labeling, synthetic data generation, and quality gates.
Build and maintain RL training environments, including reward functions, simulators, verifiers, and task generators.
Collaborate with researchers to turn hypotheses into runnable evaluations and environments and interpret results.
Measure evaluation regressions, environment health, throughput, and cost while identifying misleading metric changes.
Improve research-code quality through testing, versioned datasets and evaluations, and clear training, inference, and evaluation boundaries.

Requirements

At least 3 years of software engineering experience, including 1–2 years of hands-on LLM training, evaluation, or data-infrastructure experience.
Deep Python fluency and practical distributed-systems experience across unreliable workers and machine fleets.
Experience building evaluation infrastructure, including tasks, graders, and supporting systems.
Working knowledge of supervised fine-tuning and reinforcement learning for language models.
Production-oriented engineering practices, including testing and reproducibility.
Ability to work effectively with researchers and turn ambiguous ideas into measurable systems.
Preferred qualifications include agentic evaluation, tool use, code execution, sandbox environments, multi-turn tasks, training frameworks, inference stacks, data-labeling operations, human-preference collection, open-source evaluation frameworks, public benchmarks, verifiers, and simulation environments.

Benefits

Full-time position with a US base salary range of $180,000–$450,000 annually.
Additional compensation components and benefits may be included depending on the specific role and shared if an employment offer is extended.

Salary: $180k - $450k/yr

Hark

Hark is a forward‑thinking technology firm that empowers businesses to harness the power of data-driven insights and automation. By blending cutting‑edge analytics with intuitive user experiences, we help organizations streamline operations, unlock new growth opportunities, and stay ahead in a ra...

Similar positions

Deployed Engineer, Professional Services

LangChain
Full time

Remote
10/15/2026
Salary: Competitive

Singapore, US

Senior Software Engineer

Nuro
Full time

USA
10/15/2026
Salary: $160k - $291k/yr

Mountain View, CA

Senior Software Engineer, Network Development

CoreWeave
Full time

USA
10/15/2026
Salary: $165k - $220k/yr

Bellevue, WA

Technical Lead, Machine Learning

Bjak
Full time

Remote
10/15/2026

Worldwide

Senior Software Engineer - Data Engineer

Tekion
Full time

Others
10/15/2026
Salary: Competitive

Bengaluru, India