Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Sr. Software Engineer, Pretraining Data

Home > Other programming jobs

Sr. Software Engineer, Pretraining Data in USA new

  • Palo Alto, CA

Responsibilities

  • Design, build, and scale distributed data infrastructure that converts raw web, code, multimodal, and acquired data into training-ready datasets.
  • Own high-throughput data pipelines, orchestration systems, tooling, data lineage, freshness, observability, reproducibility, and pipeline health.
  • Build and deploy high-performance models and algorithms to classify, rank, deduplicate, filter, and clean training data.
  • Run experiments involving data mixtures, sampling strategies, and quality thresholds, translating findings into production systems.
  • Build and optimize large-scale web crawling infrastructure for URL discovery, prioritization, host scheduling, fetching, parsing, and content extraction.
  • Improve crawl coverage, efficiency, reliability, anti-bot resilience, extraction quality, and automated recovery.
  • Lead complex initiatives across data platform, data quality, crawling, acquisition, and model-training teams.
  • Drive architecture and technical direction, mentor engineers, and connect data-system improvements to model performance.

Requirements

  • At least 5 years of professional software engineering experience building distributed systems and/or large-scale data infrastructure.
  • Strong infrastructure or data platform background, ideally with exceptional depth in a relevant area.
  • Ability to architect and ship end-to-end systems, debug complex systems independently, and work alongside AI agents.
  • Strong understanding of large-scale distributed systems and operating them reliably at frontier scale.
  • Track record of leading technical projects across teams and mentoring engineers.
  • Interest in how pretraining data shapes model quality and in owning systems that support frontier training runs.
  • Must be able to work onsite at the Palo Alto office.

Benefits

  • Equity and comprehensive medical, vision, and dental coverage.
  • Access to a 401(k) retirement plan, short- and long-term disability insurance, life insurance, discounts, and other perks.
  • Onsite work arrangement at the Palo Alto office.

Salary: $220k - $357k/yr

Cursor

Cursor is an AI-powered code editor and coding assistant from Anysphere, built for professional software engineers and enterprise teams. It combines a VS Code–style editor with integrated AI chat, code generation, and repo-aware refactoring, and is sold via individual, team, and enterprise subscr...

Similar positions

Staff Backend Engineer, Agent Infrastructure

  • Airbyte
  • Full time
  • USA
  • 11/12/2026
  • Salary: $250k - $280k/yr
  • San Francisco, CA

Software Architect

  • Consilio LLC
  • Full time
  • Others
  • 11/12/2026
  • Bengaluru, India

Sr Software Engineer - Builder Tools

  • Human Interest
  • Full time
  • Remote
  • 11/12/2026
  • Salary: $190k-$230k
  • United States

Senior QA Engineer, Sparkrock

  • Ionic Partners
  • Full time
  • Remote
  • 11/12/2026
  • Salary: USD 50,000
  • Argentina, Brazil

Member of Data Staff

  • Perplexity
  • Full time
  • USA
  • 11/12/2026
  • Salary: $175k - $330k/yr
  • San Francisco, CA