Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Data Infrastructure Engineer, Pre-training

Home > Python programming jobs

Data Infrastructure Engineer, Pre-training in USA

  • Anthropic
  • Full time
  • Email
  • San Francisco, CA

Responsibilities

  • Design and implement highly performant, reproducible, and traceable data-processing infrastructure for large language model training.
  • Develop scalable processing primitives including tokenization, deduplication, and chunking.
  • Build data quality assurance and validation systems at scale.
  • Collaborate with research teams to implement novel data-processing architectures.
  • Build and operate end-to-end pipelines that transform raw web-scale corpora into training-ready datasets.
  • Develop distributed computing architectures and fault-tolerant infrastructure components based on research requirements.

Requirements

  • At least 5 years of professional experience outside internships.
  • Strong software engineering skills building high-throughput, fault-tolerant distributed systems.
  • Hands-on experience with distributed computing frameworks, particularly Apache Spark.
  • Advanced degree in Computer Science or a related field preferred.
  • Experience with language model training infrastructure preferred.
  • Background in data infrastructure, MLOps, or ML infrastructure preferred.
  • Expertise with Python and Rust preferred.
  • Strong problem-solving, communication, collaboration, ownership, and attention-to-detail skills.

Benefits

  • Hybrid work policy requiring staff to be in an Anthropic office at least 25% of the time, with some roles requiring more office time.
  • Visa sponsorship with immigration-lawyer support when sponsorship is possible.
  • Competitive compensation and benefits.
  • Optional equity donation matching.
  • Generous vacation and parental leave.
  • Flexible working hours.
  • Collaborative office space.

Salary: $500k - $850k/yr

Anthropic

Anthropic builds AI systems that are reliable, interpretable, and steerable, with a commitment to ensuring their safety and benefit to users and society. Our work is driven by a dedicated team of researchers, engineers, and policy experts focused on the development of beneficial AI solutions.

Similar positions

Senior Core Infrastructure Engineer

  • Oracle
  • Full time
  • USA
  • 09/13/2026
  • Salary: Competitive
  • Nashville, TN

Senior Software Engineer, ML Ops

  • PathAI
  • Full time
  • USA
  • 09/13/2026
  • Salary: $128k - $196k/yr
  • Boston, MA

Data Platform Engineer

  • Worth AI
  • Full time
  • USA
  • 09/13/2026
  • Orlando, FL

Software Engineer III - Data Engineer

  • JPMorgan Chase
  • Full time
  • USA
  • 09/13/2026
  • Salary: Competitive
  • Plano, TX

Senior Software Engineer, Fullstack

  • PathAI
  • Full time
  • USA
  • 09/13/2026
  • Salary: $128k - $196k/yr
  • Boston, MA

Listings

by


Job Type

Language

Country

CodingJobBoard.com © 2026