Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Software Engineer, Tinker Infrastructure

Home > Javascript/Typescript programming jobs

Software Engineer, Tinker Infrastructure in USA new

  • Thinking Machines Lab
  • Full time
  • Email
  • San Francisco, CA

Responsibilities

  • Design, build, and operate distributed systems for scheduling, resource orchestration, checkpointing, and fault recovery across large GPU clusters.
  • Own the reliability, latency, and throughput of production systems serving concurrent training and sampling workloads.
  • Design graceful degradation and rapid recovery for node failures, preemptions, network partitions, and other partial failures.
  • Improve platform observability through metrics, tracing, and alerting.
  • Lead incident response, root-cause analysis, and durable remediation for owned systems.
  • Partner with research and ML infrastructure teams to evolve the platform for new training and sampling workloads.
  • Make architectural and build-versus-buy decisions for core infrastructure and mentor engineers on distributed-systems practices.

Requirements

  • 7+ years of experience building, operating, and scaling distributed systems in production with direct on-call ownership of live services.
  • Deep understanding of consensus, consistency models, failure detection, scheduling, and state management under partial failure.
  • Demonstrated ability to design reliable systems at scale and diagnose and resolve production incidents under time pressure.
  • Strong systems-level coding ability in Python, Go, Rust, or C++, with comfort working close to the infrastructure layer.
  • Experience with large-scale GPU or accelerator clusters, job orchestration, resource scheduling, or ML training infrastructure is preferred.
  • Familiarity with large-language-model training or inference systems and fine-tuning or post-training workload demands is preferred.
  • Experience with checkpointing, distributed storage, or high-throughput networking such as RDMA or NCCL is preferred.
  • Experience building reliable and usable developer-facing infrastructure or APIs is preferred.
  • Platform-wide architectural leadership and significant autonomy in a fast-changing environment are preferred.

Benefits

  • Annual salary range of $300,000-$400,000 USD.
  • Health, dental, and vision benefits.
  • Unlimited paid time off and paid parental leave.
  • Relocation support as needed.
  • Role is based in San Francisco, California, or New York, New York.
  • Visa sponsorship is available with a commitment to work through the visa process together, although success is not guaranteed for every candidate or role.

Salary: $300k - $400k/yr

Thinking Machines Lab

Thinking Machines Lab pioneers advanced AI research, blending cutting‑edge theory with practical applications to solve complex problems across industries. Our interdisciplinary team pushes the boundaries of machine learning, neural architecture, and cognitive modeling to deliver innovative soluti...

Similar positions

Staff Performance Engineer, JavaScript Engine

  • Mozilla
  • Full time
  • UK
  • 11/18/2026
  • Salary: £81k-£108k
  • Remote

Staff Software Engineer, GI Team

  • Hinge Health
  • Full time
  • USA
  • 11/18/2026
  • Salary: $197k - $264k/yr
  • San Francisco, CA

Software Engineer, Agent Experience

  • AssemblyAI
  • Full time
  • Remote
  • 11/18/2026
  • Salary: $160k-$210k
  • North America

Lead Software Engineer - UI Specialist

  • Platform Science
  • Full time
  • Others
  • 11/18/2026
  • Chennai, India

Staff Software Engineer

  • Wheel
  • Full time
  • Remote
  • 11/18/2026
  • Salary: $185k-$264k
  • United States