Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Software Engineer, ML Developer Experience

Home > Python programming jobs

Software Engineer, ML Developer Experience in USA

  • Anyscale
  • Full time
  • Email
  • San Francisco, CA

Responsibilities

  • Build developer tooling and MLOps capabilities on Ray for developers and coding agents.
  • Develop CLI, SDK, API, and MCP surfaces with self-discovery, structured errors, dry-run support, and consistent platform behavior.
  • Improve Anyscale Workspaces workflows covering environments, dependencies, images, authentication, workload submission, and debugging.
  • Build tools for data preparation, fine-tuning and post-training, evaluation, production serving, dataset management, experiment tracking, and lineage.
  • Develop model registration, deployment, benchmarking, and LLM service-metrics capabilities for production endpoints.
  • Provide observability and failure diagnosis across jobs, tasks, actors, nodes, and GPUs.
  • Design integrations using OpenAI-compatible APIs, OpenTelemetry, and stable Jobs and Services interfaces.
  • Design and operate highly available backend services and platform architecture across serverless and bring-your-own-cloud environments.
  • Work with users, field teams, distributed systems experts, and machine learning experts to scope, ship, and iterate on products.

Requirements

  • Bachelor's degree in Computer Science, Engineering, or equivalent practical experience.
  • At least 5 years of experience writing high-quality production code.
  • Strong foundation in algorithms, data structures, and system design.
  • Experience with modern machine learning tooling, including PyTorch, MLflow, data catalogs, or similar tools.
  • Hands-on experience building and operating highly available production services.
  • Strong product instincts and a record of shipping developer-facing tools that users choose to use.
  • Preferred: experience building and maintaining open-source projects.
  • Preferred: experience operating machine learning infrastructure in production.
  • Preferred: experience building highly available serving systems.
  • Preferred: experience using Ray.

Benefits

  • The posting identifies Anyscale as an Equal Opportunity Employer.
  • Anyscale is an E-Verify company.

Salary: $226k - $283k/yr

Anyscale

Anyscale enables Python developers to build and run all their AI—from data prep to training and inference—at any scale. Anyscale is trusted by leading AI teams at Canva, TripAdvisor, Physical Intelligence, Coinbase and more.

Similar positions

Software Engineer in Test

  • Roadie
  • Full time
  • USA
  • 09/13/2026
  • Salary: Competitive
  • Remote

Principal Software Engineer - Builder Experience

  • Elastic
  • Full time
  • Remote
  • 09/13/2026
  • Salary: €73k-€116k
  • Greece

Principal Software Engineer - Builder Experience

  • Elastic
  • Full time
  • Remote
  • 09/13/2026
  • Salary: zł 369k-zł 584k
  • Poland

Senior Software Engineer, ML Ops

  • PathAI
  • Full time
  • USA
  • 09/13/2026
  • Salary: $128k - $196k/yr
  • Boston, MA

Mission Software Engineer II

  • Varda Space Industries
  • Full time
  • USA
  • 09/13/2026
  • Salary: $144k - $184k/yr
  • El Segundo, CA

Listings

by


Job Type

Language

Country

CodingJobBoard.com © 2026