Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Production Engineer

Home > Python programming jobs

Production Engineer in Others

  • ByteDance
  • Full time
  • Email
  • Singapore, Singapore

Responsibilities

  • Manage production operations and stability for AML training, inference, and storage systems across scheduling, orchestration, Kubernetes/GPU clusters, distributed training, online inference, and Parameter Server/NoSQL storage.
  • Build and maintain SLO/SLA frameworks, observability, alerting, on-call processes, incident diagnosis, self-healing, disaster recovery, and post-incident review practices.
  • Develop engineering capabilities including canary and gradual deployments, automated rollback, health inspections, pre-flight checks, capacity forecasting, and elastic scaling.
  • Lead resource governance and optimization across GPU, CPU, storage, and network infrastructure, including quota management, cost attribution, and performance tuning.

Requirements

  • Bachelor's degree or above in Computer Science, Software Engineering, Artificial Intelligence, or a related field.
  • Proficiency in Linux and at least one of Shell, Python, Go, or C++.
  • Familiarity with machine learning training and inference architectures, Kubernetes, GPU clusters, or distributed storage systems.
  • Experience with production issue troubleshooting, performance analysis, and automation platform development.
  • Strong ownership, analytical and problem-solving skills, and the ability to drive cross-functional collaboration.
  • Preferred experience with large-scale training, inference, or storage platforms, SLO governance, FinOps practices, NoSQL systems, or open-source infrastructure projects.
  • Preferred hands-on experience operating and governing large-scale Kubernetes containerized clusters, including Operators, declarative operations, and release protection mechanisms.
  • Preferred familiarity with recommendation and advertising system architectures and AI infrastructure components such as Parameter Servers or KV Caches, including Mooncake.

ByteDance

ByteDance is a global incubator of platforms at the cutting edge of commerce, content, entertainment and enterprise services - over 2.5bn people interact with ByteDance products including TikTok. Creation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This...

Similar positions

Software Engineer in Test

  • Roadie
  • Full time
  • USA
  • 09/13/2026
  • Salary: Competitive
  • Remote

Principal Software Engineer - Builder Experience

  • Elastic
  • Full time
  • Remote
  • 09/13/2026
  • Salary: €73k-€116k
  • Greece

Principal Software Engineer - Builder Experience

  • Elastic
  • Full time
  • Remote
  • 09/13/2026
  • Salary: zł 369k-zł 584k
  • Poland

Senior Devops Engineer

  • Woliba
  • Full time
  • USA
  • 09/13/2026
  • Remote

Senior Core Infrastructure Engineer

  • Oracle
  • Full time
  • USA
  • 09/13/2026
  • Salary: Competitive
  • Nashville, TN