Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Software Engineer Graduate - 2027 Start

Home > Golang programming jobs

Software Engineer Graduate - 2027 Start in USA

  • ByteDance
  • Full time
  • Email
  • San Jose, CA

Responsibilities

  • Design and build large-scale container-based cluster management and orchestration systems focused on performance, scalability, and resilience.
  • Architect cloud-native GPU and AI accelerator infrastructure for cost-efficient and secure machine learning platforms.
  • Deliver LLM inference solutions using vLLM, SGLang, TensorRT-LLM, and other inference engines.
  • Integrate advances in Kubernetes, Ray, AI/ML, LLM infrastructure, and systems research into production systems.
  • Write maintainable, testable, scalable, production-ready code.
  • Collaborate with global, cross-functional teams and contribute to open-source infrastructure.

Requirements

  • Completing or recently completed a PhD in Software Development, Computer Science, Computer Engineering, or a related technical discipline.
  • Strong understanding of large model inference, distributed and parallel systems, and/or high-performance networking systems.
  • Hands-on experience building cloud or ML infrastructure involving resource management, scheduling, request routing, monitoring, or orchestration.
  • Knowledge of Docker and Kubernetes.
  • Proficiency in at least one of Go, Rust, Python, or C++.
  • Preferred experience operating or contributing to large-scale cluster management systems such as Kubernetes or Ray.
  • Preferred experience with workload scheduling, GPU orchestration, scaling, and isolation in production environments.
  • Preferred experience with CUDA or inference engines such as vLLM, SGLang, and TensorRT-LLM.
  • Preferred familiarity with AWS, Azure, GCP, SageMaker, Azure ML, and Vertex AI.
  • Preferred knowledge of Ray, DeepSpeed, PyTorch, and distributed training or inference platforms.
  • Strong communication and cross-functional collaboration skills, with an interest in system efficiency, performance optimization, and open-source innovation.

Benefits

  • Graduate role with a 2027 start and onboarding availability required by the end of the year.
  • Opportunity to work in a hyperscale global datacenter environment and contribute to open-source infrastructure.
  • Candidates should state their availability and graduation date clearly in their resume.

ByteDance

ByteDance is a global incubator of platforms at the cutting edge of commerce, content, entertainment and enterprise services - over 2.5bn people interact with ByteDance products including TikTok. Creation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This...

Similar positions

Senior Software Engineer

  • Roku
  • Full time
  • Others
  • 09/22/2026
  • Bengaluru, India

Senior Kubernetes Platform Engineer

  • Firmus Technologies
  • Full time
  • Australia
  • 09/22/2026
  • Sydney

Senior Platform Engineer

  • Recorded Future
  • Full time
  • USA
  • 09/22/2026
  • Salary: $129k - $194k/yr
  • Remote

Software Engineer, Network Security

  • Google
  • Full time
  • Australia
  • 09/22/2026
  • Sydney

Software Engineer, Ads

  • Reddit
  • Full time
  • USA
  • 09/22/2026
  • Salary: $164k-$230k
  • Remote