Your browser does not support javascript! Please enable it, otherwise web will not work for you.

AI Software Development Engineer

Home > Python programming jobs

AI Software Development Engineer in Others new

  • Taipei, Taiwan

Responsibilities

  • Build routing intelligence for vllm-sr, including decision models, semantic and policy-based routing, semantic caching, and routing for safety, privacy, tools, and agents.
  • Develop production deployment and operations integrations with vLLM, Kubernetes, Envoy, Gateway API, and AI gateways.
  • Build a universal serving engine for decision models using the System One API across AMD Instinct GPUs and CPUs.
  • Optimize model inference for batching, memory, latency, and throughput, including GPU kernels in HIP or Triton on ROCm.
  • Train, post-train, evaluate, and improve foundation decision models and automate research experiments.
  • Co-design decision models with the serving engine and build benchmarks, evaluations, profiling, and cost and performance measurements.
  • Ship production-quality software with testing, CI, observability, and reliability practices.
  • Review and land open-source contributions, triage issues, ship releases, and help grow the vllm-sr community.
  • Represent AMD and vllm-sr through conferences, workshops, talks, demos, blogs, and documentation.
  • Collaborate with AMD ROCm, kernel, AI framework, Enterprise, and IT teams to validate and deploy vllm-sr.

Requirements

  • Strong Python programming skills and proficiency in at least one of Go, Rust, or C++.
  • Hands-on experience serving or training large language models, or building products on top of them, using technologies such as vLLM or SGLang.
  • Daily use of AI coding agents and agentic workflows with the judgment to verify and correct generated output.
  • End-to-end experience taking AI products from idea and design through deployment and operations.
  • Strong systems or machine learning fundamentals, or both.
  • Experience with GitHub workflows, public code review, and clear written English.
  • Experience with open-source projects such as vllm-sr, vLLM, SGLang, PyTorch, Hugging Face, Envoy, or Kubernetes is preferred.
  • GPU programming experience with HIP, CUDA, or Triton, or experience with ROCm on AMD Instinct GPUs, is preferred.
  • Experience with model routing, API gateways, LLM inference optimization, or training and post-training classifiers, reward models, or multimodal models is preferred.
  • Research experience in machine learning systems, distributed systems, or high-performance computing is a plus.
  • Papers at top machine learning or systems conferences, technical writing, public speaking, or community-building experience are preferred.
  • Bachelor’s or master’s degree in computer science, computer engineering, electrical engineering, or a related field, or equivalent experience.

Benefits

  • AMD benefits are referenced through the company’s “Benefits at a glance” information.

AMD

We care deeply about transforming lives with AMD technology to enrich our industry, our communities, and the world. Our mission is to build great products that accelerate next-generation computing experiences – the building blocks for the data center, artificial intelligence, PCs, gaming and embe...

Similar positions

Lead Data Engineer (P3999)

  • 84.51˚
  • Full time
  • USA
  • 11/18/2026
  • Salary: $125k - $207k/yr
  • Chicago, IL

Software Engineer, Datacenter Server Lifecycle

  • Anthropic
  • Full time
  • USA
  • 11/18/2026
  • Salary: $405k - $485k/yr
  • Remote

Embedded AI Builder

  • Coalition
  • Full time
  • USA
  • 11/18/2026
  • Salary: $138k - $190k/yr
  • Remote

Lead AI Engineer

  • ALO
  • Full time
  • USA
  • 11/18/2026
  • Salary: $180k - $220k/yr
  • Beverly Hills, CA

Staff Integration Engineer

  • Zscaler
  • Full time
  • Remote
  • 11/18/2026
  • India