Staff Inference Engineer

Home > Other programming jobs

Staff Inference Engineer in USA

Designworks Talent
Full time
Email

USA
10/08/2026
Report

Bellevue, WA

Responsibilities

Build and operate production-grade model-serving and inference systems for high-throughput, low-latency AI workloads.
Optimize inference infrastructure for token throughput, latency, scalability, GPU utilization, reliability, and cost efficiency.
Improve the scalability and operational maturity of the inference platform as customer demand grows.
Partner with AI training, GPU performance, orchestration, infrastructure, and operations teams to transition models into production serving.
Develop monitoring, alerting, and operational practices and resolve performance, reliability, and capacity issues.
Contribute to architecture decisions and engineering standards for the evolving platform.

Requirements

Experience building and operating production machine learning inference or model-serving systems at scale.
Strong understanding of latency, throughput, memory utilization, and cost-efficiency trade-offs when serving large AI models.
Experience designing reliable distributed systems or production infrastructure.
Understanding of GPU-backed AI workloads and inference-system scaling challenges.
Strong engineering fundamentals and ability to independently own complex technical problems.
Experience with inference-serving frameworks such as vLLM, SGLang, TensorRT-LLM, Triton Inference Server, or similar technologies is preferred.
Experience optimizing LLM inference workloads or large-scale AI serving platforms is preferred.
Experience with API-based AI products, high-volume production services, GPU scheduling, distributed systems, Kubernetes, or cloud infrastructure platforms is preferred.
Familiarity with quantization, batching, caching, or performance tuning is preferred.
Experience at a hyperscaler, AI lab, GPU cloud provider, or large-scale ML infrastructure organization is preferred.

Benefits

Hybrid role in Bellevue, Washington, with approximately three days per week in the office.
Candidates elsewhere in the U.S. may apply if open to relocation.
Medical, dental, and vision insurance for U.S.-based employees.
401(k) plan with company match and paid holidays.
Certain roles may receive merit increases, annual bonuses, and long-term incentives.
U.S. work authorization is required; visa sponsorship is not currently available.

Designworks Talent

Designworks Talent specializes in the design and delivery of enterprise workforce solutions including strategy, talent acquisition, engagement, and succession planning. We work collaboratively with business leaders and enterprise Talent Acquisition and Human Resources teams to deliver custom work...

Similar positions

DevSecOps Engineer

Blueprint Technologies
Full time

USA
10/15/2026
Salary: $95k - $105k/yr

Remote

Product Security Engineer

Base Power Company
Full time

USA
10/15/2026

Austin, TX

(Junior) DevOps Engineer Voice

Koninklijke KPN N.V.
Full time

Others
10/15/2026
Salary: DOE

Rotterdam, Netherlands

Full-Stack Engineer - Studio

ElevenLabs
Full time

Remote
10/15/2026

Worldwide

Software Engineer

Asana
Full time

USA
10/15/2026
Salary: $171k - $190k/yr

San Francisco, CA