Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Staff Software Engineer

Home > Golang programming jobs

Staff Software Engineer in USA new

  • Coupang
  • Full time
  • Email
  • Seattle, WA

Responsibilities

  • Architect and build an AI Inference Gateway platform for large-scale machine learning and generative AI workloads.
  • Design request routing, model endpoint abstraction, traffic shaping, load balancing, failover, caching, and policy enforcement mechanisms.
  • Develop infrastructure components in Go, Java, or Python across cloud and on-premise environments.
  • Build multi-tenant capabilities including authentication, authorization, quotas, cost attribution, rate limiting, and governance controls.
  • Partner with ML Platform, Model Serving, Data, and Product Engineering teams to operate AI workloads.
  • Lead architecture and design reviews, establish engineering standards, and mentor senior engineers.
  • Optimize inference latency, throughput, resiliency, and infrastructure efficiency.
  • Define observability standards and operate business-critical AI services using metrics, tracing, logging, and SLO-based operations.
  • Investigate production issues, conduct root-cause analysis, and implement long-term architectural improvements.

Requirements

  • 6+ years of professional software development experience.
  • 4+ years of experience designing and operating large-scale distributed systems in production.
  • Strong programming expertise in one or more of Go, Java, or Python.
  • Experience building highly available, mission-critical platform or infrastructure services.
  • Experience designing API platforms, service gateways, service meshes, or large-scale networking infrastructure.
  • Deep understanding of distributed systems, microservices architecture, and cloud-native technologies.
  • Production experience with Kubernetes and containerized workloads.
  • Experience operating services on AWS, Azure, or GCP.
  • Strong understanding of observability, reliability engineering, capacity planning, and production operations.
  • Preferred experience with AI/ML inference platforms, LLM gateways, model serving infrastructure, or GPU-accelerated workloads.
  • Preferred expertise with Kubernetes networking technologies, inference-serving frameworks, high-performance networking, traffic management, GenAI and LLM ecosystems, distributed data systems, and asynchronous programming.

Benefits

  • Medical, dental, vision, life, AD&D, disability, FSA, HSA, EAP, and 401(k) benefits.
  • 18–21 days of paid time off annually based on tenure and 12 public holidays.
  • Paid parental leave and pre-tax commuter benefits.
  • Free electric car charging station.
  • Base pay ranges from $152,000 to $261,000 per year depending on geographic market and job-related factors.

Salary: $152k - $261k/yr

Coupang

Coupang is a technology and Fortune 150 company listed on the New York Stock Exchange (NYSE: CPNG) that provides retail, restaurant delivery, video streaming, and fintech services to customers around the world under brands that include Coupang, Eats, Play, Rocket Now, and Farfetch.

Similar positions

Senior Software Engineer - Security Assurance

  • Grafana Labs
  • Full time
  • Remote
  • 11/22/2026
  • Salary: kr 775k-kr 931k
  • Sweden

Senior Software Engineer - Security Assurance

  • Grafana Labs
  • Full time
  • Remote
  • 11/22/2026
  • Salary: €83k-€100k
  • Spain

Senior Software Engineer - Security Assurance

  • Grafana Labs
  • Full time
  • Remote
  • 11/21/2026
  • Salary: €97k-€116k
  • Germany

Senior Network Platform Engineer (AWS)

  • Capgemini
  • Full time
  • Canada
  • 11/21/2026
  • Remote

Superintelligence (SI) Engineer, Supercomputing

  • SpaceX
  • Full time
  • USA
  • 11/21/2026
  • Salary: $135k - $235k/yr
  • Hawthorne, CA