Your browser does not support javascript! Please enable it, otherwise web will not work for you.

IT Engineer, Internal AI Infrastructure

Home > Other programming jobs

IT Engineer, Internal AI Infrastructure in USA

  • San Francisco, CA

Responsibilities

  • Design and build the hosting golden path for internal AI applications, bots, and agents, including long-running workflows, scheduled jobs, and agent execution.
  • Build model routing across frontier and lower-cost models based on cost, capability, and policy with a complete audit trail.
  • Develop observability, usage analytics, audit logging, and per-team cost attribution for company-wide AI workloads.
  • Integrate identity, access, and security patterns for internal AI applications and sensitive-data workflows.
  • Partner with product AI infrastructure teams to share gateways and telemetry and avoid duplicate systems.
  • Help shape platform strategy, roadmap, and engineering best practices as a founding member of the infrastructure pillar.

Requirements

  • 5+ years of software engineering experience, including significant infrastructure, platform, or backend engineering experience.
  • Track record of building internal platforms or paved paths adopted by other engineers and teams.
  • Strong system design skills and experience architecting resilient, observable production systems.
  • Hands-on experience with LLM operations, such as model gateways or routing, agent runtimes, evals, or cost and usage instrumentation.
  • Experience with enterprise identity and access management, such as Okta, SSO, or secure service-to-service authentication.
  • Excellent communication and collaboration skills across security, IT, and business teams.
  • Preferred: experience building internal AI or developer platforms at comparable scale.
  • Preferred: familiarity with MCP, agent orchestration frameworks, or skill and plugin registry patterns.
  • Preferred: experience with SOX/ITGC audit and compliance programs or systems with audit requirements.
  • Preferred: experience as a first infrastructure hire on a small team and setting standards across a broad scope.

Benefits

  • Full-time role available remotely in the United States or from one of Figma’s US hubs.
  • Equity, health, dental, and vision coverage, retirement benefits with company contributions, parental leave, reproductive and family planning support, mental health and wellness benefits, and paid time off.
  • Paid sick leave, holidays, and other legally required leave benefits; eligible exempt employees receive flexible PTO and flexible paid sick leave.
  • Potential company recharge days, cell phone and home internet reimbursements, lifestyle spending accounts, and annual bonuses for eligible non-sales roles.
  • In-person onboarding is required, and cameras must remain on during video interviews.

Salary: $153k - $296k/yr

Figma

Figma is a company that offers a cloud-based design and prototyping tool for digital designers and teams to build together. In the design services industry, it allows multiple users to collaborate in real-time on designing interfaces, websites, applications, and other digital products.

Similar positions

Backend Engineer, Security Platform

  • Vannevar
  • Full time
  • USA
  • 09/13/2026
  • Salary: $150k - $215k/yr
  • Remote

Agentic Security Engineer

  • NXP Semiconductors
  • Full time
  • USA
  • 09/13/2026
  • Austin, TX

INFRASTRUCTURE AND PLATFORM ARCHITECT L2

  • Wipro
  • Full time
  • Others
  • 09/13/2026
  • Bengaluru, India

Sr Application Security Engineer

  • Henry Schein One
  • Full time
  • USA
  • 09/13/2026
  • Salary: $125k-$160k
  • Remote

Senior DevOps Engineer, Infrastructure & Reliabili

  • Worth AI
  • Full time
  • USA
  • 09/13/2026
  • Remote

Listings

by


Job Type

Language

Country

CodingJobBoard.com © 2026