Senior Software Engineer, Inference

Home > Other programming jobs

Senior Software Engineer, Inference in USA

AssemblyAI
Full time
Email

USA
09/02/2026
Report

New York, NY

Responsibilities

Design and ship customer-facing APIs for new model capabilities from prototype through launch and iteration.
Scale inference infrastructure for more than 1 million API users.
Productionize research techniques into reliable, low-latency, customer-ready systems.
Partner with researchers, Applied teams, and customers to guide product and research direction.
Contribute to backend services, inference infrastructure, SDKs, and internal tooling.

Requirements

Strong backend engineering experience building and supporting machine learning infrastructure and/or production customer-facing APIs.
Curiosity about AI/ML and sufficient understanding of model behavior to make sound engineering decisions.
Ability to operate effectively amid ambiguous and shifting research and product timelines.
Strong collaboration skills across research, applied engineering, and customer-facing stakeholders.

Benefits

U.S. salary range of $190,000–$225,000 base pay.
High-ownership, fast-moving environment at a small growth-stage AI company.
Equal-opportunity workplace with an emphasis on inclusion and diverse backgrounds.

Salary: $190k - $225k/yr

AssemblyAI

AssemblyAI is a Speech AI company that develops advanced artificial intelligence models for speech recognition and voice understanding. Its platform enables developers and businesses to transform spoken language into actionable insights, helping them build intelligent applications powered by voic...

Similar positions

Senior Test Automation Engineer

City of New York
Full time

USA
09/13/2026

Brooklyn, NY

Backend Engineer, Security Platform

Vannevar
Full time

USA
09/13/2026
Salary: $150k - $215k/yr

Remote

Senior DevOps Engineer, Infrastructure & Reliabili

Worth AI
Full time

USA
09/13/2026

Remote

Software Development Engineer II

Amazon
Full time

Canada
09/13/2026

Toronto

Software Engineer Leader

Entefy
Full time

USA
09/13/2026

Remote