LLM Platform Engineer

Home > Python programming jobs

LLM Platform Engineer in USA new

AllSpice
Full time
Email

USA
10/14/2026
Report

Boston, MA

Responsibilities

Partner with engineers and product managers to identify workflow bottlenecks, prioritize problems, and own solutions from requirements and architecture through rollout and iteration.
Own evaluation and observability systems for AI products, including automated and human review, regression detection, and comparisons across models, prompts, and pipelines.
Build internal applications and self-service tools for inspecting AI results, investigating failures, and collecting feedback, with potential customer-facing extensions.
Build scripts, data pipelines, integrations, and automations connecting internal systems, third-party services, LLMs, and Model Context Protocol tools.
Create unified analytics layers from evaluation results, customer feedback, and telemetry while maintaining data quality and schema evolution.
Design RAG-based information repositories and tooling for component data and domain knowledge.
Integrate AI insights with CI/CD workflows and help improve AI workflow reliability, cost, latency, and cache effectiveness.
Document technical findings, communicate with technical and non-technical audiences, mentor teammates, and champion code quality, testing, and reliability.

Requirements

4+ years of software engineering experience focused on tooling, data platforms, or full-stack web development, with senior-level ownership of dependable systems or products.
Strong SQL skills and experience designing data pipelines and storage schemas, managing data quality and schema evolution, and using analytics tools.
Proficiency in Python scripting and automation for data pipelines, integrations, and internal tools.
Experience building web applications or customer-facing tools with modern frameworks such as Vue, React, or TypeScript.
Practical experience shipping or maintaining LLM-enabled systems, including evaluation pipelines, observability, or integrations, with awareness of non-determinism and cost, latency, quality, and reliability tradeoffs.
Bachelor’s degree or higher in a technology-related field, or equivalent practical experience.
Strong communication, customer focus, project management, stakeholder collaboration, autonomy, and comfort with ambiguity.
Preferred familiarity with business analytics and data visualization tools, LLM evaluation frameworks, GitHub Actions, monitoring and observability tools, and common web architectures and APIs.

Benefits

Flexible work with preferred availability for hybrid work from the San Francisco or Boston flex offices 2–3 times per week.
Competitive salary and equity, health, dental, and vision benefits, generous PTO, and a home office stipend.
Supportive colleagues, flexible work, and the opportunity to make a significant impact.

Salary: $160k - $190k/yr

AllSpice

AllSpice is the collaboration platform for modern hardware teams. We bring software-style workflows to electronics development, so schematics, reviews, and decisions are easy to share, track, and scale. DRCY is our AI design review agent. It runs automated, auditable first-pass checks directly in...

Similar positions

Staff Machine Learning Engineer

Altana
Full time

USA
10/15/2026
Salary: $205k - $240k/yr

Boston, MA

Security Platform Automation Engineer

Apple
Full time

USA
10/15/2026

Seattle, WA

Analytics Engineer

Reddit
Full time

USA
10/15/2026
Salary: $164k-$230k

Remote

Senior AI Engineer

Infiterra S.A
Full time

Remote
10/15/2026

Greece, UK

Security Operations Engineer (SecOps)

Collibra
Full time

USA
10/15/2026
Salary: $116k - $145k/yr

Remote