Model Engineer, Multimodal Understanding

Home > Python programming jobs

Model Engineer, Multimodal Understanding in USA new

xAI
Full time
Email

USA
11/06/2026
Report

Palo Alto, CA

Responsibilities

Design, build, and optimize distributed systems for multimodal pre-training, post-training, inference, data processing, and tokenization at web and petabyte scale.
Develop high-throughput pipelines for multimodal data acquisition, preprocessing, filtering, generation, decoding, loading, crawling, visualization, and management.
Advance multimodal understanding and generation, including spatial-temporal compression, cross-modal alignment, world modeling, reasoning, real-time video processing, and noisy-data handling.
Drive human and synthetic data curation, filtering, quality analysis, and scalable data pipelines for large models.
Create evaluation frameworks, benchmarks, reward models, and metrics for real-world usage, failure modes, interactive dynamics, and human-AI collaboration.
Innovate on algorithms, modeling, hardware/software/algorithm co-design, and scaling approaches.
Build research tooling, interfaces, prototypes, demos, full-stack applications, and real-time interactive experiences.
Work across pre-training, supervised fine-tuning, reinforcement learning, and post-training to enable reasoning, tool calling, agentic behavior, orchestration, and real-time interaction.

Requirements

Production-quality coding experience in Python, PyTorch, JAX, Rust, or C++.
Expert-level Python proficiency and strong experience with at least one of JAX, PyTorch, or XLA.
Experience building or optimizing large-scale distributed ML systems, including training or inference optimization, GPU utilization, multi-GPU or TPU setups, and hardware co-design.
Deep experience designing and operating large-scale data pipelines for curation, filtering, generation, and quality studies involving noisy, real-world multimodal data.
Strong fundamentals in evaluation design, benchmarking, reward modeling, or reinforcement learning, especially for interactive or agentic behaviors.
Experience leading major model-capability improvements through data, modeling, algorithms, or scaling.
Familiarity with multimodal LLMs, scaling laws, tokenizers, compression techniques, reasoning, or agentic systems.
Proficiency in Rust and/or C++ for performance-critical components.
Hands-on experience with large-scale orchestration tools such as Spark, Ray, or Kubernetes.
Experience building full-stack tooling, performant interfaces, real-time research demos or applications, or end-to-end products.
Passion for interactive, real-time multimodal AI systems and willingness to own end-to-end initiatives in a high-intensity environment.

Benefits

$160,000–$250,000 base salary.
Equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short- and long-term disability insurance, life insurance, discounts, and other perks.

Salary: $160k - $250k/yr

xAI

xAI builds advanced AI systems designed to deeply understand the universe and support humanity's quest for knowledge. Targeting innovators and thinkers, our platform emphasizes engineering excellence and hands-on collaboration, fostering an environment where curiosity drives results.

Similar positions

Senior Attack Engineer, Kubernetes

Horizon3 AI
Full time

USA
11/07/2026
Salary: $206k - $243k/yr

Remote

Senior Attack Engineer, OCI

Horizon3 AI
Full time

USA
11/06/2026
Salary: $206k - $243k/yr

Remote

Staff Software Engineer, Fullstack

Affirm
Full time

Remote
11/06/2026
Salary: $129k-$172k

Canada

Staff Backend Engineer, Internal

Horizon3 AI
Full time

USA
11/06/2026
Salary: $229k - $270k/yr

Remote

Software Engineer, Cloud Infrastructure

Verkada
Full time

USA
11/06/2026

San Mateo, CA