Principal Software Engineer, Orchestration

Home > Python programming jobs

Principal Software Engineer, Orchestration in USA

Roblox
Full time
Email

USA
10/21/2026
Report

San Mateo, CA

Responsibilities

Own the multi-year architecture and strategy for Apache Airflow and Roblox’s data orchestration platform.
Scale and harden schedulers, metadata databases, executors, and DAG parsing for thousands of daily workflows.
Design and operate AWS EKS clusters for orchestration and Spark workloads, including autoscaling, resource isolation, cost efficiency, and deployment automation.
Build APIs, custom operators and providers, libraries, and self-service tooling for internal data engineers.
Establish SLOs, alerting, diagnostics, incident reviews, and root-cause fixes for platform and pipeline reliability.
Lead technical alignment across data platform, governance, data science, and product engineering teams.
Set engineering standards and mentor staff, senior, and mid-level engineers.

Requirements

Bachelor’s degree in computer science or equivalent experience.
10+ years of experience designing, building, and operating large-scale production distributed systems.
Deep hands-on experience designing, operating, and scaling a production workflow orchestrator or job scheduler, ideally Apache Airflow or an equivalent system.
Experience with scheduler and executor design, metadata-store performance, task isolation, retries, idempotency, upgrades, and migrations.
Production Kubernetes cluster management and scaling on AWS, including EKS, Helm, and Karpenter or Cluster Autoscaler.
Strong Python proficiency plus Go or Java experience, with a record of writing clean, tested platform and tooling code.
Working knowledge of Spark workloads running on Kubernetes, including Spark on Kubernetes, spark-operator, or EMR on EKS.
Experience building platforms for other engineers, including APIs, observability, reliability, and developer experience.
Track record of cross-organizational technical leadership and driving multi-quarter projects from concept through production.
Preferred qualifications include contributions to Apache Airflow or related open-source projects, experience with Dagster, Temporal, Argo Workflows, or Flyte, and experience with Terraform, Prometheus, OpenTelemetry, cost optimization, chargeback, or consumer-internet-scale infrastructure.

Benefits

Full-time employees are eligible for equity compensation and company benefits.
For San Mateo office-based roles, employees work onsite Tuesday, Wednesday, and Thursday, with optional presence Monday and Friday.
The listed annual base salary range for San Mateo roles is $295,250–$345,040 USD.

Salary: $295k - $345k/yr

Roblox

Roblox's vision is to reimagine the way people come together. Our mission is to connect a billion people with optimism and civility. What is Roblox? Roblox is a platform where people come together virtually to share experiences. Every day, tens of millions of people from around the world come to ...

Similar positions

Senior Software Engineer - Machine Learning

Anduril Industries
Full time

USA
10/25/2026
Salary: $190k - $252k/yr

Broomfield, CO

2027 Software Engineer

Point72
Full time

Others
10/25/2026

Bengaluru, India

Staff Software Engineer | AI

LawPay
Full time

Remote
10/25/2026
Salary: $150k-$190k

United States

Senior Mission Software Engineer

Varda Space Industries
Full time

USA
10/25/2026
Salary: $169k - $216k/yr

El Segundo, CA

Software Engineer, AI Integrations

Zyte
Full time

Remote
10/25/2026
Salary: Competitive

Poland