Senior Data Platform Engineer

Home > Python programming jobs

Senior Data Platform Engineer in USA new

Komodo Health
Full time
Email

USA
10/24/2026
Report

San Francisco, CA

Responsibilities

Build, operate, and optimize large-scale batch pipelines using Python, SQL, Spark, Airflow, and AWS.
Make data storage and layout decisions involving table formats, partitioning, file sizing, and compaction.
Ingest data from external sources and maintain pipeline correctness through frequent schema changes.
Transform healthcare claims, EHR, and reference data into trusted, serving-ready data products.
Improve data quality, validation, lineage, observability, alerting, reliability, performance, and cost efficiency.
Debug complex data, system, and performance issues across compute-heavy workflows.
Contribute to system design, code quality, testing, documentation, CI/CD, and rotational production support.
Partner with Data Product and Engineering teams and provide mentorship through design reviews and engineering best practices.
Use AI-assisted engineering tools for coding, debugging, documentation, test creation, technical exploration, and architectural analysis.

Requirements

Strong hands-on experience building, owning, and debugging production data pipelines at multi-terabyte scale.
Advanced Python skills, including performant and memory-efficient large-scale data processing, and strong SQL skills.
Deep production experience operating and scaling Airflow, not only writing DAGs.
Understanding of physical data storage, including columnar and row formats and open table formats such as Iceberg, Delta Lake, or Hudi.
Experience with Spark or a comparable distributed processing framework.
Proven experience designing and operating data systems in AWS.
Strong data correctness, root-cause analysis, and production troubleshooting skills.
Ability to communicate technical trade-offs with engineering, product, and data partners.
Preferred experience with Docker, Kubernetes, data governance, data lineage, external-facing data products, APIs, serving layers, customer access patterns, AI or agentic workflows, and high-growth or ambiguous environments.
Healthcare experience is not required.

Benefits

Annual base pay is $196,000–$230,000 in the San Francisco Bay Area and New York City, or $170,000–$200,000 in other US locations.
Benefits include comprehensive health, dental, and vision insurance, flexible time off and holidays, 401(k) with company match, disability insurance, life insurance, and applicable leaves of absence.
Open to US remote work or hybrid work in San Francisco or New York City; Komodo also has hubs in Chicago.
The role may be eligible for performance-based bonuses and equity awards.
Komodo uses a hybrid work model with intentional in-office rhythms for hub-based employees.

Salary: $170k - $230k/yr

Komodo Health

Komodo Health builds a healthcare data platform and analytics applications, anchored by its Healthcare Map of de-identified U.S. patient journeys. Life sciences companies, payers, providers, and public health teams use its SaaS tools and services to study treatment patterns, size markets, and ide...

Similar positions

Backend Engineer (Europe)

Kalepa
Full time

Remote
10/26/2026
Salary: $80k-$105k

Europe

Sr. AI/ML Engineer II

MetroStar
Full time

USA
10/26/2026
Salary: $200k - $240k/yr

Reston, VA

Staff Security Engineer

Quince
Full time

Others
10/26/2026

Bengaluru, India

ChatGPT Performance Engineer

OpenAI
Full time

USA
10/26/2026
Salary: $325k-$405k

Remote

Junior Backend Engineer (Europe)

Kalepa
Full time

Remote
10/25/2026
Salary: $60k-$70k

Europe