Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Senior Software Engineer, Data Platform

Home > Python programming jobs

Senior Software Engineer, Data Platform in USA

  • San Francisco, CA

Responsibilities

  • Own the data platform architecture and technical direction, including reusable frameworks and build-versus-buy decisions.
  • Build and operate ingestion across streaming, batch, CDC, and third-party connectors with safe schema evolution.
  • Land data in Snowflake with reliable freshness, completeness, and cost characteristics and define handoffs to Analytics Engineering.
  • Own orchestration capabilities including scheduling, retries, backfills, and dependency management.
  • Build transformation, compute, stream-processing, and self-serve pipeline frameworks for product engineers, data engineers, and analysts.
  • Develop data quality, observability, lineage, cataloging, discovery, alerting, and anomaly-detection capabilities.
  • Create tooling for PII classification, masking, retention, access control, and multi-region data residency.
  • Set technical standards through design reviews, documentation, and mentorship while helping build the data platform team.

Requirements

  • 5+ years of experience building and operating production data infrastructure that other teams depend on.
  • Deep experience with cloud data warehouses, especially Snowflake, including performance tuning and cost management.
  • Hands-on experience building CDC and streaming pipelines with technologies such as Kafka, Debezium, Flink, or Spark Streaming.
  • Experience with managed ingestion tools such as Fivetran or Airbyte and sound build-versus-buy judgment.
  • Strong experience operating workflow orchestration platforms such as Temporal, Airflow, or Dagster at scale.
  • Strong Python programming skills and advanced SQL proficiency.
  • Experience building frameworks or internal tools used by other engineers.
  • Practical experience with data quality, observability, lineage, and schema evolution for high-availability systems.
  • Working knowledge of data governance in regulated environments, including PII classification, masking, access control, retention, and data residency.
  • Familiarity with Azure, AWS, GCP, Kubernetes, and infrastructure-as-code tools such as Terraform or Pulumi.
  • Preferred: experience with dbt, lakehouse architectures, Iceberg, Delta Lake, Trino, multi-tenant secure platforms, AI-product data infrastructure, or early/founding data platform roles.

Benefits

  • The role is based in San Francisco, CA or New York, NY.
  • The position offers the opportunity to be an early hire on the central data platform team and help shape its technical direction and team.
  • Compensation is listed separately as a base salary range of $193,400–$290,000 USD.

Salary: $193k - $290k/yr

Harvey

Harvey is domain-specific AI for legal and professional services. Adopted by Fortune 500 companies like AT&T, Verizon, Cox, Koch, KKR, Bridgewater, more than 100,000 lawyers across 2,400+ customers in 70 countries and over 75% of AmLaw 100 law firms rely on Harvey to advance legal expertise faste...

Similar positions

Software Engineer in Test

  • Roadie
  • Full time
  • USA
  • 09/13/2026
  • Salary: Competitive
  • Remote

Principal Software Engineer - Builder Experience

  • Elastic
  • Full time
  • Remote
  • 09/13/2026
  • Salary: €73k-€116k
  • Greece

Principal Software Engineer - Builder Experience

  • Elastic
  • Full time
  • Remote
  • 09/13/2026
  • Salary: zł 369k-zł 584k
  • Poland

Senior Devops Engineer

  • Woliba
  • Full time
  • USA
  • 09/13/2026
  • Remote

Senior Core Infrastructure Engineer

  • Oracle
  • Full time
  • USA
  • 09/13/2026
  • Salary: Competitive
  • Nashville, TN