Senior Software Engineer, Data Infrastructure

Home > Other programming jobs

Senior Software Engineer, Data Infrastructure in USA

Decagon
Full time
Email

USA
08/26/2026
Report

San Francisco, CA

Responsibilities

Design and implement high-throughput data pipelines and streaming systems with strong SLOs, runbooks, and actionable telemetry.
Build and operate real-time and batch ingestion infrastructure using Kafka, Flink, and Airflow.
Own the analytical data layer, including schema design, query performance, and cost optimization across ClickHouse, BigQuery, or similar systems.
Partner with research and product teams to architect data solutions, evaluate performance, and scale new features.
Optimize data paths, caching, partitioning, pipeline latency, and query latency to meet tight p95/p99 targets.
Lead Terraform infrastructure-as-code and GitOps practices, including reusable modules and policy-as-code.
Participate in on-call and reduce operational toil through automation and elimination of recurring data issues.

Requirements

5+ years of experience building and operating production data infrastructure at scale.
Hands-on experience with Tier 1 data technologies including ClickHouse, Kafka or MSK/Pub-Sub/RabbitMQ, and Flink or dbt.
Proven ability to meet high-availability and low-latency targets across streaming and batch workloads.
Strong experience with OpenTelemetry, Prometheus/Grafana, or Datadog and disciplined incident response.
Clear written communication and the ability to turn ambiguous data requirements into simple, reliable designs.
Preferred: experience with Debezium and orchestration frameworks such as Airflow, Dagster, or Prefect.
Preferred: familiarity with Spark or Dask for large-scale data processing.
Preferred: experience with Snowflake, BigQuery, Redshift, or Databricks.
Preferred: experience as an early data, platform, or infrastructure engineer.
Preferred: strong Kubernetes experience with GKE, EKS, or AKS and exposure to GCP, AWS, and Azure.
Preferred: experience with customer-managed deployments.

Benefits

Medical, dental, vision, life insurance, disability, retirement, parental leave, and fertility and family-building benefits are offered to full-time employees.
Monthly wellness and lifestyle stipend, daily office lunches and snacks, and a take-what-you-need vacation policy are provided.
The role is in-office; benefits vary by location, and UK employees receive 25 days of statutory leave.

Salary: $200k - $400k/yr

Decagon

Decagon is the leading conversational AI platform empowering every brand to deliver concierge customer experiences. Our technology enables industry-defining enterprises like Avis Budget Group, Chime, Oura Health, 1-800-FLOWERS.COM, and Hunter Douglas to deploy AI agents that power personalized, d...

Similar positions

Copy of Senior Lua Developer

Lifted, an Upwork Company™
Contract

Remote
10/30/2026

Indonesia

Backend Engineer, Profile & Community

Airbnb
Full time

USA
10/30/2026
Salary: $162k-$186k

Remote

Software Engineer, Infranomics

OpenAI
Full time

USA
10/30/2026
Salary: $385k - $445k/yr

San Francisco, CA

Staff+ Software Engineer, Enterprise Connectivity

Anthropic
Full time

USA
10/30/2026
Salary: $405k - $485k/yr

San Francisco, CA

Intern - Software Engineer, Audio (NTD)

Nintendo
Full time

USA
10/30/2026
Salary: $45 - $45/yr

Redmond, WA