Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Senior Software Engineer, Data Platform

Home > Python programming jobs

Senior Software Engineer, Data Platform in USA

  • San Francisco, CA

Responsibilities

  • Architect and build scalable, reliable data platform infrastructure for analytics, machine learning, and operational intelligence.
  • Develop high-performance data processing frameworks and storage solutions for AI infrastructure and cloud operations.
  • Implement data validation, monitoring, and observability systems for data integrity and platform reliability.
  • Collaborate with software engineers, data scientists, and operations teams to translate requirements into data infrastructure.
  • Establish data engineering best practices, contribute to architecture decisions, and mentor team members.
  • Drive projects independently from conception through production with minimal supervision.

Requirements

  • Bachelor’s degree or foreign equivalent in Computer Science, Data Engineering, Information Systems, or a closely related technical field.
  • At least 5 years of progressive, post-baccalaureate experience in software engineering, data infrastructure engineering, or a related role.
  • Proficiency in Python and at least one systems-level language, with Go preferred and Java, C, or C++ also valued.
  • Deep experience designing and building data warehouses, data lakes, streaming systems, and ETL/ELT frameworks.
  • Understanding of distributed computing principles and experience building reliably scalable systems.
  • Advanced SQL skills for data modeling, query optimization, and database design.
  • Familiarity with CI/CD, containerization, and infrastructure automation.
  • Experience with Google Cloud Platform data services, including BigQuery, Dataflow, Pub/Sub, and Cloud Storage, is a bonus.
  • Experience with Apache Beam, AI/ML or cloud infrastructure workloads, growing data teams, orchestration tools such as Airflow, Dagster, or Prefect, and real-time streaming architectures is preferred.
  • Strong ownership, autonomy, communication, and collaboration skills.

Benefits

  • Competitive compensation of $170,000–$205,000 plus bonus and Restricted Stock Units.
  • Paid time off and paid holidays.
  • Comprehensive health, dental, and vision insurance.
  • Employer HSA contributions.
  • Paid parental leave.
  • Paid life insurance and short- and long-term disability coverage.
  • Professional development and tuition reimbursement.
  • Mental health and wellness support.
  • Commuter benefits for parking and transit.
  • Cell phone stipend.
  • 401(k) retirement plan with company match up to 4% of salary.
  • Volunteer time off.
  • Full-time, strictly on-site work in Sunnyvale, California, or San Francisco, California; remote work is not eligible.

Salary: $170k - $205k/yr

Crusoe

As the AI factory company, Crusoe is on a mission to accelerate the abundance of energy and intelligence. The company provides a reliable, scalable, cost-effective, and energy-first solution for AI infrastructure. By harnessing large-scale energy resources, building AI-optimized data centers, and...

Similar positions

Software Engineer in Test

  • Roadie
  • Full time
  • USA
  • 09/13/2026
  • Salary: Competitive
  • Remote

Principal Software Engineer - Builder Experience

  • Elastic
  • Full time
  • Remote
  • 09/13/2026
  • Salary: €73k-€116k
  • Greece

Principal Software Engineer - Builder Experience

  • Elastic
  • Full time
  • Remote
  • 09/13/2026
  • Salary: zł 369k-zł 584k
  • Poland

Senior Devops Engineer

  • Woliba
  • Full time
  • USA
  • 09/13/2026
  • Remote

Senior Core Infrastructure Engineer

  • Oracle
  • Full time
  • USA
  • 09/13/2026
  • Salary: Competitive
  • Nashville, TN