Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Principal Data Engineer - AI

Home > Python programming jobs

Principal Data Engineer - AI in USA

  • Anaplan
  • Full time
  • Email
  • Remote

Responsibilities

  • Lead data architecture, design, and deployment of scalable, high-throughput Big Data systems in production.
  • Architect, deploy, and manage vector, NoSQL, and document database systems supporting AI infrastructure.
  • Develop end-to-end ETL/ELT pipelines, API services, and data ingestion frameworks.
  • Design storage and processing layers for data lakes, data warehouses, distributed file systems, and real-time streaming architectures.
  • Build feature-rich context pipelines using batch and streaming processing patterns.
  • Optimize large distributed queries and data transformations for high performance and low latency.
  • Implement data quality frameworks supporting data integrity, reliability, and governance.
  • Collaborate with analytics, product, and platform teams to build data models representing customer metrics, hierarchies, and relationships.
  • Evaluate modern data-stack tools, distributed computing frameworks, and database technologies.
  • Lead technical projects and mentor engineering teams.

Requirements

  • Extensive hands-on data engineering experience delivering in complex data environments.
  • Deep practical understanding of vector databases, NoSQL databases, and document stores used in AI and machine learning infrastructure.
  • Experience building, scaling, and shipping large-scale data platforms in production.
  • Deep experience with Apache Spark, Flink, or Hadoop.
  • Strong expertise with message brokers and event streaming platforms such as Apache Kafka and Kinesis.
  • Extensive experience with workflow orchestration tools such as Apache Airflow and Dagster.
  • Expertise with cloud data warehouses such as Snowflake, BigQuery, and Redshift.
  • Experience with data lake architectures and technologies such as Databricks, Delta Lake, and Apache Iceberg.
  • Advanced SQL skills and proficiency in Python.
  • Strong background in software development practices including testing, code review, CI/CD, and Infrastructure as Code.
  • Desirable experience with cloud-native infrastructure on AWS, GCP, or Azure.
  • Desirable experience implementing data observability, monitoring, and alerting frameworks at scale.
  • Familiarity with Anaplan or similar enterprise planning platforms.

Benefits

  • The role is open to candidates located in the Eastern or Central time zones.
  • Employees within commuting distance of an Anaplan office are expected to work onsite two days per week under a hybrid work model.
  • Anaplan provides reasonable accommodation for individuals with disabilities during the application, interview, and employment process.

Anaplan

Anaplan builds a cloud platform for enterprise planning, forecasting, and scenario modeling used by finance, supply chain, sales, and workforce teams. It sells subscription software and related services to large organizations that need connected, cross-functional planning. Founded in 2006 and hea...

Similar positions

Core Services Data Operations

  • FICO
  • Full time
  • Remote
  • 10/15/2026
  • Salary: Competitive
  • Mexico

Staff Machine Learning Engineer

  • Altana
  • Full time
  • USA
  • 10/15/2026
  • Salary: $205k - $240k/yr
  • Boston, MA

Security Platform Automation Engineer

  • Apple
  • Full time
  • USA
  • 10/15/2026
  • Seattle, WA

Analytics Engineer

  • Reddit
  • Full time
  • USA
  • 10/15/2026
  • Salary: $164k-$230k
  • Remote

Senior AI Engineer

  • Infiterra S.A
  • Full time
  • Remote
  • 10/15/2026
  • Greece, UK