Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Sr Data Engineer

Home > Python programming jobs

Sr Data Engineer in Remote new

  • Capgemini
  • Full time
  • Email
  • Mexico

Responsibilities

  • Build and optimize Spark pipelines on Microsoft Fabric or Databricks.
  • Diagnose performance using Spark UI and Delta statistics.
  • Manage Delta Lake design, Fabric capacity consumption, compute sizing, throttling exposure, and operational reliability.
  • Create reusable Python libraries and Spark modules for ingestion, governance, security, monitoring, and optimization.
  • Optimize Delta Lake using partitioning, liquid clustering, Z-Order, OPTIMIZE, VACUUM, and MERGE strategies.
  • Design, optimize, and troubleshoot large-scale data pipelines.
  • Develop reliable production-grade data solutions with testing, logging, monitoring, and documentation.

Requirements

  • At least 5 years of experience as a data engineer, ETL engineer, or in a similar role.
  • Strong production experience with Microsoft Fabric or Databricks, including performance tuning and operational support.
  • Experience troubleshooting Apache Spark issues such as skew, spills, out-of-memory errors, task execution problems, and query optimization.
  • Hands-on experience optimizing Delta Lake with partitioning, liquid clustering, Z-Order, OPTIMIZE, VACUUM, and MERGE.
  • Strong SQL and data engineering skills for large-scale data pipelines.
  • Python development experience and the ability to build reliable production-grade data solutions.
  • Fluent English level.

Benefits

  • Work on meaningful technology projects that solve real-world challenges.
  • Join a company focused on sustainability, inclusion, and digital equity.
  • Contribute to initiatives aimed at improving outcomes for people, planet, and society.
  • This role can be performed from any state in Mexico.

Capgemini

Capgemini is an AI-powered global business and technology transformation partner, delivering tangible business value. We imagine the future of organizations and make it real with AI, technology and people. With our strong heritage of nearly 60 years, we are a responsible and diverse group of 420,...

Similar positions

Lead Data Engineer (P3999)

  • 84.51˚
  • Full time
  • USA
  • 11/18/2026
  • Salary: $125k - $207k/yr
  • Chicago, IL

Software Engineer, Datacenter Server Lifecycle

  • Anthropic
  • Full time
  • USA
  • 11/18/2026
  • Salary: $405k - $485k/yr
  • Remote

Lead AI Engineer

  • ALO
  • Full time
  • USA
  • 11/18/2026
  • Salary: $180k - $220k/yr
  • Beverly Hills, CA

Staff Integration Engineer

  • Zscaler
  • Full time
  • Remote
  • 11/18/2026
  • India

Enterprise Security Engineer (Okta / Identity)

  • Socure
  • Full time
  • USA
  • 11/18/2026
  • Salary: $165k - $230k/yr
  • New York, NY