Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Java Scala Developer Apache Spark

Home > Java programming jobs

Java Scala Developer Apache Spark in Others new

  • Pune, India

Responsibilities

  • Design, implement, and maintain scalable batch and streaming data pipelines using Apache Spark, Java/Scala, and PySpark.
  • Develop high-level and low-level designs, data-flow diagrams, interface specifications, and data-modeling artifacts.
  • Perform data sourcing, cleansing, enrichment, reconciliation, schema evolution, transformation, quality validation, and analytical insight generation.
  • Write and optimize complex Spark SQL queries, joins, window functions, partitioned datasets, and transformations for large enterprise datasets.
  • Build enterprise services and data-ingestion microservices using Spring and Spring Boot.
  • Implement automated build, test, and deployment workflows using Git, GitHub, Jenkins/Lightspeed, and Harness.
  • Use GitHub Copilot and Devin AI for prototyping, code review, test generation, refactoring, and documentation.
  • Collaborate with product owners, data analysts, business teams, and quality assurance to deliver solutions.
  • Identify vulnerabilities and security issues, conduct testing and debugging, and resolve application and data-processing issues.
  • Advise or coach new or lower-level analysts and operate with limited direct supervision.

Requirements

  • Bachelor’s degree or university degree, or equivalent experience.
  • At least 5 years of hands-on software and data engineering experience is listed, with 7+ years expected; the stated experience range is 5–9 years.
  • Advanced proficiency in Java and/or Scala and strong object-oriented and functional programming skills.
  • Deep practical expertise in Apache Spark architecture, including RDDs, DataFrames, Datasets, execution plans, memory management, partitioning, and performance tuning.
  • Strong Python and practical PySpark experience for data transformations.
  • Expert SQL and Spark SQL skills, including window functions, complex joins, indexing, and query-plan analysis with EXPLAIN.
  • Experience creating maintainable HLD and LLD documents, technical specifications, data-flow diagrams, and data-modeling artifacts.
  • Hands-on experience with GitHub or Bitbucket, Jenkins/Lightspeed, and Harness.
  • Experience using AI development tools such as GitHub Copilot or Devin AI.
  • Experience with automated unit and integration testing, TDD, SonarQube quality gates, and secure coding standards.
  • Strong communication, analytical reasoning, ownership, and problem-solving skills.
  • Tableau or similar BI visualization experience is preferred; banking, financial services, liquidity reporting, regulatory data, or risk-management experience is also preferred.

Benefits

  • Full-time position.
  • Equal opportunity employer with reasonable accommodation support available.

Citi

Citi is a public financial-services company offering consumer and institutional banking, credit cards, wealth management, treasury and trade solutions, and capital-markets services. It serves individuals, corporations, financial institutions, and governments in more than 160 countries and jurisdi...

Similar positions

Bigdata Spark Developer

  • Citi
  • Full time
  • Others
  • 10/16/2026
  • Pune, India

Senior Java Full Stack Developer

  • Cognizant
  • Full time
  • Canada
  • 10/16/2026
  • Salary: $60k - $96k/yr
  • Toronto

Senior Software Developer Engineer in

  • MiQ Digital
  • Full time
  • Others
  • 10/15/2026
  • Bengaluru, India

Senior Java Engineer - Distributed Systems

  • Elastic
  • Full time
  • Remote
  • 10/15/2026
  • Salary: €86k-€136k
  • Ireland

Senior Java Engineer - Security - Elasticsearch

  • Elastic
  • Full time
  • Remote
  • 10/15/2026
  • Salary: zł 308k-zł 487k
  • Poland