remote

Spark Scala Developer - Tata Consultancy Services (TCS)

Software Engineer

Develop and maintain high‑performance data pipelines using Apache Spark and Scala, integrating with Hadoop ecosystems and cloud services to deliver scalable analytics solutions.

About the role

Key Responsibilities

Design, develop, and optimize large‑scale data processing pipelines using Apache Spark and Scala.
Integrate Spark jobs with Hadoop ecosystem components such as HDFS, Hive, and YARN.
Implement real‑time data streaming solutions with Kafka and Spark Structured Streaming.
Collaborate with data engineers and analysts to translate business requirements into efficient data models.
Deploy and monitor Spark applications on cloud platforms (e.g., AWS EMR) ensuring reliability and performance.
Conduct code reviews, unit testing, and performance tuning to maintain code quality.

Requirements

Strong proficiency in Scala and Java programming languages.
Hands‑on experience with Apache Spark (core, SQL, Streaming) in production environments.
Familiarity with Hadoop ecosystem tools such as HDFS, Hive, and YARN.
Experience building data pipelines using Kafka or similar messaging systems.
Knowledge of cloud services (AWS) and containerization/orchestration (Docker, Kubernetes) is a plus.

Skills

apache sparkscalajavahadoopkafkaaws

CompanyTata Consultancy Services (TCS)

DepartmentEngineering

LocationON, California, United States

Experience3+ years

Tenurefull-time

LevelMid-Level

Salary120,000

Posted June 26, 2026