onsite
Distinguished Engineer Apache Spark - 2100 NVIDIA USA
Software Engineer
Lead architect and senior engineer driving large‑scale Apache Spark solutions, leveraging Scala, Java, and C++ to design and optimize high‑performance big data pipelines and systems.
About the role
Key Responsibilities
- Design, develop, and maintain enterprise‑grade Apache Spark applications using Scala, Java, and C++.
- Architect scalable, fault‑tolerant data pipelines and real‑time processing workflows.
- Lead technical direction, mentor engineering teams, and set coding standards.
- Collaborate with data scientists and product managers to translate business requirements into robust data solutions.
- Optimize performance, memory usage, and resource allocation across distributed clusters.
Requirements
- 10+ years of experience in big data engineering and distributed systems.
- Deep expertise in Apache Spark, Scala, Java, and C++.
- Proven track record of leading architecture design and delivering production‑grade solutions.
- Strong understanding of cluster management, performance tuning, and data governance.
- Excellent communication skills and ability to mentor junior engineers.
Skills
apache sparkscalajavac