onsite
Hadoop Platform Support Engineer - ICS Global Soft, Inc.
Software Engineer
Senior support engineer focused on maintaining and optimizing Hadoop Distributed File System environments, ensuring high availability, performance, and reliability using Linux, YARN, and Python scripting.
About the role
Key Responsibilities
- Provide L3 support for Hadoop clusters, diagnosing and resolving HDFS, YARN, and related component issues.
- Monitor cluster health, performance metrics, and capacity planning to maintain optimal throughput.
- Implement and maintain automation scripts in Python for routine maintenance, backups, and alerts.
- Collaborate with data engineering and DevOps teams to troubleshoot data pipelines and ensure data integrity.
- Document troubleshooting procedures, create knowledge base articles, and conduct knowledge transfer sessions.
Requirements
- 5+ years of experience supporting Hadoop ecosystems (HDFS, YARN, MapReduce).
- Strong Linux system administration skills and shell scripting proficiency.
- Hands‑on experience with Python for automation and monitoring.
- Excellent problem‑solving skills and ability to work under pressure.
- Effective communication skills for cross‑team collaboration.