onsite
Hadoop Platform Support Engineer - CogniSoft Technologies
Software Engineer
Senior support engineer responsible for L3 troubleshooting, maintenance, and performance tuning of Hadoop ecosystems on GCP, ensuring high availability, data integrity, and efficient data ingestion for analytics teams.
About the role
Key Responsibilities
- Provide L3 support for Hadoop platform, diagnosing and resolving complex issues to maintain high availability and performance.
- Manage and maintain HDFS, ensuring data integrity, security, and efficient storage utilization.
- Collaborate with data scientists and analysts to understand data requirements and optimize data pipelines.
- Implement and monitor data ingestion processes, ensuring smooth flow from diverse sources into the Hadoop ecosystem.
- Leverage Google Cloud Platform services to enhance scalability, reliability, and cost-efficiency of the Hadoop deployment.
Requirements
- Proven experience with Hadoop, HDFS, and related ecosystem components.
- Strong knowledge of GCP services such as BigQuery, Cloud Storage, and Dataflow.
- Hands‑on skills in performance tuning, troubleshooting, and automation of Hadoop workloads.
- Excellent communication and collaboration abilities with cross‑functional teams.
- Experience with data pipeline design and data ingestion best practices.