onsite
Hadoop Developer - Bright Vision Technologies
Software Engineer
Seeking an experienced Hadoop Developer to design, develop, and maintain large-scale data pipelines using Hadoop ecosystem tools such as Java, MapReduce, Hive, Spark, HDFS, and YARN.
About the role
Key Responsibilities
- Design, develop, and optimize Hadoop-based data processing solutions using Java, MapReduce, and Spark.
- Build and maintain Hive data warehouses, including schema design, ETL jobs, and performance tuning.
- Implement and manage HDFS and YARN configurations to ensure high availability and scalability.
- Collaborate with data scientists and analysts to translate business requirements into efficient data pipelines.
- Monitor, troubleshoot, and improve job performance, ensuring reliability and cost-effectiveness.
Requirements
- 3+ years of hands‑on experience with Hadoop ecosystem components.
- Strong proficiency in Java and experience with MapReduce, Spark, and Hive.
- Deep understanding of HDFS, YARN, and cluster administration.
- Experience with data modeling, ETL processes, and performance optimization.
- Excellent problem‑solving skills and ability to work in a fast‑paced environment.