onsite
Big Data Engineer II - MetLife
Data Engineer
Senior Big Data Engineer responsible for designing, building, and maintaining production‑grade data pipelines and analytics solutions using Spark, Hadoop, and AWS services.
About the role
Key Responsibilities
- Design, develop, and optimize large‑scale data pipelines using Spark and Hadoop ecosystems.
- Implement robust ETL processes and data quality checks to support analytics and reporting.
- Leverage AWS services (S3, EMR, Glue, Redshift) for scalable data storage and processing.
- Collaborate with data scientists and business stakeholders to translate requirements into technical solutions.
- Monitor, troubleshoot, and tune performance of data workloads in production environments.
Requirements
- 5–8+ years of experience in big data engineering and analytics.
- Strong proficiency in SQL, Python, and Scala for data processing.
- Hands‑on experience with Spark, Hadoop, and related ecosystem tools.
- Deep understanding of AWS data services and cloud architecture.
- Excellent problem‑solving skills and ability to work independently.