remote
Senior Software Development Engineer, AWS Elastic MapReduce EMR - Amazon.com
Software Engineer
Senior Software Development Engineer focused on AWS Elastic MapReduce, building and optimizing large‑scale distributed data processing pipelines using Spark, Hadoop, and related frameworks.
About the role
Key Responsibilities
- Design, develop, and maintain high‑performance, fault‑tolerant data processing services on AWS EMR.
- Integrate Spark, Hadoop, Presto, and Flink workloads with S3, DynamoDB, and other AWS data stores.
- Collaborate with cross‑functional teams to define architecture, performance benchmarks, and cost‑optimization strategies.
- Implement automated testing, CI/CD pipelines, and monitoring for distributed workloads.
- Provide technical mentorship and code reviews for junior engineers.
Requirements
- 5+ years of software engineering experience in distributed data processing.
- Proficiency in Python, Java, or Scala with deep knowledge of Spark and Hadoop ecosystems.
- Hands‑on experience with AWS services (EMR, S3, DynamoDB, EC2, CloudWatch).
- Strong understanding of distributed systems concepts, performance tuning, and cost optimization.
- Excellent communication skills and a collaborative mindset.
Skills
awsapache sparkhadooppythonjava