onsite
Software Development Engineer II - AWS Data Processing and Analytics - Amazon
Software Engineer
Senior engineer building a next‑generation serverless analytics platform on AWS, executing Apache Spark and Python workloads with ultra‑low latency at massive scale.
About the role
Key Responsibilities
- Design, develop, and maintain scalable serverless services that run Apache Spark, Python, and other runtime engines on AWS.
- Optimize data pipelines for low‑latency, high‑throughput analytics workloads across petabyte‑scale datasets.
- Collaborate with product and backend teams to define feature requirements and deliver production‑ready solutions.
- Implement automated testing, CI/CD, and monitoring to ensure reliability and performance.
- Mentor junior engineers and contribute to architectural best practices for cloud‑native data platforms.
Requirements
- 5+ years of software engineering experience in large‑scale data processing environments.
- Proficiency in Python and experience with Apache Spark or similar distributed computing frameworks.
- Strong background in AWS services (Lambda, S3, Glue, EMR, Kinesis, Athena).
- Hands‑on experience building serverless architectures and optimizing for latency and cost.
- Excellent problem‑solving skills and a passion for delivering high‑quality, production‑grade code.
Skills
pythonapache sparkawsanalytics