onsite
Software Development Engineer, Advanced Analytics - Amazon
Software Engineer
Lead the design and implementation of petabyte‑scale analytics pipelines on AWS, processing log‑level advertising data to unlock insights into auction dynamics, revenue opportunities, and supply chain integrity.
About the role
Key Responsibilities
- Design, build, and maintain scalable data pipelines ingesting petabyte‑scale log data using AWS services (S3, Glue, Redshift, Athena) and Apache Spark.
- Develop and optimize SQL queries and Spark jobs to extract actionable insights for programmatic advertising partners.
- Collaborate with data scientists and product teams to translate business requirements into robust analytics solutions.
- Ensure data quality, lineage, and security across the analytics stack.
- Continuously improve performance, cost efficiency, and reliability of the analytics infrastructure.
Requirements
- 5+ years of experience in large‑scale data engineering and analytics.
- Proficiency in Python, SQL, and Spark for data processing.
- Deep knowledge of AWS data services (S3, Glue, Redshift, Athena, EMR).
- Strong problem‑solving skills and ability to work in a fast‑paced environment.
- Excellent communication skills and a collaborative mindset.
Skills
pythonawsapache sparksql