Senior Software Development Engineer, AWS Mantle - Amazon Web Services

Key Responsibilities

• Design, develop, and operate distributed systems that deliver ML inference for generative AI models at petabyte‑scale traffic.
• Collaborate with cross‑functional teams to define architecture, performance goals, and reliability targets for the inference engine.
• Implement fault‑tolerant, low‑latency services using AWS infrastructure and best practices for scalability.
• Optimize code and data pipelines for high throughput, ensuring secure and compliant data handling.
• Mentor junior engineers, conduct code reviews, and drive continuous improvement of engineering processes.

Requirements

• 5+ years of software engineering experience in distributed systems and cloud platforms.
• Strong proficiency in Python and experience with C++ or Java for performance‑critical components.
• Hands‑on experience with AWS services (EC2, ECS, Lambda, S3, CloudWatch, etc.) and infrastructure‑as‑code tools.
• Deep understanding of ML inference pipelines, model serving, and generative AI workloads.
• Excellent problem‑solving skills, ability to work in a fast‑paced, high‑impact environment.