remote
Principal Software Development Engineer - AWS Mantle - Amazon Web Services
Software Engineer
Lead the design and delivery of a high‑performance, globally distributed ML inference platform on AWS, driving architectural vision, scalability, and security for millions of Bedrock customers.
About the role
Key Responsibilities
- Architect and implement large‑scale, distributed inference services that support millions of Bedrock users.
- Define long‑term technical direction for the Mantle platform, balancing performance, reliability, and security.
- Collaborate with cross‑functional teams to integrate new foundation models and optimize inference pipelines.
- Mentor senior engineers, fostering a culture of technical excellence and continuous improvement.
- Drive innovation in distributed computing, model serving, and secure data handling at scale.
Requirements
- 10+ years of software engineering experience, with a proven track record in large‑scale distributed systems.
- Deep expertise in AWS services, ML inference, and performance optimization.
- Strong background in security best practices for cloud‑native applications.
- Proficiency in Python and C++ for high‑performance backend development.
- Excellent communication skills and ability to influence technical strategy across teams.
Skills
awsmachine learningpythonc