Minimum qualifications:
- Bachelor’s degree or equivalent practical experience.
- 8 years of experience in software development.
- 5 years of experience testing, and launching software products, and 3 years of experience with software design and architecture.
- 5 years of experience with ML design and ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).
- Experience integrating generative AI tools or LLM interfaces into workflows.
- Experience with Kubernetes, C++, Go programming.
Preferred qualifications:
- Master’s degree or PhD in Engineering, Computer Science, or a related technical field.
- 8 years of experience with data structures and algorithms.
- 5 years of experience with software development in Go, Python or Java programming languages.
- 3 years of experience in a technical leadership role leading project teams and setting technical direction.
- 3 years of experience with distributed system design of infrastructure software.
- Experience testing, maintaining, or launching software products, and with software design and architecture.
Responsibilities
- Build infrastructure for model creators to be able to generate business with their models.
- Build a platform for partners to manage their services on Vertex.
- Work with sister teams to bring optimized models and serving techniques (e.g. prefix caching, cache-aware routing, etc.).
- Build infrastructure for efficiently onboarding open and closed source models to Google Cloud.
Scale and maintain existing Model-as-a-service deployments.