Research Engineer, Gemini Large Scale Pretraining, DeepMind

Minimum qualifications:

• Bachelor's degree in Computer Science, or a related technical field, or equivalent practical experience.
• 2 years of experience with software engineering involving Python-based ML/scientific libraries such as JAX or internship experience in these areas or Open Source Software (OSS) contributions.
• 1 year of experience with machine learning.

Preferred qualifications:

• Experience with large-scale system design, distributed systems, or performance engineering.
• A good understanding of engineering best practices, codebase design, and testing.
• Familiarity with how modern large language models are trained.
• Ability to collaborate with, and communicate effectively with, people with different skill sets and needs, and who may be distributed across different time zones.

Responsibilities

• Work on long term projects to enable new research, which involve multiple team members and require good software engineering and design.
• Respond to time-sensitive issues arising in large-scale training runs, and in ongoing research.
• Make systematic improvements to technical workflows and tooling used across pretraining.
• Apply engineering expertise to help researchers navigate technical challenges. This requires both a deep understanding of the codebase and a broad understanding of the tech stack, the model architecture and data pipeline.
• Develop the right balance between good engineering practices and having a flexible codebase which researchers find easy to use and extend.