Research Scientist, Frontier Model Evaluation

About the Role

We are seeking a Research Scientist, Frontier Model Evaluation to join our team. In this role, you will be instrumental in advancing our understanding of frontier model capabilities and propensities, and in developing new methodologies to assess and mitigate risks associated with these models.

Responsibilities

• Identify the biggest limitations to current understanding of frontier model capabilities and propensities.
• Generate and rapidly derisk new methodologies and frameworks that can move the field forward.
• Ensure these are externally valid, connecting with our threat models and helping us better predict risk.
• Publish these as useful artifacts (datasets, environments, papers, model organisms) that the field can build on.
• Streamline methodologies for use in evaluation sprints or live dashboards.