Research Engineer, Frontier Safety Risk Assessment

Core responsibilities:

• Design, implement, and empirically validate approaches to assessing and managing catastrophic risk from current and future frontier AI systems
• Identify new risk pathways within current areas (loss of control, ML R&D, cyber, CBRN, harmful manipulation) or in new ones
• Conceive of, design, and develop new ways to measure pre-mitigation and post-mitigation risk
• Forecast and scenario plan for future risks which are not yet material

This role contributes to identifying, assessing, and mitigating potential catastrophic risks from current and future AI systems, ensuring safety and ethics remain the highest priority in AI development.

Required skills and experience:

• Extensive research experience with deep learning and/or foundation models (e.g., PhD in machine learning)
• Adept at generating ideas and designing experiments, and implementing these in Python with real AI systems
• Keen to address risks from foundation models and have thought about how to do so
• Strong, clear communication skills with confidence engaging technical stakeholders

Benefits include: enhanced maternity, paternity, adoption, and shared parental leave; private medical and dental insurance for yourself and any dependents; flexible working options; healthy food; on-site gym; faith rooms; terraces; relocation support and immigration services; salary range of $136,000 - $245,000 + bonus + equity + benefits.