How to apply for Project Manager, Pilot Audits

About AI Verification and Evaluation Research Institute

The AI Verification and Evaluation Research Institute (AVERI) is a nonprofit dedicated to establishing third-party auditing as a standard practice for frontier AI systems. Working here means contributing to a mission that prioritizes global safety and security in AI development, with a collaborative, mission-driven culture that values rigor and innovation.

About the role

As Project Manager for Pilot Audits, you will lead the execution of pilot audits that validate and refine auditing methodologies, directly shaping the emerging discipline of frontier AI auditing. This role is impactful because it sets the standards and tools that will be used to evaluate the most powerful AI systems, influencing industry practices and policy.

A typical day

You'll start your day by checking in with your remote team across time zones, then dive into refining audit frameworks based on feedback from ongoing pilots. Afternoons might involve stakeholder meetings to align on standards, followed by deep work on developing assessment tools or reviewing audit results to iterate on best practices.

Who AI Verification and Evaluation Research Institute is looking for

• Proven experience in project management, ideally in AI, tech, or research environments, with a track record of delivering complex, cross-functional projects.
• Deep understanding of AI concepts and the ability to translate technical details into audit frameworks and methodologies.
• Strong leadership and team coordination skills, with experience guiding diverse teams (engineers, researchers, policy experts) toward common goals.
• Excellent communication skills to articulate audit findings and standards to both technical and non-technical stakeholders.

Tips for this application

• Highlight any experience you have with AI safety, auditing, or standards development, even if tangential, to show your commitment to the field.
• In your resume, quantify the impact of projects you've led (e.g., 'led a team of 10 to deliver a risk assessment framework adopted by 3 organizations').
• Tailor your cover letter to reference AVERI's mission and recent publications or blog posts to show you've done your homework.
• Since it's remote, emphasize your experience with distributed teams and your ability to manage projects asynchronously.
• If you have a portfolio or case studies of past projects, include links to demonstrate your project management approach and outcomes.

What to cover in your cover letter

['Express genuine passion for AI safety and the importance of third-party auditing in mitigating risks.', "Detail your project management methodology and how you've successfully led projects from conception to completion.", "Show how your background aligns with the role's focus on defining methodologies and developing standards.", 'Mention specific ideas you have for approaching pilot audits or improving existing frameworks to demonstrate proactive thinking.']

Research before applying

• Read AVERI's website thoroughly, especially their mission statement, ongoing projects, and any public reports or publications.
• Look up recent news or articles about AI auditing standards (e.g., from NIST, EU AI Act) to understand the regulatory landscape.
• Familiarize yourself with key concepts in AI safety, such as red-teaming, model evaluation, and interpretability.
• Check if any AVERI team members have given talks or interviews; watch them to understand their perspectives.

Likely interview topics

Based on the job description, expect questions about:

• How would you approach defining a methodology for auditing a frontier AI system when no established standards exist?
• Describe a time you led a cross-functional team through ambiguity. How did you keep everyone aligned?
• What are the key challenges in conducting a pilot audit of a frontier AI model, and how would you address them?
• How do you balance the need for rigorous, detailed audits with the speed required in a fast-paced environment?
• How do you handle disagreements among team members about audit criteria or findings?

Common mistakes to avoid

• Don't submit a generic cover letter that doesn't mention AI or the specific mission of AVERI.
• Avoid focusing solely on your project management skills without connecting them to the AI context.
• Don't overlook the importance of the nonprofit's mission; make sure you demonstrate genuine interest in AI safety, not just the project management aspect.