Application Guide

How to Apply for Contractor, Senior Technical Advisor, AI Capability Assessment

at Institute for Security and Technology

🏢 About Institute for Security and Technology

The Institute for Security and Technology (IST) is a nonpartisan, nonprofit network based in the San Francisco Bay Area dedicated to solving critical international security challenges through better technology and policy. They uniquely bridge the gap between technical experts and policymakers, making them a key player in shaping AI governance.

About This Role

As a Senior Technical Advisor for AI Capability Assessment, you will be at the forefront of developing technical evaluations and testing methodologies to assess frontier AI capabilities, particularly around recursive self-improvement. Your work will directly inform policy decisions and interventions for frontier labs and policymakers, making a tangible impact on AI safety and governance.

💡 A Day in the Life

A typical day might involve collaborating with a small team of technical experts to define sub-capabilities for recursive self-improvement, then designing testing methodologies to assess those capabilities in frontier models. You might also spend time reviewing proposed policy interventions, validating their technical robustness, and preparing briefs for policymakers. Remote work means you'll have flexibility, but also regular virtual meetings to coordinate with your team and external partners.

🎯 Who Institute for Security and Technology Is Looking For

  • Deep expertise in AI/ML with a strong background in evaluating or testing large language models or frontier AI systems.
  • Experience in developing or applying evaluation protocols, benchmarks, or red-teaming methodologies.
  • Familiarity with the concept of recursive self-improvement and AI capability thresholds, possibly from research or policy work.
  • Ability to translate technical findings into clear, actionable recommendations for non-technical policymakers.

📝 Tips for Applying to Institute for Security and Technology

1

Highlight specific examples of AI capability assessments you've designed or conducted, including metrics and outcomes.

2

Show your understanding of the AI governance landscape by mentioning recent policy discussions or papers from IST or similar organizations.

3

Tailor your resume to emphasize your experience with frontier AI systems (e.g., GPT-4, Claude, Gemini) and any work on recursive self-improvement or AI safety.

4

In your cover letter, connect your technical expertise to the mission of IST, showing you're not just a technologist but also committed to policy impact.

5

If possible, get a referral from someone in the AI safety or governance community who can vouch for your technical and policy acumen.

✉️ What to Emphasize in Your Cover Letter

["Explain why you're passionate about AI governance and how your technical skills can help bridge the gap between AI development and policy.", 'Provide specific examples of your work in AI capability assessment, such as designing benchmarks or uncovering vulnerabilities in frontier models.', "Demonstrate your understanding of the role's focus on recursive self-improvement and how you would approach defining sub-capabilities.", 'Emphasize your ability to collaborate with both technical teams and policymakers, as IST values interdisciplinary work.']

Generate Cover Letter →

🔍 Research Before Applying

To stand out, make sure you've researched:

  • Read IST's recent reports and publications, especially those related to AI governance and capability assessments.
  • Familiarize yourself with the company's mission and network, including their partnerships with other organizations in the AI safety space.
  • Look into the backgrounds of the team members, especially those in technical roles, to understand their approach and priorities.
  • Review the latest academic and industry discussions on recursive self-improvement and AI capability thresholds, such as papers from leading AI labs.
Visit Institute for Security and Technology's Website →

💬 Prepare for These Interview Topics

Based on this role, you may be asked about:

1 How would you design an evaluation protocol to assess a frontier model's capability for recursive self-improvement?
2 Describe a time you identified a sub-capability that was overlooked in AI evaluation. How did you validate it?
3 How do you stay current with the latest developments in frontier AI and their implications for safety?
4 How would you explain a technical evaluation result to a policymaker without a technical background?
5 What is your experience with red-teaming or adversarial testing of AI systems? Provide an example.
Practice Interview Questions →

⚠️ Common Mistakes to Avoid

  • Don't focus solely on your technical skills without showing an understanding of the policy implications of your work.
  • Avoid generic statements about AI safety; be specific about your experience and how it relates to the role's responsibilities.
  • Don't neglect to mention your ability to work remotely and communicate effectively across distributed teams, as the role is remote.

📅 Application Timeline

This position is open until filled. However, we recommend applying as soon as possible as roles at mission-driven organizations tend to fill quickly.

Typical hiring timeline:

1

Application Review

1-2 weeks

2

Initial Screening

Phone call or written assessment

3

Interviews

1-2 rounds, usually virtual

Offer

Congratulations!

Ready to Apply?

Good luck with your application to Institute for Security and Technology!