How to apply for Senior Advisor, Advanced Guardrails for AI-Induced Incidents

About Institute for Security and Technology

The Institute for Security and Technology (IST) is a nonpartisan, nonprofit network based in the San Francisco Bay Area that tackles critical international security challenges by bridging technology and policy. Unlike traditional think tanks, IST convenes diverse stakeholders—from AI labs to government agencies—to develop actionable solutions for emerging threats. Working here means shaping global AI safety policy at a time when it's most needed.

About the role

As Senior Advisor for Advanced Guardrails for AI-Induced Incidents, you'll lead research and strategy on preventing and mitigating high-consequence AI incidents, including loss-of-control scenarios. You'll assess technical and governance safeguards, identify gaps, and translate findings into policy recommendations. This role is pivotal in ensuring that advanced AI systems are developed and deployed safely, directly impacting international security.

A typical day

A typical day might involve researching emerging AI risks, drafting a policy brief on loss-of-control safeguards, and meeting with technical experts and policymakers to refine recommendations. You could also be planning a workshop or convening stakeholders to discuss incident preparedness. Expect a mix of deep analytical work and interactive sessions, all aimed at turning research into real-world impact.

Who Institute for Security and Technology is looking for

• Deep technical understanding of AI systems, including emerging capabilities, risks, and failure modes such as loss of control.
• Experience in AI safety, security, or incident response, with a track record of developing or evaluating guardrails and contingency plans.
• Strong policy acumen: ability to translate complex technical concepts into actionable governance measures and engage with policymakers.
• Proven ability to convene and facilitate expert discussions, workshops, and multi-stakeholder initiatives.

Tips for this application

• Highlight any experience you have with AI incident response, red teaming, or loss-of-control scenario planning—IST is looking for concrete examples, not just general AI knowledge.
• Demonstrate familiarity with IST's existing work, such as their AI safety and security projects, and reference them in your application to show alignment.
• Emphasize your ability to bridge technical and policy domains; IST values candidates who can speak both languages fluently.
• Showcase any experience convening experts or leading workshops, as this role involves significant stakeholder engagement.
• If you have published research or reports on AI risks, include links or summaries to showcase your thought leadership.

What to cover in your cover letter

Your cover letter should emphasize: (1) your specific expertise in AI loss-of-control scenarios and guardrails, (2) your ability to translate technical research into policy recommendations, (3) any experience you have with incident preparedness or contingency planning, and (4) your alignment with IST's mission and collaborative approach.

Research before applying

• Read IST's reports and initiatives on AI safety and security, especially any work related to AI incidents or guardrails.
• Understand IST's nonpartisan, network-based approach and how they collaborate with government, industry, and academia.
• Research recent AI incidents or near-misses to speak knowledgeably about current challenges.
• Look into IST's key partners and funders to understand their sphere of influence and current priorities.

Likely interview topics

Based on the job description, expect questions about:

• How would you approach developing guardrails for AI systems that could potentially cause high-consequence incidents?
• Can you describe a time when you identified a critical gap in AI safeguards and recommended a solution?
• What do you see as the most pressing AI-induced incident risks in the next 3-5 years?
• How would you convene and facilitate a workshop with diverse stakeholders to address AI loss-of-control scenarios?
• How do you balance technical feasibility with policy needs when recommending governance measures?

Common mistakes to avoid

• Being too theoretical without practical experience in AI safety or incident response—IST values actionable solutions.
• Ignoring the policy translation aspect; candidates who focus solely on technical details may miss the mark.
• Failing to demonstrate collaborative skills; IST is a network-based organization, so solo expertise isn't enough.