Head of Evals

Trajectory Labs, PBC

Location
Remote (US)
Type
Full-time
Compensation
$275,000 – $400,000 per year
Posted
Sep 17, 2026

Last seen in the source feed: Oct 10, 2026.

Source listings can change. Check the employer's page for current availability and application requirements.

Job description

Lead AI safety evaluations for frontier models, ensuring red-teaming data quality and building evals that measure model safety.
- Review red-teaming tasks and transcripts to maintain quality standards; automate judgment patterns into agent skills and pipeline automation.
- Design new evaluations to test model robustness, identify failure modes, and communicate safety findings to frontier labs.
- Set evaluation strategy and prioritize which safety tests Trajectory should build next to scale data collection and model assessment.
- Requires 2+ years software engineering experience and demonstrated ability to use LLMs and coding agents to automate workflows independently.
- Desirable: experience building evals, benchmarks, grading pipelines, or familiarity with prompt injection, red teaming, or AI safety research.

About Trajectory Labs, PBC

Website

Trajectory Labs is a startup that builds RL environments for frontier AI labs to train robust, secure, and reliable models.

Share

Tweet Share WhatsApp Email Facebook

Cover letter and interview prep

Draft a cover letter for this role or practise the questions you are likely to be asked.

Open application tools

Want more roles like this?

Describe what you want and get your strongest matching jobs by email.

Find matching jobs

Related searches

Head of Evals

Trajectory Labs, PBC

Apply on company site