Head of Evals
Trajectory Labs, PBC
- Location
- Remote (US)
- Type
- Full-time
- Compensation
- $275,000 – $400,000 per year
- Posted
- Sep 17, 2026
Last seen in the source feed: Oct 10, 2026.
Source listings can change. Check the employer's page for current availability and application requirements.
Job description
Lead AI safety evaluations for frontier models, ensuring red-teaming data quality and building evals that measure model safety.
- Review red-teaming tasks and transcripts to maintain quality standards; automate judgment patterns into agent skills and pipeline automation.
- Design new evaluations to test model robustness, identify failure modes, and communicate safety findings to frontier labs.
- Set evaluation strategy and prioritize which safety tests Trajectory should build next to scale data collection and model assessment.
- Requires 2+ years software engineering experience and demonstrated ability to use LLMs and coding agents to automate workflows independently.
- Desirable: experience building evals, benchmarks, grading pipelines, or familiarity with prompt injection, red teaming, or AI safety research.
About Trajectory Labs, PBC
WebsiteTrajectory Labs is a startup that builds RL environments for frontier AI labs to train robust, secure, and reliable models.
Share
Tweet Share WhatsApp Email FacebookCover letter and interview prep
Draft a cover letter for this role or practise the questions you are likely to be asked.
Open application toolsWant more roles like this?
Describe what you want and get your strongest matching jobs by email.
Find matching jobsRelated searches
Head of Evals
Trajectory Labs, PBC