How to apply for Senior Efficacy Research and Psychometrics Analyst, Khan Kids (24 months fixed-term)

About Khanacademy

Khan Academy is a nonprofit with the mission to deliver a free, world-class education to anyone, anywhere. It reaches over 181 million registered learners globally, with a focus on historically under-resourced communities. Working here means contributing to a meaningful social mission while collaborating with a passionate, mission-driven team.

About the role

As a Senior Efficacy Research and Psychometrics Analyst for Khan Kids (a free learning program for children ages 2–8), you will design and lead research studies to measure the efficacy of early literacy, math, and executive function activities. You will apply psychometric methods to ensure the reliability and validity of assessments and learning outcomes. This 24-month fixed-term role is critical for demonstrating impact and informing product improvements to better serve young learners.

A typical day

A typical day might involve analyzing assessment data using IRT models, collaborating with product managers to integrate research findings into new features, and writing reports to communicate efficacy results to internal teams and external partners. You might also meet with educators or conduct literature reviews to inform study designs. The role is remote, so you'll coordinate with colleagues across time zones and balance independent work with virtual meetings.

Who Khanacademy is looking for

• Advanced degree (PhD or Master's) in Educational Psychology, Psychometrics, Statistics, or a related field, with 3+ years of applied research experience.
• Proven expertise in psychometric analysis, including item response theory (IRT), classical test theory, and reliability/validity testing.
• Experience designing and conducting efficacy research studies, preferably in early childhood education or edtech, with strong quantitative data analysis skills (R, Python, or similar).
• Ability to translate complex research findings into actionable insights for product teams, educators, and stakeholders, and a passion for improving early learning outcomes.

Tips for this application

• Highlight specific psychometric methods you've used (e.g., IRT, factor analysis, differential item functioning) and how they improved educational assessments or products.
• Demonstrate experience with early childhood education research or child development; mention any work with children ages 2–8 or early literacy/math assessments.
• Showcase your ability to manage research projects end-to-end, from design to analysis to reporting, and include examples of how your findings influenced decisions.
• Emphasize your alignment with Khan Academy's nonprofit mission and your interest in making education accessible to under-resourced communities.
• Since this is a fixed-term role, express your enthusiasm for the project-based nature and your ability to deliver results within a defined timeline.

What to cover in your cover letter

In your cover letter, focus on: (1) your psychometric expertise and how you've applied it to educational assessments, (2) your experience in early childhood education research, (3) your ability to communicate complex findings to non-technical audiences, and (4) your motivation to contribute to Khan Academy's mission and specifically to Khan Kids' goal of improving early learning outcomes.

Research before applying

• Explore Khan Academy Kids' app and website to understand its content, features, and target age group (2–8).
• Read Khan Academy's annual reports or blog posts about their efficacy research and impact studies to understand their approach to measuring learning outcomes.
• Familiarize yourself with early childhood education standards (e.g., Common Core, Head Start Early Learning Outcomes Framework) and common assessments used in early literacy and math.
• Research Khan Academy's nonprofit model and funding sources to understand how efficacy research supports their mission and sustainability.

Likely interview topics

Based on the job description, expect questions about:

• How would you design an efficacy study to evaluate the impact of Khan Kids on early literacy skills? Walk us through your approach.
• Describe a time when you used psychometric analysis to improve an assessment. What methods did you use, and what was the outcome?
• How do you ensure that assessments are fair and unbiased for diverse populations, especially young children from under-resourced communities?
• Can you explain a complex psychometric concept (e.g., IRT) to a non-technical stakeholder? Provide an example.
• Why are you interested in working at a nonprofit like Khan Academy, and how do you see this role contributing to our mission?

Common mistakes to avoid

• Avoid focusing only on technical psychometric skills without connecting them to educational impact and the mission of Khan Academy.
• Do not neglect to mention experience with early childhood populations; this role specifically targets ages 2–8, so generic research experience is not enough.
• Avoid using jargon without explaining it; Khan Academy values clear communication to diverse stakeholders, so show you can translate complex ideas.