Efficacy Research and Psychometrics Analyst

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Efficacy Research and Psychometrics Analyst, Khan Kids (24 months fixed-term) based in United States.

• Serve as the primary technical point of contact for external psychometric research partners, supporting study design, data sharing, analysis, and interpretation.
• Extract, clean, validate, and securely share assessment data with research partners on recurring schedules.
• Analyze psychometric findings, including item difficulty, score distributions, growth analyses, concurrent validity, and Item Response Theory (IRT)-based scoring.
• Translate research findings into actionable product improvements, including potential changes to scoring models and assessment discontinuation rules.
• Collaborate with research partners to develop technical documentation, including technical manuals for assessments.
• Recruit and onboard school and district research sites, execute MOUs, align on consent and participant incentive procedures, and coordinate site visits for direct child assessment data collection.
• Partner with legal and external organizations to develop and negotiate data-sharing agreements involving pseudonymized and identified data.
• Coordinate participation in ongoing efficacy studies and contribute to the design and planning of future research initiatives.
• Own and maintain the product KPI dashboard in partnership with engineering, including integrations with App Store Connect and Google Play Console.
• Ensure analytics dashboards remain useful for marketing, school partnerships, philanthropy, and other internal teams.
• Lead recurring app performance reporting, including monthly and quarterly business reviews and periodic target-setting activities.
• Respond to ad hoc data requests by developing SQL queries and analyses to support initiatives such as district outreach and grant reporting.
• Coordinate multiple external partners, recurring deliverables, data-sharing schedules, and research activities while maintaining strong attention to detail.

• Advanced degree, such as a PhD or Master’s, in psychometrics, educational measurement, quantitative methods, or a related discipline, or equivalent applied experience.
• Strong knowledge of psychometric methods, including item analysis, reliability and validity evidence, growth modeling, and Item Response Theory (IRT).
• Proficiency with SQL and a statistical programming language such as R or Python for data extraction, cleaning, analysis, and visualization.
• Experience with, or willingness to learn, business intelligence tools such as Looker, along with experience building dashboards and data pipelines.
• Familiarity with responsible data-sharing practices in education research, including student privacy considerations such as FERPA and COPPA and the use of pseudonymized or deidentified data.
• Strong ability to communicate complex quantitative and psychometric findings clearly to technical and non-technical audiences, including product teams, funders, and school partners.
• Excellent project management and organizational skills, with the ability to coordinate external partners, research activities, recurring deliverables, and multiple priorities.
• Strong analytical thinking, attention to detail, and commitment to data quality and research rigor.
• Demonstrated cross-cultural competency, self-awareness, and ability to contribute to inclusive and collaborative working environments.
• Ability to translate research evidence into practical recommendations that influence product or program decisions.
• Strong interest in using data, research, and technology to improve learning outcomes for young children.
• Experience with early childhood education or assessment of young learners is a plus.
• Experience designing quasi-experimental studies in school or program settings is advantageous.
• Experience with Spanish-language assessment or dual-language learner measurement is a plus.

• $137,871–$155,105 USD annual compensation range for candidates based in the United States.
• $186,306–$209,595 CAD annual compensation range for candidates based in Canada.
• Competitive total rewards package, with compensation based on relevant skills, experience, qualifications, internal equity, and market data.
• Remote-first culture with flexibility designed to accommodate different time zones.
• Generous paid time off and 8 pre-scheduled Wellness Days in 2026.
• Generous parental leave.
• 401(k) plan with 4% employer matching.
• Comprehensive medical, dental, vision, and life insurance.
• Opportunities to participate in affinity, ally, and social groups.
• Wellness and professional growth and development programs.
• Opportunity to contribute quantitative and research expertise to high-impact education products used by children, families, and educators.
• Collaboration with interdisciplinary teams spanning research.