Senior Psychometrician for the Foundational Learning Study
Organizational Context
UNICEF works in over 190 countries and territories to save children’s lives, defend their rights, and help them fulfill their potential. At UNICEF, we are committed, passionate, and proud of what we do for as long as we are needed. Promoting the rights of every child is not just a job – it is a calling.
Job Purpose
The purpose of this consultancy is to provide senior psychometrician expertise to the National Assessment Wing (NAW) of the Pakistan Institute of Education (PIE) for the Foundational Learning Study (FLS)-2026. This role is critical for the psychometric analysis, scaling, and national reporting of Pakistan's first nationally representative assessment of Grade 3 literacy and numeracy. The consultant will ensure the data collected is converted into credible, internationally comparable national evidence, aligning with the Global Proficiency Framework (GPF) and Minimum Proficiency Levels (MPLs) to support SDG indicator 4.1.1 reporting. The consultancy will address technically critical activities that were not covered by the initial World Bank/DARE-funded technical assistance, ensuring the study's findings are robust and actionable for policy and practice.
Responsibilities
Conduct comprehensive psychometric analysis of the FLS-2026 dataset, including item response theory (IRT) modeling, scaling, and reliability analysis. Benchmark assessment results across the three languages of instruction (English, Urdu, Sindhi) to ensure comparability and validity. Extend large-scale administration to English-medium schools to ensure comprehensive coverage. Prepare detailed psychometric reports and documentation for national and international stakeholders. Develop and finalize the SDG indicator 4.1.1 reporting documentation based on the study's findings. Provide technical guidance and support to the NAW/PIE team on psychometric methodologies and best practices. Ensure the quality and integrity of the data analysis and reporting processes. Collaborate with relevant stakeholders, including the Ministry of Federal Education and Professional Training and the World Bank, to disseminate findings and recommendations. Contribute to the development of future large-scale assessment strategies and frameworks for Pakistan.
Work Experience
Minimum of 5 years of progressive experience in psychometric analysis, large-scale assessment design, implementation, and reporting. Experience with item response theory (IRT) models and scaling techniques is essential. Experience in international development or working with national education systems is desirable.
Skills
Psychometric analysis, Item Response Theory (IRT), Large-scale assessment, Data analysis, Statistical modeling, Educational measurement, Report writing, Benchmarking, SDG indicator reporting, Project management, Stakeholder engagement, Quantitative research