How to evaluate science, technology and innovation in a development context?
Dear EvalForward members,
I lead the Evaluation Function of CGIAR, a global research partnership tasked with delivering science and innovation that advance the transformation of food, land and water systems in a climate crisis. I am joined today by Nanae Yabuki of the Office of Evaluation of the Food and Agriculture Organization (FAO) of the United Nations, which leads international efforts to end hunger and achieve food security for all.
CGIAR and FAO disseminate their knowledge through knowledge products such as publications and databases. However, when it comes to evaluating the quality of the science, technology and/or innovation (STI) used in our knowledge efforts, this is not always straightforward.
Evaluating the quality of STI should cover both normative knowledge at headquarters and operational work in the field. It requires appropriate criteria and methodologies, such as the use of bibliometric analysis, interviews, surveys, case studies and synthesis.
Building on experiences in evaluating quality of science, and to better align with the Quality of Research for Development (QoR4D) and industry practice, the CGIAR evaluation function recently issued a technical note on the use of bibliometrics to measure and evaluate science quality, with a view to developing guidance on evaluating the quality of science.
Additionally, to this end, FAO’s Office of Evaluation has been designing a quality of science evaluation to better meet the needs of users in the evolving development context.
We would like to hear your perspectives on and experience of the following:
1. What do you think are the challenges in evaluating quality of science and research?
a. What evaluation criteria have you used or are best to evaluate interventions at the nexus of science, research, innovation and development? Why?
b. Could a designated quality of science (QoS) evaluation criterion help capture the scientific aspects used in research and development?
2. What are the methods and indicators that could work in the evaluation of science and research?
3. Have you seen monitoring, evaluation and learning (MEL) practices that could facilitate evaluations of science, technology and innovation?
Because of the specific expertise of the EvalForward community in applied monitoring and evaluation processes, we welcome your comments to help us learn together.
- Blog: How to evaluate science, technology, and innovation in a development context | Eval Forward
- Technical note: Science-Metrix & CGIAR Advisory Services Secretariat Evaluation Function (2022). Bibliometric Analysis to Evaluate Quality of Science in the Context of One CGIAR. Technical Note. Rome.
- Article: Rünzel, M., Sarfatti, P. & Negroustoueva (2021), Evaluating quality of science in CGIAR research programs: Use of bibliometrics
Looking forward to hearing from you.
Evaluation lead, CGIAR Advisory Services Shared Secretariat