Evaluating Project Proposal Alignment with Objectives and the Role of Research Assessment in the Selection Process: A Study of the STI Hub Program of DST
Year: 2024
Type: preprint
Abstract: This paper assesses the funding process of India's Department of Science and Technology’s (DST) Science Technology and Innovation (STI) Hub program, focusing on how well the submitted proposals align with the goals of the program and how the quality of the proposed research is assessed by reviewers while recommending proposals for funding. The research assessment process was evaluated based on how responsible the process is. Qualitative research methods, including semi-structured interviews with the STI Hub program head, program review committee head, and focus group discussions with review committee members, were used in the evaluation of the research assessment process. The alignment and quality of a project proposal was determined by how well it addresses the STI Hub program’s stated objectives. Analysing the STI Hub's objectives helped develop 19 indicators essential to fulfil the program's goals. 200 proposals were evaluated to determine if they addressed these indicators, providing insights into the quality of submitted proposals and their alignment with the program goals. Our findings suggest that the alignment of proposals with project goals is not encouraging, highlighting the challenge of balancing academic research with the need for immediate social impact and participatory research approaches. The research assessment process needs better formal guidelines, a structured assessment method and transparency. The reputation of the institution and principal investigator, as well as the perspectives of review committee members, influence decision-making. The findings highlight the need for a better understanding of the STI Hub program’s objectives among reviewers and a shift in academic attitudes to value various outcomes beyond journal publications and institutional reputation. The paper aims to guide the design and implementation of future social impact initiatives and inform the newly established National Research Foundation in India.
Language: English
Subfield: Information Systems and Management
Field: Decision Sciences
Domain: Social Sciences
Open Access status: green
OpenAlex ID: W4400801262