Twenty-fourth International Conference on Knowledge, Culture, and Change in Organizations

Abstract

During a time of accountability, nongovernmental organizations (NGOs) need to enhance their organizational evaluation capacity to create high-quality program evaluations and demonstrate the effectiveness of their services to stakeholders. Nevertheless, there is a scarcity of easily accessible tools for this purpose. The objective of this research is to create and validate the Organizational Evaluation Capacity Scale (OECS), a self-reporting tool designed to assess the evaluation capacity of NGOs. The validation data included responses from 279 NGO practitioners who participated in the Jockey Club MEL Institute Project held in Hong Kong, China. To establish the latent factor structure of the OECS, exploratory factor analysis was employed. The validity of the OECS was then examined through confirmatory factor analysis and structural equation models. Results: The analysis yielded two factors, namely organizational evaluation readiness and organizational evaluation infrastructure, which accounted for a substantial portion of the total variance (72.967%). The confirmatory factor analysis confirmed this two-factor structure and indicated a favorable fit of the model (CFI = 0.915, RMSEA = 0.096, and SRMR = 0.064). All the items significantly reflected their respective sub-constructs. Furthermore, the results demonstrated satisfactory internal consistency, sub-group consistency (across subsamples categorized by gender, age, level of education, and job position), and concurrent validity of the OECS. Our findings provide support for the validity and reliability of the OECS as a tool for assessing the evaluation capacity of NGOs in Hong Kong.