TY - JOUR
T1 - Psychometric properties of two implementation measures
T2 - Normalization MeAsure Development questionnaire (NoMAD) and organizational readiness for implementing change (ORIC)
AU - Batterham, P.
AU - Allenhof, Caroline
AU - Cerga Pashoja, Arlinda
AU - Etzelmueller, A.
AU - Fanaj, N.
AU - Finch, T.
AU - Freund, J.
AU - Hanssen, D.
AU - Mathiasen, K.
AU - Piera Jiminez, Jordi
AU - Qirjako, G.
AU - Rapley, T.
AU - Sacco, Y.
AU - Samalin, L.
AU - Schuurmans, J.
AU - van Genugten, Claire
AU - Vis, C.
N1 - Publisher Copyright:
© The Author(s) 2024.
PY - 2024/4/28
Y1 - 2024/4/28
N2 - Background: Effective interventions need to be implemented successfully to achieve impact. Two theory-based measures exist for measuring the effectiveness of implementation strategies and monitor implementation progress. The Normalization MeAsure Development questionnaire (NoMAD) explores the four core concepts (Coherence, Cognitive Participation, Collective Action, Reflexive Monitoring) of the Normalization Process Theory. The Organizational Readiness for Implementing Change (ORIC) is based on the theory of Organizational Readiness for Change, measuring organization members’ psychological and behavioral preparedness for implementing a change. We examined the measurement properties of the NoMAD and ORIC in a multi-national implementation effectiveness study. Method: Twelve mental health organizations in nine countries implemented Internet-based cognitive behavioral therapy (iCBT) for common mental disorders. Staff involved in iCBT service delivery (n = 318) participated in the study. Both measures were translated into eight languages using a standardized forward–backward translation procedure. Correlations between measures and subscales were estimated to examine convergent validity. The theoretical factor structures of the scales were tested using confirmatory factor analysis (CFA). Test–retest reliability was based on the correlation between scores at two time points 3 months apart. Internal consistency was assessed using Cronbach's alpha. Floor and ceiling effects were quantified using the proportion of zero and maximum scores. Results: NoMAD and ORIC measure related but distinct latent constructs. The CFA showed that the use of a total score for each measure is appropriate. The theoretical subscales of the NoMAD had adequate internal consistency. The total scale had high internal consistency. The total ORIC scale and subscales demonstrated high internal consistency. Test–retest reliability was suboptimal for both measures and floor and ceiling effects were absent. Conclusions: This study confirmed the psychometric properties of the NoMAD and ORIC in multi-national mental health care settings. While measuring on different but related aspects of implementation processes, the NoMAD and ORIC prove to be valid and reliable across different language settings.
AB - Background: Effective interventions need to be implemented successfully to achieve impact. Two theory-based measures exist for measuring the effectiveness of implementation strategies and monitor implementation progress. The Normalization MeAsure Development questionnaire (NoMAD) explores the four core concepts (Coherence, Cognitive Participation, Collective Action, Reflexive Monitoring) of the Normalization Process Theory. The Organizational Readiness for Implementing Change (ORIC) is based on the theory of Organizational Readiness for Change, measuring organization members’ psychological and behavioral preparedness for implementing a change. We examined the measurement properties of the NoMAD and ORIC in a multi-national implementation effectiveness study. Method: Twelve mental health organizations in nine countries implemented Internet-based cognitive behavioral therapy (iCBT) for common mental disorders. Staff involved in iCBT service delivery (n = 318) participated in the study. Both measures were translated into eight languages using a standardized forward–backward translation procedure. Correlations between measures and subscales were estimated to examine convergent validity. The theoretical factor structures of the scales were tested using confirmatory factor analysis (CFA). Test–retest reliability was based on the correlation between scores at two time points 3 months apart. Internal consistency was assessed using Cronbach's alpha. Floor and ceiling effects were quantified using the proportion of zero and maximum scores. Results: NoMAD and ORIC measure related but distinct latent constructs. The CFA showed that the use of a total score for each measure is appropriate. The theoretical subscales of the NoMAD had adequate internal consistency. The total scale had high internal consistency. The total ORIC scale and subscales demonstrated high internal consistency. Test–retest reliability was suboptimal for both measures and floor and ceiling effects were absent. Conclusions: This study confirmed the psychometric properties of the NoMAD and ORIC in multi-national mental health care settings. While measuring on different but related aspects of implementation processes, the NoMAD and ORIC prove to be valid and reliable across different language settings.
KW - implementation measures
KW - implementation outcomes
KW - NoMAD
KW - normalization process theory
KW - organizational readiness for implementing change
KW - ORIC
KW - psychometric properties
UR - http://www.scopus.com/inward/record.url?scp=85192500049&partnerID=8YFLogxK
U2 - 10.1177/26334895241245448
DO - 10.1177/26334895241245448
M3 - Article
AN - SCOPUS:85192500049
SN - 2633-4895
VL - 5
JO - Implementation Research and Practice
JF - Implementation Research and Practice
ER -