A case study of the development of a valid and pragmatic implementation science measure: the Barriers and Facilitators in Implementation of Task-Sharing Mental Health interventions (BeFITS-MH) measure.

Journal: BMC health services research

Volume: 24

Issue: 1

Year of Publication: 2024

Affiliated Institutions:  Department of Social and Behavioral Sciences, New York University School of Global Public Health, Broadway, New York, NY, , USA. ly@nyu.edu. Department of Mental Health, Johns Hopkins Bloomberg School of Public Health, N. Wolfe Street, Room W, Baltimore, MD, , USA. Department of Community Health Sciences, Boston University School of Public Health, Massachusetts Avenue, Suite , Massachusetts, , Boston, USA. Center for Global Mental Health Equity, Department of Psychiatry and Behavioral Health, George Washington University, L St NW, Washington DC, , USA. Transcultural Psychosocial Organization (TPO) Nepal, Anek Marg, Kathmandu, , Nepal. Universidad O'Higgins, Avenida Bernardo O'Higgins , Santiago, Chile. Department of Social and Behavioral Sciences, New York University School of Global Public Health, Broadway, New York, NY, , USA. Columbia University Mailman School of Public Health, west th, New York, NY, , USA. Department of Population Health, New York University Grossman School of Medicine, Madison Avenue, New York, NY, , USA. Universidad de Valparaíso, Faculty of Medicine, School of Medicine, Department of Public Health, Center for Interdisciplinary Health Studies (CIESAL), Angamos , Viña del Mar, Chile. University of KwaZulu-Natal, Centre for Rural Health, Howard College campus, Mazisi Kunene Road, Glenwood, Durban, South Africa.

Abstract summary 

Few implementation science (IS) measures have been evaluated for validity, reliability and utility - the latter referring to whether a measure captures meaningful aspects of implementation contexts. We present a real-world case study of rigorous measure development in IS that assesses Barriers and Facilitators in Implementation of Task-Sharing in Mental Health services (BeFITS-MH), with the objective of offering lessons-learned and a framework to enhance measurement utility.We summarize conceptual and empirical work that informed the development of the BeFITS-MH measure, including a description of the Delphi process, detailed translation and local adaptation procedures, and concurrent pilot testing. As validity and reliability are key aspects of measure development, we also report on our process of assessing the measure's construct validity and utility for the implementation outcomes of acceptability, appropriateness, and feasibility.Continuous stakeholder involvement and concurrent pilot testing resulted in several adaptations of the BeFITS-MH measure's structure, scaling, and format to enhance contextual relevance and utility. Adaptations of broad terms such as "program," "provider type," and "type of service" were necessary due to the heterogeneous nature of interventions, type of task-sharing providers employed, and clients served across the three global sites. Item selection benefited from the iterative process, enabling identification of relevance of key aspects of identified barriers and facilitators, and what aspects were common across sites. Program implementers' conceptions of utility regarding the measure's acceptability, appropriateness, and feasibility clustered across several common categories.This case study provides a rigorous, multi-step process for developing a pragmatic IS measure. The process and lessons learned will aid in the teaching, practice and research of IS measurement development. The importance of including experiences and knowledge from different types of stakeholders in different global settings was reinforced and resulted in a more globally useful measure while allowing for locally-relevant adaptation. To increase the relevance of the measure it is important to target actionable domains that predict markers of utility (e.g., successful uptake) per program implementers' preferences. With this case study, we provide a detailed roadmap for others seeking to develop and validate IS measures that maximize local utility and impact.

Authors & Co-authors:  Yang Lawrence H LH Bass Judy K JK Le PhuongThao D PD Singh Ritika R Gurung Dristy D Velasco Paola R PR Grivel Margaux M MM Susser Ezra E Cleland Charles M CM Alvarado Rubén R Kohrt Brandon A BA Bhana Arvin A

Study Outcome 

Source Link: Visit source

Statistics
Citations :  Lewis CC, Fischer S, Weiner BJ, Stanick C, Kim M, Martinez RG. Outcomes for implementation science: an enhanced systematic review of instruments using evidence-based rating criteria. Implement Sci. 2015;10:1–17.
Authors :  12
Identifiers
Doi : 1352
SSN : 1472-6963
Study Population
Male,Female
Mesh Terms
Humans
Other Terms
Implementation science;Measure adaptation;Measure development;Measure validation; Case Study;Mental Health Services;Task-sharing
Study Design
Case Study
Study Approach
Country of Study
Publication Country
England