Improving inter-rater reliability of the enhancing assessment of common therapeutic factors (ENACT) measure through training of raters.

Journal: Journal of public health in Africa

Volume: 13

Issue: 3

Year of Publication: 

Affiliated Institutions:  Centre for Infectious Disease Research in Zambia, Lusaka, Zambia. Johns Hopkins Bloomberg School of Public Health, Baltimore, USA. Columbia University Mailman School of Public Health, New York, USA. George Washington University School of Medicine, Washington, DC, USA, Washington, USA.

Abstract summary 

As evidence supports task-shifting approaches to reduce the global mental health treatment gap, counselor competency evaluation measures are critical to ensure evidence-based therapies are administered with quality and fidelity.This article describes a training technique for evaluating lay counselors' competency for mental health lay practitioners without rating scale experience.Mental health practitioners were trained to give the Enhancing Assessment of Common Therapeutic Factors (ENACT) test to assess counselor proficiency in delivering the Common Elements Treatment Approach (CETA) in-person and over the phone using standardized video and audio recordings. A two-day in-person training was followed by a one-day remote training session. Training includes a review of item scales through didactic instructions, active learning by witnessing and scoring role-plays, peer interactions, and trainer observation and feedback. The trainees rated video and audio recordings, and ICC values were calculated.The training technique presented in this research helped achieve high counselor competency scores among lay providers with no prior experience using rating scales. ICC rated both trainings satisfactory to exceptional (ICC: .71 - .89).Raters with no past experience with rating scales can achieve high consistency when rating counselor competency through training. Effective rater training should include didactic learning, practical learning with trainer observation and feedback, and video and audio recordings to assess consistency.

Authors & Co-authors:  Mwenge Mwamba M MM Figge Caleb J CJ Metz Kristina K Kane Jeremy C JC Kohrt Brandon A BA Pedersen Gloria A GA Sikazwe Izukanji I Van Wyk Stephanie Skavenski SS Mulemba Saphira M SM Murray Laura K LK

Study Outcome 

Source Link: Visit source

Statistics
Citations :  Santomauro DF, Herrera AM, Shadid J, et al. . Global prevalence and burden of depressive and anxiety disorders in 204 countries and territories in 2020 due to the COVID-19 pandemic. Lancet. 2020; 398. 10.1016/S0140-6736(21)02143-7
Authors :  10
Identifiers
Doi : 2201
SSN : 2038-9922
Study Population
Male,Female
Mesh Terms
Other Terms
counselor competency;inter-rater reliability;raters;training
Study Design
Study Approach
Country of Study
Publication Country
Italy