Assessing local instrument reliability and validity: a field-based example from northern Uganda.

Journal: Social psychiatry and psychiatric epidemiology

Volume: 44

Issue: 8

Year of Publication: 2009

Affiliated Institutions:  Dept. of Population and International Health, François-Xavier Bagnoud Center for Health and Human Rights, Harvard School of Public Health, Boston, MA , USA. theresa_betancourt@harvard.edu

Abstract summary 

This paper presents an approach for evaluating the reliability and validity of mental health measures in non-Western field settings. We describe this approach using the example of our development of the Acholi psychosocial assessment instrument (APAI), which is designed to assess depression-like (two tam, par and kumu), anxiety-like (ma lwor) and conduct problems (kwo maraco) among war-affected adolescents in northern Uganda. To examine the criterion validity of this measure in the absence of a traditional gold standard, we derived local syndrome terms from qualitative data and used self reports of these syndromes by indigenous people as a reference point for determining caseness. Reliability was examined using standard test-retest and inter-rater methods. Each of the subscale scores for the depression-like syndromes exhibited strong internal reliability ranging from alpha = 0.84-0.87. Internal reliability was good for anxiety (0.70), conduct problems (0.83), and the pro-social attitudes and behaviors (0.70) subscales. Combined inter-rater reliability and test-retest reliability were good for most subscales except for the conduct problem scale and prosocial scales. The pattern of significant mean differences in the corresponding APAI problem scale score between self-reported cases vs. noncases on local syndrome terms was confirmed in the data for all of the three depression-like syndromes, but not for the anxiety-like syndrome ma lwor or the conduct problem kwo maraco.

Authors & Co-authors:  Betancourt Theresa S TS Bass Judith J Borisova Ivelina I Neugebauer Richard R Speelman Liesbeth L Onyango Grace G Bolton Paul P

Study Outcome 

Source Link: Visit source

Statistics
Citations :  Achenbach TM. Manual for the Child Behavior Checklist and 1991 Profile. Department of Psychiatry, University of Vermont; Burlington, VT: 1991.
Authors :  7
Identifiers
Doi : 10.1007/s00127-008-0475-1
SSN : 1433-9285
Study Population
Male,Female
Mesh Terms
Adolescent
Other Terms
Study Design
Cross Sectional Study
Study Approach
Qualitative
Country of Study
Uganda
Publication Country
Germany