Measuring mental health and wellbeing outcomes for children and adolescents to inform practice and policy: a review of child self-report measures

Chinese Medicine

Miranda Wolpert¹  Praveetha Patalay¹  Jeb Brown²  Peter Fonagy⁴  Tim Croudace³  Jessica Deighton¹ 

[1] Evidence Based Practice Unit (EBPU), UCL and the Anna Freud Centre, 21 Maresfield Gardens, London NW3 5SD, UK;Center for Clinical Informatics, 2061 Murray Holliday Blvd, Salt Lake City, UT 84117, USA;Mental Health and Addiction Research Group (MHARG), HYMS and Department of Health Sciences, Room 204, 2nd Floor (Area 4) ARRC Building, University of York, York, Heslington YO10 5DD, UK;Research Department of Clinical, Educational and Health Psychology, UCL, Gower Street, London WC1E 6BT, UK

关键词: Patient reported outcome measures;    Child mental health services;    Children;    Measurement;    Mental health outcomes;   

Others  :  790454
DOI  :  10.1186/1753-2000-8-14

 received in 2013-11-15, accepted in 2014-04-10,  发布年份 2014

【 摘 要 】

There is a growing appetite for mental health and wellbeing outcome measures that can inform clinical practice at individual and service levels, including use for local and national benchmarking. Despite a varied literature on child mental health and wellbeing outcome measures that focus on psychometric properties alone, no reviews exist that appraise the availability of psychometric evidence and suitability for use in routine practice in child and adolescent mental health services (CAMHS) including key implementation issues. This paper aimed to present the findings of the first review that evaluates existing broadband measures of mental health and wellbeing outcomes in terms of these criteria. The following steps were implemented in order to select measures suitable for use in routine practice: literature database searches, consultation with stakeholders, application of inclusion and exclusion criteria, secondary searches and filtering. Subsequently, detailed reviews of the retained measures’ psychometric properties and implementation features were carried out. 11 measures were identified as having potential for use in routine practice and meeting most of the key criteria: 1) Achenbach System of Empirically Based Assessment, 2) Beck Youth Inventories, 3) Behavior Assessment System for Children, 4) Behavioral and Emotional Rating Scale, 5) Child Health Questionnaire, 6) Child Symptom Inventories, 7) Health of the National Outcome Scale for Children and Adolescents, 8) Kidscreen, 9) Pediatric Symptom Checklist, 10) Strengths and Difficulties Questionnaire, 11) Youth Outcome Questionnaire. However, all existing measures identified had limitations as well as strengths. Furthermore, none had sufficient psychometric evidence available to demonstrate that they could reliably measure both severity and change over time in key groups. The review suggests a way of rigorously evaluating the growing number of broadband self-report mental health outcome measures against standards of feasibility and psychometric credibility in relation to use for practice and policy.

【 授权许可】

   
2014 Deighton et al.; licensee BioMed Central Ltd.

【 图 表 】

Figure 1.

【 参考文献 】

• [1]Bickman L, Kelley SD, Breda C, de Andrade AR, Riemer M: Effects of routine feedback to clinicians on mental health outcomes of youths: results of a randomized trial. Psychiatr Serv 2011, 62:1423-1429.
• [2]Wolpert M, Ford T, Trustam E, Law D, Deighton J, Flannery H, Fugard A: Patient-reported outcomes in child and adolescent mental health services (CAMHS): use of idiographic and standardized measures. J Ment Health 2012, 21:165-173.
• [3]Wolpert M, Fugard AJB, Deighton J, Görzig A: Routine outcomes monitoring as part of children and young people's Improving Access to Psychological Therapies (CYP IAPT) – improving care or unhelpful burden? Child Adolesc Ment Health 2012, 17:129-130.
• [4]Achenbach TM, Rescorla L: Manual for the ASEBA school-age forms & profiles: an integrated system of multi-informant assessment. Burlington, Vt: ASEBA; 2001.
• [5]Goodman R: The Strengths and Difficulties Questionnaire: a research note. J Child Psychol Psychiatry 1997, 38:581-586.
• [6]Goodman R, Scott S: Comparing the strengths and difficulties questionnaire and the child behavior checklist: is small beautiful? J Abnorm Child Psychol 1999, 27:17-24.
• [7]Cremeens J, Eiser C, Blades M: Characteristics of health-related self-report measures for children aged three to eight years: a review of the literature. Qual Life Res 2006, 15:739-754.
• [8]Myers K, Winters NC: Ten-year review of rating scales. II: scales for internalizing disorders. J Am Acad Child Adolesc Psychiatry 2002, 41:634-659.
• [9]Hunter J, Higginson I, Garralda E: Systematic literature review: outcome measures for child and adolescent mental health services. J Public Health Med 1996, 18:197-206.
• [10]UK Government: Children Act, Volume 31. London: The Stationery Office; 2004.
• [11]Black N: Patient reported outcome measures could help transform healthcare. BMJ 2013, 346:f167.
• [12]Department of Health: Liberating the NHS: No decision about me without me. Government response. London: Stationary Office; 2012.
• [13]Nations U: The United Nations Convention on the Rights of the Child. London: UNICEF; 1989.
• [14]Lesley C: Unit Costs of Health and Social Care 2012. Canterbury: Personal Social services Research Unit; 2012.
• [15]Marsh H, Debus R, Bornholt L: Validating Young Children's Self-Concept Responses: Methodological Ways and Means to Understand their Responses. In Handbook of Research Methods in Developmental Science. Blackwell Publishing Ltd: Malden, Oxford and Victoria: Blackwell Publishing Ltd.; 2008:23-160.
• [16]Edelbrock C, Costello AJ, Dulcan MK, Kalas R, Conover NC: Age differences in the reliability of the psychiatric interview of the child. Child Dev 1985, 56:265-275.
• [17]Truman J, Robinson K, Evans AL, Smith D, Cunningham L, Millward R, Minnis H: The strengths and difficulties questionnaire: a pilot study of a new computer version of the self-report scale. Eur Child Adolesc Psychiatry 2003, 12:9-14.
• [18]Schmidt LJ, Garratt AM, Fitzpatrick R: Instruments for Mental Health: A review. London: Patient-Reported Health Instruments Group; 2000.
• [19]Sharp C, Croudace TJ, Goodyer IM, Amtmann D: The strength and difficulties questionnaire: predictive validity of parent and teacher ratings for help-seeking behaviour over one year. Educ Child Psychol 2005, 22:28-44.
• [20]Arseneault L, Kim-Cohen J, Taylor A, Caspi A, Moffitt TE: Psychometric evaluation of 5- and 7-year-old children's self-reports of conduct problems. J Abnorm Child Psychol 2005, 33:537-550.
• [21]Deighton J, Tymms P, Vostanis P, Belsky J, Fonagy P, Brown A, Martin A, Patalay P, Wolpert M: The development of a school-based measure of child mental health. J Psychoeduc Assess 2013, 31:247-257.
• [22]Chorpita BF, Reise S, Weisz JR, Grubbs K, Becker KD, Krull JL: Evaluation of the brief problem checklist: child and caregiver interviews to measure clinical progress. J Consult Clin Psychol 2010, 78:526-536.
• [23]Weisz JR, Jensen-Doss A, Hawley KM: Evidence-based youth psychotherapies versus usual clinical care: a meta-analysis of direct comparisons. Am Psychol 2006, 61:671-689.
• [24]Wolpert M, Aitken J, Syrad H, Munroe M, Saddington C, Trustam E, Bradley J, Nolas SM, Lavis P, Jones A, Fonagy P, Frederickson N, Day C, Rutter M, Humphrey N, Vostanis P, Meadows P, Croudace T, Tymms P, Brown J: Review and recommendations for national policy for England for the use of mental health outcome measures with children and young people. London: Department for Children, Schools and Families; 2008. [http://www.ucl.ac.uk/ebpu/publications/reports webcite]
• [25]Beck JS, Beck AT, Jolly JB: Beck Youth Inventories Manual. San Antonio: Psychological Corporation; 2001.
• [26]Flanagan D, Alfonso V, Primavera L, Povall L, Higgins D: Convergent validity of the BASC and SSRS: implications for social skills assessment. Psychol Sch 1996, 33:13-23.
• [27]Flanagan R: A Review of the Behavior Assessment System for Children (BASC): Assessment Consistent With the Requirements of the Individuals With Disabilities Education Act (IDEA). J Sch Psychol 1995, 33:177-186.
• [28]Sandoval J, Echandia A: Behavior assessment system for children. J Sch Psychol 1994, 32:419-425.
• [29]Epstein MH: Behavioral and Emotional Rating Scale. PRO-ED: Austin; 2004.
• [30]Reid R, Epstein MH, Pastor DA, Ryser GR: Strengths-based assessment differences across students with LD and EBD. Remedial Spec Educ 2000, 21:346-355.
• [31]Landgraf JM, Abetz L, Ware JE: The CHQ: A user's manual. Boston: HealthAct; 1999.
• [32]Raat H, Botterweck AM, Landgraf JM, Hoogeveen WC, Essink-Bot ML: Reliability and validity of the short form of the Child Health Questionnaire for parents (CHQ-PF28) in large random school based and general population samples. J Epidemiol Community Health 2005, 59:75-82.
• [33]Sung L, Greenberg ML, Doyle JJ, Young NL, Ingber S, Rubenstein J, Wong J, Samanta T, McLimont M, Feldman BM: Construct validation of the health utilities index and the Child Health Questionnaire in children undergoing cancer chemotherapy. Br J Cancer 2003, 88:1185-1190.
• [34]Gadow KD, Sprafkin J: Child Symptom Inventory 4: Screening and Norms Manual. Stony Brook, NY: Checkmate Plus; 2002.
• [35]Garralda ME, Yates P, Higginson I: Child and adolescent mental health service use. HoNOSCA as an outcome measure. Br J Psychiatry 2000, 177:52-58.
• [36]Gowers SG, Harrington RC, Whitton A, Lelliott P, Beevor A, Wing J, Jezzard R: Brief scale for measuring the outcomes of emotional and behavioural disorders in children. Health of the Nation Outcome Scales for children and Adolescents (HoNOSCA). Br J Psychiatry 1999, 174:413-416.
• [37]Gowers SG, Levine W, Bailey-Rogers S, Shore A, Burhouse E: Use of a routine, self-report outcome measure (HoNOSCA-SR) in two adolescent mental health services. Health of the nation outcome scale for children and adolescents. Br J Psychiatry 2002, 180:266-269.
• [38]Ravens-Sieberer U, Gosch A, Rajmil L, Erhart M, Bruil J, Power M, Duer W, Auquier P, Cloetta B, Czemy L, Mazur J, Czimbalmos A, Tountas Y, Hagquist C, Kilroe J, KIDSCREEN Group: The KIDSCREEN-52 quality of life measure for children and adolescents: psychometric results from a cross-cultural survey in 13 European countries. Value Health 2008, 11:645-658.
• [39]Berra S, Ravens-Sieberer U, Erhart M, Tebe C, Bisegger C, Duer W, von Rueden U, Herdman M, Alonso J, Rajmil L: Methods and representativeness of a European survey in children and adolescents: the KIDSCREEN study. BMC Public Health 2007, 7:182. BioMed Central Full Text
• [40]Ravens-Sieberer U, Erhart M, Rajmil L, Herdman M, Auquier P, Bruil J, Power M, Duer W, Abel T, Czemy L, Azur J, Czimbalmos A, Tountas Y, Hagquist C, Kilroe J, KIDSCREEN Group: Reliability, construct and criterion validity of the KIDSCREEN-10 score: a short measure for children and adolescents’ well-being and health-related quality of life. Qual Life Res 2010, 19:1487-1500.
• [41]Robitail S, Ravens-Sieberer U, Simeoni MC, Rajmil L, Bruil J, Power M, Duer W, Cloetta B, Czemy L, Mazur J, Czimbalmos A, Tountas Y, Hagquist C, Kilroe J, Auquier P, Kidscreen Group: Testing the structural and cross-cultural validity of the KIDSCREEN-27 quality of life questionnaire. Qual Life Res 2007, 16:1335-1345.
• [42]Gall G, Pagano ME, Desmond MS, Perrin JM, Murphy JM: Utility of psychosocial screening at a school-based health center. J Sch Health 2000, 70:292-298.
• [43]Gardner W, Lucas A, Kolko DJ, Campo JV: Comparison of the PSC-17 and alternative mental health screens in an at-risk primary care sample. J Am Acad Child Adolesc Psychiatry 2007, 46:611-618.
• [44]Jellinek MS, Murphy JM, Little M, Pagano ME, Comer DM, Kelleher KJ: Use of the Pediatric Symptom Checklist to screen for psychosocial problems in pediatric primary care: a national feasibility study. Arch Pediatr Adolesc Med 1999, 153:254-260.
• [45]Murphy JM, Jellinek M, Milinsky S: The Pediatric Symptom Checklist: validation in the real world of middle school. J Pediatr Psychol 1989, 14:629-639.
• [46]Wasserman RC, Kelleher KJ, Bocian A, Baker A, Childs GE, Indacochea F, Stulp C, Gardner WP: Identification of attentional and hyperactivity problems in primary care: a report from pediatric research in office settings and the ambulatory sentinel practice network. Pediatrics 1999, 103:E38.
• [47]Goodman R: Psychometric properties of the strengths and difficulties questionnaire. J Am Acad Child Adolesc Psychiatry 2001, 40:1337-1345.
• [48]Goodman R, Meltzer H, Bailey V: The Strengths and Difficulties Questionnaire: a pilot study on the validity of the self-report version. Eur Child Adolesc Psychiatry 1998, 7:125-130.
• [49]Dunn TW, Burlingame GM, Walbridge M, Smith J, Crum MJ, Dunn TW, Burlingame GM, Walbridge M, Smith J, Crum MJ: Outcome assessment for children and adolescents: psychometric validation of the Youth Outcome Questionnaire 30.1 (Y-OQ®-30.1). Clin Psychol Psychother 2005, 12:388-401.
• [50]Edwards TC, Huebner CE, Connell FA, Patrick DL: Adolescent quality of life, Part I: conceptual and measurement model. J Adolesc 2002, 25:275-286.
• [51]Bares C, Andrade F, Delva J, Grogan-Kaylor A, Kamata A: Differential item functioning due to gender between depression and anxiety items among Chilean adolescents. Int J Soc Psychiatry 2012, 58:386-392.
• [52]McClendon DT, Warren JS, Green KM, Burlingame GM, Eggett DL, McClendon RJ: Sensitivity to change of youth treatment outcome measures: a comparison of the CBCL, BASC-2, and Y-OQ. J Clin Psychol 2011, 67:111-125.
• [53]Humphrey N, Kalambouka A, Wigelsworth M, Lendrum A, Deighton J, Wolpert M: Measures of social and emotional skills for children and young people: a systematic review. Educ Psychol Meas 2011, 71:617-637.
• [54]Fokkema M, Smits N, Kelderman H, Cuijpers P: Response shifts in mental health interventions: an illustration of longitudinal measurement invariance. Psychol Assess 2013, 25:520-531.
• [55]Oort FJ: Using structural equation modeling to detect response shifts and true change. Qual Life Res 2005, 14:587-598.
• [56]Wolpert M: Uses and Abuses of Patient Reported Outcome Measures (PROMs): potential iatrogenic impact of PROMs implementation and how it can be mitigated. Adm Policy Ment Health 2014, 41:141-145.
• [57]Law D, Wolpert M (Eds): Guide to Using Outcomes and Feedback Tools With Children, Young People and Families. 2nd edition. London: CAMHS Press; 2014.
• [58]Badham B: Talking about talking therapies: thinking and planning about how to make good and accessible talking therapies available to children and young people. 2011. http://www.iapt.nhs.uk/silo/files/talking-about-talking-therapies.pdf webcite
• [59]Curtis-Tyler K: Facilitating children's contributions in clinic? Findings from an in-depth qualitative study with children with Type 1 diabetes. Diabet Med 2012, 29:1303-1310.
• [60]Moran P, Kelesidi K, Guglani S, Davidson S, Ford T: What do parents and carers think about routine outcome measures and their use? A focus group study of CAMHS attenders. Clin Child Psychol Psychiatry 2012, 17(1):65-79.