Developing a reporting guideline for social and psychological intervention trials

Trials

Paul Montgomery²  David Moher¹  Geraldine Macdonald³  Sally Hopewell⁵  Sean Grant²  Evan Mayo-Wilson⁴ 

[1] Clinical Epidemiology Program, Ottawa Hospital Research Institute Centre for Practice-Changing Research (CPCR), The Ottawa Hospital − General Campus, 501 Smyth Rd Room L1288, Ottawa, ON K1H 8L6, Canada;Centre for Evidence-Based Intervention, University of Oxford Barnett House, 32 Wellington Square, Oxford OX1 2ER, UK;Institute of Child Care Research, Queen’s University Belfast, 6 College Park, Belfast BT7 1LP, UK;Centre for Outcomes Research and Effectiveness, Research Department of Clinical, Educational & Health Psychology, University College London, 1-19 Torrington Place, London WC1E 7HB, UK;Centre for Statistics in Medicine, University of Oxford Wolfson College Annexe, Linton Road, Oxford OX2 6UD, UK

关键词: Reporting standards;    Reporting guideline;    CONSORT-SPI;    RCT;    Randomised controlled trial;   

Others  :  1093293
DOI  :  10.1186/1745-6215-14-242

 received in 2012-11-21, accepted in 2013-07-22,  发布年份 2013

【 摘 要 】

Social and psychological interventions are often complex. Understanding randomised controlled trials (RCTs) of these complex interventions requires a detailed description of the interventions tested and the methods used to evaluate them; however, RCT reports often omit, or inadequately report, this information. Incomplete and inaccurate reporting hinders the optimal use of research, wastes resources, and fails to meet ethical obligations to research participants and consumers. In this paper, we explain how reporting guidelines have improved the quality of reports in medicine, and describe the ongoing development of a new reporting guideline for RCTs: CONSORT-SPI (an Extension for social and psychological interventions). We invite readers to participate in the project by visiting our website, in order to help us reach the best-informed consensus on these guidelines (http://tinyurl.com/CONSORT-study webcite).

【 授权许可】

   
2013 Mayo-Wilson et al.; licensee BioMed Central Ltd.

【 参考文献 】

• [1]Medical Research Council: A framework for development and evaluation of RCTs for complex interventions to improve health. London: MRC; 2008.
• [2]Pawson R, Greenhalgh T, Harvey G, Walshe K: Realist synthesis: an introduction. ESRC Research Methods Programme: University of Manchester; 2004.
• [3]Bonell C: The utility of randomized controlled trials of social interventions: an examination of two trials of HIV prevention. Crit Public Health 2002, 12:321-334.
• [4]Hawe P, Shiell A, Riley T: Complex interventions: how “out of control” can a randomised controlled trial be? BMJ 2004, 328:1561-1563.
• [5]Bonell C, Fletcher A, Morton M, Lorenc T, Moore L: Realist randomised controlled trials: a new approach to evaluating complex public health interventions. Soc Sci Med 2012, 75:2299-2306.
• [6]Henggeler SW, Schoenwald SK, Rowland MD, Cunningham PB: Serious emotional disturbances in children and adolescents: multisystemic therapy. New York: Guilford Press; 2002.
• [7]Littell JH, Campbell M, Green S, Toews B: Multisystemic Therapy for social, emotional, and behavioral problems in youth aged 10–17. Cochrane Database Syst Rev 2009., 4CD004797
• [8]Cochrane Collaboration. [http://www.cochrane.org/ webcite] (retrieved 26 April 2013)
• [9]Campbell Collaboration. [http://campbellcollaboration.org/ webcite] (retrieved 26 April 2013)
• [10]Perry AE, Weisburd D, Hewitt C: Are criminologists describing randomized controlled trials in ways that allow us to assess them? Findings from a sample of crime and justice trials. J Exp Criminol 2010, 6:245-262.
• [11]Naleppa MJ, Cagle JG: Treatment fidelity in social work intervention research: a review of published studies. Res Soc Work Pract 2010, 20:674-681.
• [12]Torgerson CJ, Torgerson DJ, Birks YF, Porthouse J: A comparison of RCTs in health and education. Br Educ Res J 2005, 31:761-785.
• [13]Stinson JN, McGrath PJ, Yamada JT: Clinical trials in the Journal of Pediatric Psychology: applying the CONSORT Statement. J Pediatr Psychol 2003, 28:159-167.
• [14]Michie S, Abraham C, Eccles MP, Francis JJ, Hardeman W, Johnston M: Strengthening evaluation and implementation by specifying components of behaviour change interventions: a study protocol. Implement Sci 2011, 6:10. BioMed Central Full Text
• [15]Semaan S, Kay L, Strouse D, Sogolow E, Dolan Mullen P, Spink Neumann M, Flores SA, Peersman G, Johnson WD, Darby Lipman P, Eke A, Des Jarlais DC: A profile of U.S.-based trials of behavioral and social interventions for HIV risk reduction. J Acquir Immune Defic Syndr 2002, 30:S30-S50.
• [16]Schulz KF, Altman DG, Moher D: For the CONSORT Group: CONSORT, Statement: updated guidelines for reporting parallel group randomised trials. BMJ 2010, 2010(340):698-702.
• [17]Davidson KW, Goldstein M, Kaplan RM, Kaufman PG, Knatterud GL, Tracy Orleans C, Spring B, Trudeau KJ, Whitlock EP: Evidence-based behavioural medicine: what is it and how do we achieve it? Ann Behav Med 2003, 26:161-171.
• [18]Bonell C, Oakley A, Hargreaves J, Strange V, Rees R: Assessment of generalisability in trials of health interventions: suggested framework and systematic review. BMJ 2006, 333:346-349.
• [19]Moher D, Schulz KF, Simera I, Altman DG: Guidance for developers of health research reporting guidelines. PLoS Med 2010, 7:e1000217.
• [20]Bonell CP, Hargreaves J, Cousens S, Ross D, Hayes R, Petticrew M, Kirkwood BR: Alternatives to randomisation in the evaluation of public health interventions: design challenges and solutions. J Epidemiol Community Health 2011, 65:582-587.
• [21]Chalmers I: Trying to do more good than harm in policy and practice: the role of rigorous, transparent, up-to-date evaluations. Ann Am Acad Pol Soc Sci 2003, 589:22-40.
• [22]Turner L, Shamseer L, Altman DG, Weeks L, Peters J, Kober T, Dias S, Schulz KF, Plint AC, Moher D: Consolidated standards of reporting trials (CONSORT) and the completeness of reporting of randomised controlled trials (RCTs) published in medical journals. Cochrane Database Syst Rev 2012., 11MR000030
• [23]Moher D, Altman DG, Schulz KF, Elbourne DR: Opportunities and challenges for improving the quality of reporting clinical research: CONSORT and beyond. CMAJ 2004, 171:349-350.
• [24]Mayo-Wilson E: Reporting implementation in randomized trials: proposed additions to the Consolidated Standards of Reporting Trials statement. Am J Public Health 2007, 97:630.
• [25]Gill CE: Missing links: how descriptive validity impacts the policy relevance of randomized controlled trials in criminology. J Exp Criminol 2011, 7:201-224.
• [26]Campbell MK, Elbourne DR, Altman DG: CONSORT statement: extension to cluster randomised trials. BMJ 2004, 328:702-708.
• [27]Boutron I, Moher D, Altman DG, Schulz K, Ravaud P: for the CONSORT group: Methods and processes of the CONSORT group: example of an extension for trials assessing nonpharmacologic treatments. Ann Intern Med 148:60-67.
• [28]Zwarenstein M, Treweek S, Gagnier JJ, for the CONSORT and Pragmatic Trials in Healthcare (Practihc) group: Improving the reporting of pragmatic trials: an extension of the CONSORT statement. BMJ 2008, 337:2390.
• [29]Calvert M, Blazeby J, Revicki D, Moher D, Brundage M: Reporting quality of life in clinical trials: a CONSORT extension. Lancet 2011, 378:1684-1685.
• [30]Abraham C: WIDER recommendations to improve reporting of the content of behaviour change interventions. 2009. [http://interventiondesign.co.uk/wp-content/uploads/2009/02/wider-recommendations.pdf webcite] (accessed 13 November 2012)
• [31]American Educational Research Association: Standards for reporting on empirical social science research in AERA publications. Educ Res 2006, 35:33-40.
• [32]Newman M, Elbourne D: Improving the usability of educational research: guidelines for the REPOrting of primary empirical research Studies in Education (The REPOSE Guidelines). Evaluation & Research in Education 2004, 18:201-212.
• [33]American Psychological Association Journal Article Reporting Standards Group: Reporting standards for research in psychology: why do we need them? What might they be? Am Psychol 2008, 63:839-851.
• [34]Grant S, Montgomery P, Mayo-Wilson E: Development of a CONSORT extension for interventions in public health and related disciplines. Lancet 2012, 380:14.
• [35]Perry AE, Johnson M: Applying the Consolidated Standards of Reporting Trials (CONSORT) to studies of mental health provision for juvenile offenders: a research note. J Exp Criminol 2008, 4:165-185.
• [36]Armstrong R, Waters E, Moore L, Riggs E, Gabriel Cuervo L, Lumbiganon P, Hawe P: Improving the reporting of public health intervention research: advancing TREND and CONSORT. J Public Health 2008, 30:103-109.
• [37]Pildal J, Hróbjartsson A, Jørgensen KJ, Hilden J, Altman DG, Gøtzsche PC: Impact of allocation concealment on conclusions drawn from meta-analyses of randomized trials. Int J Epidemiol 2007, 36:847-857.
• [38]Prescott RJ, Counsell CE, Gillespie WJ, Grant AM, Russell IT, Kiauka S, Colthart IR, Ross S, Shepherd SM, Russell D: Factors that limit the quality, number and progress of randomised controlled trials. Health Technol Assess 1999, 3:1-143.
• [39]Schulz KF, Chalmers I, Hayes RJ, Altman DG: Allocation concealment in randomised trials: defending against deciphering. Lancet 1995, 359:614-617.
• [40]Moher D, Pham B, Jones A, Cook DJ, Jadad AR, Moher M, Tugwell P, Klassen TP: Does quality of reports of randomized trials affect estimates of intervention efficacy reported in meta-analyses. Lancet 1999, 352:609-613.
• [41]Ladd BO, McCrady BS, Manuel JK, Campbell W: Improving the quality of reporting alcohol outcome studies: effects of the CONSORT statement. Addict Behav 2010, 35:660-666.
• [42]Medical Research Council: Using natural experiments to evaluate population health interventions: guidance for producers and users of evidence. London: MRC; 2011.
• [43]Marshall M, Lockwood A, Bradley C, Adams C, Joy C, Fenton M: Unpublished rating scales: a major source of bias in randomised controlled trials of treatments for schizophrenia. Br J Psychiatry 2000, 176:249-252.
• [44]Fraser MW, Galinsky MJ, Richman JM, Day SH: Intervention research: developing social programs. Oxford: Oxford University Press; 2009.
• [45]Cartwright N, Munro E: The limitations of randomized controlled trials in predicting effectiveness. J Eval Clin Pract 2010, 16:260-266.
• [46]Moore L, Moore GF: Public health evaluation: which designs work, for whom and under what circumstances? J Epidemiol Community Health 2011, 65:596-597.
• [47]Shepperd S, Lewin S, Straus S, Clarke M, Eccles MP, Fitzpatrick R, Wong G, Sheikh A: Can we systematically review studies that evaluate complex interventions? PLoS Med 2009, 6:31000086.
• [48]Glasziou P, Meats E, Heneghan C, Shepperd S: What is missing from descriptions of treatment in trials and reviews? BMJ 2008, 336:1472-1474.
• [49]Craig P, Dieppe P, Macintyre S, Mitchie S, Nazareth I, Petticrew M: Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ 2008, 337:979-983.
• [50]Ivers N, Jamtvedt G, Flottorp S, Young JM, Odgaard-Jensen J, French SD, O’Brien MA, Johansen M, Grimshaw J, Oxman AD: Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev 2012., 6CD000259
• [51]Hardeman W, Michie S, Fanshawe T, Prevost AT, McLoughlin K, Kinmonth AL: Fidelity of delivery of a physical activity intervention: predictors and consequences. Psychol Health 2008, 23:11-24.
• [52]McGrath PJ, Stinson J, Davidson K: Commentary: The Journal of Pediatric Psychology should adopt the CONSORT statement as a way of improving the evidence base in pediatric psychology. J Pediatr Psychol 2003, 28:169-171.
• [53]Evans T, Brown H: Road traffic crashes: operationalizing equity in the context of health sector reform. Inj Control Saf Promot 2003, 10:11-12.
• [54]Moore L: Research design for the rigorous evaluation of complex educational interventions: lessons from health services research. Building Research Capacity 2002, 1:4-5.
• [55]Tugwell P, Petticrew M, Kristjansson E, Welch V, Ueffing E, Waters E, Bonnefoy J, Morgan A, Doohan E, Kelly MP: Assessing equity in systematic reviews: realising the recommendations of the Commission on Social Determinants of Health. BMJ 2010, 341:c4739.
• [56]Welch V, Petticrew M, Tugwell P, Moher D, O’Neill J, Waters E, White H, PRISMA-Equity Bellagio group: PRISMA-Equity 2012 extension: reporting guidelines for systematic reviews with a focus on health equity. PLoS Med 2012, 9:e1001333.
• [57]Fixsen DL, Naoom SF, Blase KA, Friedman RM, Wallace F: Implementation research: a synthesis of the literature. Tampa, Florida: University of South Florida; 2005.
• [58]Wang S, Moss JR, Hiller JE: Applicability and transferability of interventions in evidence-based public health. Health Promot Int 2006, 21:76-83.
• [59]Boutron I, Moher D, Altman DG, Schulz KF, Ravaud P, CONSORT Group: Extending the CONSORT Statement to randomized trials of nonpharmacologic treatment: explanation and elaboration. Ann Intern Med 2008, 148:295-309.
• [60]Hopewell S, Clarke M, Moher D, Wager E, Middleton P, Altman DG, Schulz KF, the CONSORT Group: CONSORT for reporting randomised trials in journal and conference abstracts. Lancet 2008, 371:281-283.
• [61]Murphy MK, Black NA, Lamping DL, McKee CM, Sanderson CF, Askham J, Marteau T: Consensus development methods, and their use in clinical guideline development. Health Technol Assess 1998, 2:1-88.
• [62]Moher D, Hopewell S, Schultz KF, Montori V, Gøtzsche PC, Devereaux PJ, Elbourne D, Egger M, Altman DG: CONSORT 2010 Explanation and Elaboration: updated guidelines for reporting parallel group randomised trials. BMJ 2010, 340:c869.
• [63]Michie S, Fixsen D, Grimshaw JM, Eccles MP: Specifying and reporting complex behaviour change interventions: the need for a scientific method. Implement Sci 2009, 4:40. BioMed Central Full Text
• [64]Goldbeck L, Vitiello B: Reporting clinical trials of psychosocial interventions in child and adolescent psychiatry and mental health. Child Adolesc Psychiatry Ment Health 2011, 5:4. BioMed Central Full Text
• [65]von Elm E, Altman DG, Egger M, Pocock SJ, Gotzsche PC, Vandenbroucke JP: The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement: guidelines for reporting observational studies. Ann Intern Med 2007, 147:573-577.
• [66]Des Jarlais DC, Lyles C, Crepaz N, And the TREND Group: Improving the reporting quality of nonrandomized evaluations of behavioral and public health interventions the TREND statement. Am J Public Health 2004, 94:361-366.
• [67]Tong A, Sainsbury P, Craig J: Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. Int J Qual Health Care 2007, 19:349-357.