The development and evaluation of a five-language multi-perspective standardised measure: clinical decision-making involvement and satisfaction (CDIS)

BMC Health Services Research

Bernd Puschner³  Wolfram Kawohl¹  Wulf Rössler¹  Helle Østermark Sørensen⁴  Malene Krogsgaard Bording⁴  Marietta Nagy²  Anikó Égerházi²  Mario Luciano⁵  Domenico Giacco⁵  Andrea Fiorillo⁵  Katrin Arnold³  Helena Kaliniecka⁶  Paul Williams⁶  Eleanor Clarke⁶  Harriet Jordan⁶  Mike Slade⁶ 

[1] Department of General and Social Psychiatry, University of Zurich, Militärstrasse 8, Zurich 8021, Switzerland;Medical and Health Science Center, Department of Psychiatry, University of Debrecen, Nagyerdei krt. 98, Debrecen 4012, Hungary;Department of Psychiatry and Psychotherapy II, Section Process-Outcome Research, Ulm University, Ludwig-Heilmeyer-Str. 2, Günzburg 89312, Germany;Unit for Psychiatric Research, Aalborg Psychiatric Hospital, Aarhus University Hospital, Mølleparkvej 10, Aalborg 9000, Denmark;Department of Psychiatry, University of Naples SUN, Largo Madonna delle Grazie, Naples 80138, Italy;Section for Recovery (Box P029), Institute of Psychiatry, King’s College London, De Crespigny Park, London SE5 8AF, UK

关键词: Recovery;    Patient reported outcome measure;    Translation;    Psychometric;    Mental health;    Satisfaction;    Involvement;    Clinical decision-making;   

Others  :  1126915
DOI  :  10.1186/1472-6963-14-323

 received in 2012-10-05, accepted in 2014-04-15,  发布年份 2014

【 摘 要 】

Background

The aim of this study was to develop and evaluate a brief quantitative five-language measure of involvement and satisfaction in clinical decision-making (CDIS) – with versions for patients (CDIS-P) and staff (CDIS-S) – for use in mental health services.

Methods

An English CDIS was developed by reviewing existing measures, focus groups, semistructured interviews and piloting. Translations into Danish, German, Hungarian and Italian followed the International Society for Pharmacoeconomics and Outcomes Research (ISPOR) Task Force principles of good practice for translation and cultural adaptation. Psychometricevaluation involved testing the measure in secondary mental health services in Aalborg, Debrecen, London, Naples, Ulm and Zurich.

Results

After appraising 14 measures, the Control Preference Scale and Satisfaction With Decision-making English-language scales were modified and evaluated in interviews (n = 9), focus groups (n = 22) and piloting (n = 16). Translations were validated through focus groups (n = 38) and piloting (n = 61). A total of 443 service users and 403 paired staff completed CDIS. The Satisfaction sub-scale had internal consistency of 0.89 (0.86-0.89 after item-level deletion) for staff and 0.90 (0.87-0.90) for service users, both continuous and categorical (utility) versions were associated with symptomatology and both staff-rated and service userrated therapeutic alliance (showing convergent validity), and not with social disability (showing divergent validity), and satisfaction predicted staff-rated (OR 2.43, 95%CI 1.54- 3.83 continuous, OR 5.77, 95%CI 1.90-17.53 utility) and service user-rated (OR 2.21, 95%CI 1.51-3.23 continuous, OR 3.13, 95%CI 1.10-8.94 utility) decision implementation two months later. The Involvement sub-scale had appropriate distribution and no floor or ceiling effects, was associated with stage of recovery, functioning and quality of life (staff only) (showing convergent validity), and not with symptomatology or social disability (showing divergent validity), and staff-rated passive involvement by the service user predicted implementation (OR 3.55, 95%CI 1.53-8.24). Relationships remained after adjusting for clustering by staff.

Conclusions

CDIS demonstrates adequate internal consistency, no evidence of item redundancy, appropriate distribution, and face, content, convergent, divergent and predictive validity. It can be recommended for research and clinical use. CDIS-P and CDIS-S in all 3 five languages can be downloaded at http://www.cedar-net.eu/instruments webcite.

Trial registration

ISRCTN75841675.

【 授权许可】

   
2014 Slade et al.; licensee BioMed Central Ltd.

【 参考文献 】

• [1]Karnieli-Miller O, Eisikovits Z: Physician as partner or salesman? Shared decision-making in real-time encounters. Soc Sci Med 2009, 69(1):1-8.
• [2]Puschner B, Steffen S, Slade M, Kaliniecka H, Maj M, Fiorillo A, Munk-Jorgensen P, Larsen JI, Egerhazi A, Nemes Z, Rossler W, Kawohl W, Becker T: Clinical decision making and outcome in routine care for people with severe mental illness (CEDAR): study protocol. BMC Psychiatry 2010, 10:90.
• [3]Goossensen A, Zijlstra P, Koopmanschap M: Measuring shared decision making processes in psychiatry: skills versus patient satisfaction. Patient Educ Couns 2007, 67(1–2):50-56.
• [4]Wakefield P, Read S, Firth W, Lindesay J: Clients’ perceptions of outcome following contact with a community mental health team. J Ment Health 1998, 7(4):375-384.
• [5]Hamann J, Leucht S, Kissling W: Shared decision making in psychiatry. Acta Psychiatr 2003, 107:403-409.
• [6]Edwards A, Elwyn G (Eds): Shared Decision-Making in Health Care. 2nd edition. Oxford: Oxford University Press; 2009.
• [7]Hamann J, Langer B, Winkler V, Busch R, Cohen R, Leucht S, Kissling W: Shared decision making for in-patients with schizophrenia. Acta Psychiatr Scand 2006, 114(4):265-273.
• [8]Charles C, Gafni A, Whelan T: Shared decision-making in the medical encounter: what does it mean? (or it takes at least two to tango). Soc Sci Med 1997, 44(5):681-692.
• [9]National Institute for Health and Clinical Excellence: Service User Experience in Adult Mental Health: Improving the Experience of Care for People Using Adult NHS Mental Health Services. London: National Institute for Health and Clinical Excellence; 2011. [CG136]
• [10]Duncan E, Best C, Hagen S: Shared decision making interventions for people with mental health conditions. Cochrane Database Syst Rev 2010, 1:CD007297.
• [11]McCabe R, Heath C, Burns T, Priebe S: Engagement of patients with psychosis in the consultation. BMJ 2002, 325:1148-1151.
• [12]Le Boutillier C, Leamy M, Bird VJ, Davidson L, Williams J, Slade M: What does recovery mean in practice? A qualitative analysis of international recovery-oriented practice guidance. Psychiatr Serv 2011, 62:1470-1476.
• [13]Bird V, Leamy M, Le Boutillier C, Williams J, Slade M: REFOCUS: Promoting Recovery in Community Mental Health Services. London: Rethink (researchintorecovery.com/refocus); 2011.
• [14]Seale C, Chaplin R, Lelliott P, Quirk A: Sharing decisions in consultations involving anti-psychotic medication: a qualitative study of psychiatrists’ experiences. Soc Sci Med 2006, 62(11):2861-2873.
• [15]Junghan UM, Leese M, Priebe S, Slade M: Staff and patient perspectives on unmet need and therapeutic alliance in community mental health services. Br J Psychiatry 2007, 191:543-547.
• [16]Melbourne E, Sinclair K, Durand M-A, Legare F, Elwyn G: Developing a dyadic OPTION scale to measure perceptions of shared decision making. Patient Educ Couns 2010, 78(2):177-183.
• [17]Attkisson CC, Zwick R: The client satisfaction questionnaire. Psychometric properties and correlations with service utilization and psychotherapy outcome. Eval Program Plann 1982, 5(3):233-237.
• [18]Ruggeri M, Lasalvia A, Dall’Agnola R, van Wijngaarden B, Knudsen HC, Leese M, Gaite L, Tansella M: Development, internal consistency and reliability of the Verona Service Satisfaction Scale–European Version. EPSILON Study 7. European Psychiatric Services: inputs linked to outcome domains and needs. Br J Psychiatry Suppl 2000, 39:s41-s48.
• [19]Scholl I, Koelewijn-van Loon M, Sepucha K, Elwyn G, Legare F, Harter M, Dirmaier J: Measurement of shared decision making – a review of instruments. Z Arztl Fortbild Qual Gesundhwes 2011, 105:313-324.
• [20]Shepherd A, Shorthouse O, Gask L: Consultant psychiatrists’ experiences of and attitudes towards shared decision making in antipsychotic prescribing, a qualitative study. BMC Psychiatry 2014, 14:127.
• [21]Macpherson R, Varah M, Summerfield L, Foy C, Slade M: Staff and patient assessments of need in an epidemiologically representative sample of patients with psychosis. Soc Psychiatry Psychiatr Epidemiol 2003, 38(11):662-667.
• [22]Slade M, Phelan M, Thornicroft G: A comparison of needs assessed by staff and by an epidemiologically representative sample of patients with psychosis. Psychol Med 1998, 28(3):543-550.
• [23]Wild D, Grove A, Martin M, Eremenco S, McElroy S, Verjee-Lorenz A, Erikson P: Principles of good practice for the translation and cultural adaptation process for patient-reported outcomes (PRO) measures: report of the ISPOR task force for translation and cultural adaptation. Value Health 2005, 8(2):94-104.
• [24]First MS R, Gibbon M, Williams J: Structured Clinical Interviews for DSM-IV Axis I Disorders - Clinical Version (SCID-CV). Washington DC: American Psychiatric Association; 1997.
• [25]Slade M, Powell R, Rosen A, Strathdee G: Threshold Assessment Grid (TAG): the development of a valid and brief scale to assess the severity of mental illness. Soc Psychiatry Psychiatr Epidemiol 2000, 35(2):78-85.
• [26]Slade M, Cahill S, Kelsey W, Powell R, Strathdee G: Threshold 2: the reliability, validity and sensitivity to change of the Threshold Assessment Grid (TAG). Acta Psychiatr Scand 2002, 106(6):453-460.
• [27]Slade M, Cahill S, Kelsey W, Powell R, Strathdee G, Valiakalayil A: Threshold 3: the feasibility of the Threshold Assessment Grid (TAG) for routine assessment of the severity of mental health problems. Soc Psychiatry Psychiatr Epidemiol 2001, 36(10):516-521.
• [28]Slade M, Cahill S, Kelsey W, Leese M, Powell R, Strathdee G: Threshold 4: an evaluation of the threshold assessment grid as an aid to mental health referrals. Prim Care Mental Health 2003, 1:45-54.
• [29]Slade M, Thornicroft G, Glover G: The feasibility of routine outcome measures in mental health. Soc Psychiatry Psychiatr Epidemiol 1999, 34(5):243-249.
• [30]Watts D, Bindman J, Slade M, Holloway F, Rosen A, Thornicroft G: Clinical Assessment of Risk Decision Support (CARDS): the development and evaluation of a feasible violence risk assessment for routine psychiatric practice. J Ment Health 2004, 13:569-581.
• [31]Wolstencoft K, Oades L, Caputi P, Andresen R: Development of a structured interview schedule to assess stage of psychological recovery from enduring mental illness. Int J Psychiatry Clin Pract 2010, 14:182-189.
• [32]Association AP: Diagnostic and Statistical Manual of Mental Disorders (4th edn.). Washington DC: American Psychiatric Association; 1994.
• [33]Wing JK, Beevor AS, Curtis RH, Park SB, Hadden S, Burns A: Health of the Nation Outcome Scales (HoNOS). Research and development. Br J Psychiatry 1998, 172:11-18.
• [34]Priebe S, Gruyters T: The role of the helping alliance in psychiatric community care: a prospective study. J Nerv Ment Dis 1993, 181:552-557.
• [35]Lambert MJ, Burlingame GM, Umphress V, Hansen NB, Vermeersch DA, Clouse GC, Yanchar SC: The reliability and validity of the outcome questionnaire. Clin Psychol Psychother 1996, 3(4):249-258.
• [36]Priebe S, Huxley P, Knight S, Evans S: Application and results of the manchester short assessment of quality of life (MANSA). Int J Soc Psychiatry 1999, 45:7-12.
• [37]Andresen R, Caputi P, Oades L: The stages of recovery instrument: development of a measure of recovery from serious mental illness. Aust N Z J Psychiatry 2006, 40:972-980.
• [38]Weeks G, Slade M, Hayward M: A UK validation of the stages of recovery instrument. Int J Soc Psychiatry 2011, 57:446-454.
• [39]Gale C, Mullen R, Patterson T: Letter. Int J Soc Psychiatry 2011, 58:449-450.
• [40]Grant MJ, Booth A: A typology of reviews: an analysis of 14 review types and associated methodologies. Health Info Libr J 2009, 26(2):91-108.
• [41]Bradley JG, Zia MJ, Hamilton N: Patient preferences for control in medical decision making: a scenario-based approach. Fam Med 1996, 28(7):496-501.
• [42]Degner LFS JA: Decision-making during serious illness - what role do patients really want to play? J Clin Epidemiol 1992, 45:941-950.
• [43]Martin LR, DiMatteo MR, Lepper HS: Facilitation of patient involvement in care: development and validation of a scale. Behav Med 2001, 27(3):111-120.
• [44]Golin CE, DiMatteo MR, Leake B, Duan N, Gelberg L: A diabetes-specific measure of patient desire to participate in medical decision making. Diabetes Educ 2001, 27(6):875-886.
• [45]Cranney A, O’Connor AM, Jacobsen MJ, Tugwell P, Adachi JD, Ooi DS, Waldegger L, Goldstein R, Wells GA: Development and pilot testing of a decision aid for postmenopausal women with osteoporosis. Patient Educ Couns 2002, 47(3):245-255.
• [46]Holmes-Rovner M, Kroll J, Schmitt N, Rovner DR, Breer ML, Rothert ML, Padonu G, Talarczyk G: Patient satisfaction with health care decisions: the satisfaction with decision scale. Med Decis Making 1996, 16(1):58-64.
• [47]O’Connor AM: Validation of a decisional conflict scale. Med Decis Making 1995, 15(1):25-30.
• [48]Ende J, Kazis L, Ash A, Moskowitz MA: Measuring patients’ desire for autonomy: decision making and information-seeking preferences among medical patients. J Gen Intern Med 1989, 4(1):23-30.
• [49]Loos S, Neumann P, Arnold K, Slade M, Fiorillo A, Frøkjær Krogsgaard Bording M, Ivanka T, Kawohl W, Puschner B: Gemeinsame Entscheidungsfindung in der Behandlung von Patienten mit schweren psychischen Erkrankungen: Eine Fokusgruppen-Untersuchung [Shared decision-making in the treatment of people with severe mental illness: a focus group study]. Psychiatr Prax 2013, 40:23-29.
• [50]Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, Bouter LM, de Vet HC: Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol 2007, 60(1):34-42.
• [51]Grogan S, Conner M, Willits D, Norman P: Development of a questionnaire to measure patients’ satisfaction with general practitioners’ services. Br J Gen Pract 1995, 45(399):525-529.
• [52]Larsen DL, Attkisson CC, Hargreaves WA, Nguyen TD: Assessment of client/patient satisfaction: development of a general scale. Eval Program Plann 1979, 2(3):197-207.
• [53]Meakin R, Weinman J: The “Medical Interview Satisfaction Scale” (MISS-21) adapted for British general practice. Fam Pract 2002, 19(3):257-263.
• [54]Ahlfors UG, Lewander T, Lindstrom E, Malt UF, Lublin H, Malm U: Assessment of patient satisfaction with psychiatric care - development and clinical evaluation of a brief consumer satisfaction rating scale (UKU-ConSat). Nordic J Psychiatry 2001, 55:71-90.
• [55]Horvath AO, Greenberg LS: Development and validation of the working alliance inventory. J Couns Psychol 1989, 36(2):223-233.
• [56]Elwyn G, Hutchings H, Edwards A, Rapport F, Wensing M, Cheung WY, Grol R: The OPTION scale: measuring the extent that clinicians involve patients in decision-making tasks. Health Expect 2005, 8(1):34-42.
• [57]O’Neal EL, Adams JR, McHugo GJ, Van Citters AD, Drake RE, Bartels SJ: Preferences of older and younger adults with serious mental illness for involvement in decision-making in medical and psychiatric settings. Am J Geriatr Psychiatry 2008, 16(10):826-833.
• [58]Mahone IH: Shared decision making and serious mental illness. Arch Psychiatr Nurs 2008, 22(6):334-343.
• [59]Wills CE, Holmes-Rovner M: Preliminary validation of the satisfaction with decision scale with depressed primary care patients. Health Expect 2003, 6(2):149-159.
• [60]Simon D, Loh A, Harter M: Measuring (shared) decision-making - a review of psychometric instruments. Z Arztl Fortbild Qual Gesundhwes 2007, 101:259-267.
• [61]Goss C, Moretti F, Mazzi MA, Del Piccolo L, Rimondini M, Zimmermann C: Involving patients in decisions during psychiatric consultations. Br J Psychiatry 2008, 193(5):416-421.
• [62]Valenstein M, Mitchinson A, Ronis DL, Alexander JA, Duffy SA, Craig TJ, Barry KL: Quality indicators and monitoring of mental health services: what Do frontline providers think? AJ Psychiatry 2004, 161:146-153.
• [63]Couture S, Roberts D, Penn D, Cather C, Otto M, Goff D: Do baseline client characteristics predict the therapeutic alliance in the treatment of schizophrenia? J Nerv Ment Dis 2006, 194:10-14.
• [64]Garner B, Godley S, Funk R: Predictors of early therapeutic alliance among adolescents in Substance abuse treatment. J Psychoactive Drugs 2008, 40:55-65.
• [65]Lysaker P, Davis L, Buck K, Outcalt S, Ringer J: Negative symptoms and poor insight as predictors of the similarity between client and therapist ratings of therapeutic alliance in cognitive behavior therapy for patients with schizophrenia. J Nerv Ment Dis 2011, 199:191-195.
• [66]McCabe R, Priebe S: Are therapeutic relationships in psychiatry explained by patients’ symptoms? Factors influencing patient ratings. Eur Psychiatry 2003, 18:220-225.
• [67]McCabe R, Priebe S: The therapeutic relationship in the treatment of severe mental illness: a review of methods and findings. Int J Soc Psychiatry 2004, 50:115-128.
• [68]Wittorf A, Jakobi U, Bechdolf A, Müller B, Sartory G, Wagner M, Wiedemann G, Wölwer W, Herrlich J, Buchkremer G, Klingberg S: The influence of baseline symptoms and insight on the therapeutic alliance early in the treatment of schizophrenia. Eur Psychiatry 2009, 24:259-267.
• [69]Brown S, Evans Y, Espenschade K, O’Connor M: An examination of two brief stigma reduction strategies: Filmed personal contact and hallucination simulations. Community Ment Health J 2010, 46:494-499.
• [70]Moher D, Schulz KF, Simera I, Altman DG: Guidance for developers of health research reporting guidelines. PLoS Med 2010, 7(2):e1000217.
• [71]Crumlish N, Kelly B: How psychiatrists think. Adv Psychiatr Treat 2009, 15:72-79.
• [72]Puschner B, Neumann P, Jordan H, Slade M, Fiorillo A, Giacco D, Egerhazi A, Ivanka T, Bording MK, Sorensen HO, Bar A, Kawohl W, Loos S, Arnold K, Ay E, Becker T, Konrad J, Steffen S, Zentner N, Clarke E, Maj M, Luciano M, De Rosa C, Sampogna G, Del Vecchio V, Cozzolino P, Del Vecchio HG, Salzano A, Nagy M, Cs group, et al.: Development and psychometric properties of a five-language multiperspective instrument to assess clinical decision making style in the treatment of people with severe mental illness (CDMS). BMC Psychiatry 2013, 13:48.
• [73]Matthias MS, Salyers MP, Rollins AL, Frankel RM: Decision making in recovery-oriented mental health care. Psychiatr Rehabil J 2012, 35(4):305-314.
• [74]Deegan P, Rapp C, Holter M, Riefer M: A program to support shared decision making in an outpatient psychiatric medication clinic. Psychiatr Serv 2008, 59:603-605.
• [75]Gilburt H, Rose D, Slade M: The importance of relationships in mental health care: a qualitative study of service users’ experiences of psychiatric hospital admission in the UK. BMC Health Serv Res 2008, 8:92.
• [76]Leamy M, Bird V, Le Boutillier C, Williams J, Slade M: A conceptual framework for personal recovery in mental health: systematic review and narrative synthesis. Br J Psychiatry 2011, 199:445-452.