Reference values for generic instruments used in routine outcome monitoring: the leiden routine outcome monitoring study

BMC Psychiatry

Erik J Giltay²  Martijn S van Noorden²  Margot WM de Waal¹  Albert M van Hemert²  Frans G Zitman²  Ingrid VE Carlier²  Yvonne WM Schulte-van Maaren² 

[1] Department of Public Health and Primary Care, Leiden University Medical Center, Leiden, The Netherlands;Department of Psychiatry, Leiden University Medical Center, P.O. Box 9600, Leiden, RC, 2300, The Netherlands

关键词: Somatoform disorders;    Anxiety disorders;    Mood disorders;    Questionnaires;    Routine outcome monitoring;    Reference values;   

Others  :  1124229
DOI  :  10.1186/1471-244X-12-203

 received in 2012-04-19, accepted in 2012-10-31,  发布年份 2012

【 摘 要 】

Introduction

The Brief Symptom Inventory (BSI), Mood & Anxiety Symptom Questionnaire −30 (MASQ-D30), Short Form Health Survey 36 (SF-36), and Dimensional Assessment of Personality Pathology-Short Form (DAPP-SF) are generic instruments that can be used in Routine Outcome Monitoring (ROM) of patients with common mental disorders. We aimed to generate reference values usually encountered in 'healthy' and ‘psychiatrically ill’ populations to facilitate correct interpretation of ROM results.

Methods

We included the following specific reference populations: 1294 subjects from the general population (ROM reference group) recruited through general practitioners, and 5269 psychiatric outpatients diagnosed with mood, anxiety, or somatoform (MAS) disorders (ROM patient group). The outermost 5% of observations were used to define limits for one-sided reference intervals (95^th percentiles for BSI, MASQ-D30 and DAPP-SF, and 5^th percentiles for SF-36 subscales). Internal consistency and Receiver Operating Characteristics (ROC) analyses were performed.

Results

Mean age for the ROM reference group was 40.3 years (SD=12.6) and 37.7 years (SD=12.0) for the ROM patient group. The proportion of females was 62.8% and 64.6%, respectively. The mean for cut-off values of healthy individuals was 0.82 for the BSI subscales, 23 for the three MASQ-D30 subscales, 45 for the SF-36 subscales, and 3.1 for the DAPP-SF subscales. Discriminative power of the BSI, MASQ-D30 and SF-36 was good, but it was poor for the DAPP-SF. For all instruments, the internal consistency of the subscales ranged from adequate to excellent.

Discussion and conclusion

Reference values for the clinical interpretation were provided for the BSI, MASQ-D30, SF-36, and DAPP-SF. Clinical information aided by ROM data may represent the best means to appraise the clinical state of psychiatric outpatients.

【 授权许可】

   
2012 Schulte-van Maaren et al.; licensee BioMed Central Ltd.

【 图 表 】

Figure 1.

【 参考文献 】

• [1]De Beurs E, Den Hollander-Gijsman ME, Van Rood YR, Van der Wee NJ, Giltay EJ, Van Noorden MS, Van der Lem R, Van Fenema E, Zitman FG: Routine outcome monitoring in the Netherlands: practical experiences with a web-based strategy for the assessment of treatment outcome in clinical practice. Clin Psychol Psychother 2011, 18:1-12.
• [2]Solberg HE, Grasbeck R: Reference values. Adv Clin Chem 1989, 27:1-79.
• [3]Solberg HE: Establishment and use of reference values. In Fundamentals of clinical chemistry. 6 edition. Edited by Burtis CA, Ashwood ER, Bruns DE. St. Louis, Missouri: Saunders Elsevier; 2008:229-238.
• [4]Geffre A, Friedrichs K, Harr K, Concordet D, Trumel C, Braun JP: Reference values: a review. Vet Clin Pathol 2009, 38:288-298.
• [5]Katayev A, Balciza C, Seccombe DW: Establishing reference intervals for clinical laboratory test results: is there a better way? Am J Clin Pathol 2010, 133:180-186.
• [6]Sasse EA, Doumas BT, Miller WG, D'Orazio P, Eckfeldt JH, Evans SA, Graham GA, Myers GL, Parsons PJ, Stanton NV: How to define and determine reference intervals in the clinical laboratory; approved guideline-Second edition. NCCLS document C28-A2. Wayne, PA: NCCLS; 2000.
• [7]Kendall PC, Marrs-Garcia A, Nath SR, Sheldrick RC: Normative comparisons for the evaluation of clinical significance. J Consult Clin Psychol 1999, 67:285-299.
• [8]Horn PS, Feng L, Li Y, Pesce AJ: Effect of outliers and nonhealthy individuals on reference interval estimation. Clin Chem 2001, 47:2137-2145.
• [9]Reed AH, Henry RJ, Mason WB: Influence of statistical method used on the resulting estimate of normal range. Clin Chem 1971, 17:275-284.
• [10]Fan J, Upadhye S, Worster A: Understanding receiver operating characteristic (ROC) curves. CJEM 2006, 8:19-20.
• [11]De Beurs E, Zitman FG: De Brief Symptom Inventory (BSI): De betrouwbaarheid en validiteit van een handzaam alternatief voor de SCL-90. [The Brief Symptom Inventory (BSI): The reliability and validity of a brief alternative of the SCL-90]. Maandblad Geestelijke Volksgezondheid 2006, 61:120-141.
• [12]DeRogatis LR: The Brief Symptom Inventory. Baltimore: MD., Clinical Psychometric Research; 1975.
• [13]Clark LA, Watson D: Tripartite model of anxiety and depression: psychometric evidence and taxonomic implications. J Abnorm Psychol 1991, 100:316-336.
• [14]Wardenaar KJ, Van Veen T, Giltay EJ, De Beurs E, Penninx BW, Zitman FG: Development and validation of a 30-item short adaptation of the Mood and Anxiety Symptoms Questionnaire (MASQ). Psychiatry Res 2010, 179:101-106.
• [15]Aaronson NK, Muller M, Cohen PDA, Essink-Bot ML, Fekkes M, Sanderman R, Sprangers MAG, Velde AT, Verrips E: Translation, validation, and norming of the Dutch language version of the SF-36 Health Survey in community and chronic disease populations. J Clin Epidemiol 1998, 51:1055-1068.
• [16]Ware JE, Snow KK, Kosinski M, Gandek B: SF-36 Health Survey Manual and Interpretation Guide. Boston: New England Medical Center, The Health Institute; 1993.
• [17]Livesley WJ, Jackson DN: Manual for the dimensional assessment of personality pathology - basic questionnaire (DAPP-BQ). Port Huron: Sigma Press; 2002.
• [18]Van Kampen D, De Beurs E, Andrea H: A short form of the Dimensional Assessment of Personality Pathology-Basic Questionnaire (DAPP-BQ): the DAPP-SF. Psychiatry Res 2008, 160:115-128.
• [19]DeRogatis LR, Melisaratos N: The Brief Symptom Inventory: an introductory report. Psychol Med 1983, 13:595-605.
• [20]Ware JE Jr, Gandek B: Overview of the SF-36 Health Survey and the International Quality of Life Assessment (IQOLA) Project. J Clin Epidemiol 1998, 51:903-912.
• [21]Jenkinson C, Coulter A, Wright L: Short form 36 (SF36) health survey questionnaire: normative data for adults of working age. BMJ 1993, 306:1437-1440.
• [22]Loge JH, Kaasa S: Short form 36 (SF-36) health survey: normative data from the general Norwegian population. Scand J Soc Med 1998, 26:250-258.
• [23]De Beurs E, Rinne T, Van Kampen D, Verheul R, Andrea H: Reliability and validity of the Dutch Dimensional Assessment of Personality Pathology-Short Form (DAPP-SF), a shortened version of the DAPP-Basic Questionnaire. J Pers Disord 2009, 23:308-326.
• [24]Tiemensma J, Biermasz NR, Middelkoop HA, van der Mast RC, Romijn JA, Pereira AM: Increased prevalence of psychopathology and maladaptive personality traits after long-term cure of Cushing's disease. J Clin Endocrinol Metab 2010, 95:E129-E141.
• [25]Bowling A, Bond M, Jenkinson C, Lamping DL: Short Form 36 (SF-36) Health Survey questionnaire: which normative data should be used? Comparisons between the norms provided by the Omnibus Survey in Britain, the Health Survey for England and the Oxford Healthy Life Survey. J Public Health Med 1999, 21:255-270.
• [26]Schulte-van Maaren YWM, Carlier IV, Giltay EJ, Van Noorden MS, De Waal MW, Van der Wee NJ, Zitman FG: Reference values for mental health assessment instruments: objectives and methods of the Leiden Routine Outcome Monitoring Study. J Eval Clin Pract 2012. [Epub ahead of print]
• [27]Van Noorden MS, Giltay EJ, Den Hollander-Gijsman ME, Van der Wee NJ, Van Veen T, Zitman FG: Gender differences in clinical characteristics in a naturalistic sample of depressive outpatients: the Leiden Routine Outcome Monitoring Study. J Affect Disord 2010, 125:116-123.
• [28]Poortvliet MC, Lamkadden M, Deville W: Niet op naam ingeschreven (NONI) bij de huisarts. Inventarisatie en gevolgen voor de ziekenfondsverzekerden. Utrecht: NIVEL; 2005. http://www.nivel.nl/pdf/Niet-op-naam-ingeschreven-(NONI)-bij-de-huisarts-2005.pdf webcite
• [29]Carlier IV, Meuldijk D, Van Vliet IM, Van Fenema E, Van der Wee NJ, Zitman FG: Routine outcome monitoring and feedback on physical or mental health status: evidence and theory. J Eval Clin Pract 2012, 18:104-110.
• [30]Sheehan DV, Lecrubier Y, Sheehan KH, Amorim P, Janavs J, Weiller E, Hergueta T, Baker R, Dunbar GC: The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry 1998, 59(20):22-33.
• [31]Van Vliet IM, De Beurs E: The MINI-International Neuropsychiatric Interview. A brief structured diagnostic psychiatric interview for DSM-IV en ICD-10 psychiatric disorders. Tijdschr Psychiatr 2007, 49:393-397.
• [32]Barnabei L, Marazia S, De Caterina R: Receiver operating characteristic (ROC) curves and the definition of threshold levels to diagnose coronary artery disease on electrocardiographic stress testing. Part I: The use of ROC curves in diagnostic medicine and electrocardiographic markers of ischaemia. J Cardiovasc Med (Hagerstown) 2007, 8:873-881.
• [33]Ware JE Jr, Gandek B: Methods for testing data quality, scaling assumptions, and reliability: the IQOLA Project approach. International Quality of Life Assessment. J Clin Epidemiol 1998, 51:945-952.
• [34]Gandek B, Ware JE Jr: Methods for validating and norming translations of health status questionnaires: the IQOLA Project approach. International Quality of Life Assessment. J Clin Epidemiol 1998, 51:953-959.
• [35]Apolone G, Mosconi P: The Italian SF-36 Health Survey: translation, validation and norming. J Clin Epidemiol 1998, 51:1025-1036.
• [36]Hammerlid E, Taft C: Health-related quality of life in long-term head and neck cancer survivors: a comparison with general population norms. Br J Cancer 2001, 84:149-156.
• [37]Razavi D, Gandek B: Testing Dutch and French translations of the SF-36 Health Survey among Belgian angina patients. J Clin Epidemiol 1998, 51:975-981.
• [38]Demiral Y, Ergor G, Unal B, Semin S, Akvardar Y, Kivircik B, Alptekin K: Normative data and discriminative properties of short form 36 (SF-36) in Turkish urban population. BMC Public Health 2006, 6:247. BioMed Central Full Text
• [39]Marazia S, Barnabei L, De Caterina R: Receiver operating characteristic (ROC) curves and the definition of threshold levels to diagnose coronary artery disease on electrocardiographic stress testing. Part II: the use of ROC curves in the choice of electrocardiographic stress test markers of ischaemia. J Cardiovasc Med (Hagerstown) 2008, 9:22-31.
• [40]Zimmerman M, Chelminski I, Posternak M: A review of studies of the Montgomery-Asberg Depression Rating Scale in controls: implications for the definition of remission in treatment studies of depression. Int Clin Psychopharmacol 2004, 19:1-7.
• [41]Tromp NB, Koot HM: Self- and parent report of adolescent personality pathology: informant agreement and relations to dysfunction. J Pers Disord 2010, 24:151-170.
• [42]Hirschfeld RM, Klerman GL, Clayton PJ, Keller MB, McDonald-Scott P, Larkin BH: Assessing personality: effects of the depressive state on trait measurement. Am J Psychiatry 1983, 140:695-699.
• [43]Zimmerman M, Coryell WH: Diagnosing personality disorders in the community. A comparison of self-report and interview measures. Arch Gen Psychiatry 1990, 47:527-531.