Computerized adaptive measurement of depression: A simulation study

BMC Psychiatry

Ellen Frank¹  Daniel Buysse¹  Oommen Mammen¹  Kathleen A Pajer²  Kelly J Kelleher²  Katherine Shear¹  William Gardner² 

[1]Psychiatry, Western Psychiatric Institute and University of Pittsburgh, Pittsburgh, PA, USA

[2]Pediatrics, Children's Research Institute and Ohio State University, Columbus, OH, USA

关键词: Tests/Interviews, Psychometrics;    Diagnosis and Classification;    Computers;    Mood Disorders, Unipolar;   

Others  :  1125134
DOI  :  10.1186/1471-244X-4-13

 received in 2003-12-23, accepted in 2004-05-06,  发布年份 2004

【 摘 要 】

Background

Efficient, accurate instruments for measuring depression are increasingly important in clinical practice. We developed a computerized adaptive version of the Beck Depression Inventory (BDI). We examined its efficiency and its usefulness in identifying Major Depressive Episodes (MDE) and in measuring depression severity.

Methods

Subjects were 744 participants in research studies in which each subject completed both the BDI and the SCID. In addition, 285 patients completed the Hamilton Depression Rating Scale.

Results

The adaptive BDI had an AUC as an indicator of a SCID diagnosis of MDE of 88%, equivalent to the full BDI. The adaptive BDI asked fewer questions than the full BDI (5.6 versus 21 items). The adaptive latent depression score correlated r = .92 with the BDI total score and the latent depression score correlated more highly with the Hamilton (r = .74) than the BDI total score did (r = .70).

Conclusions

Adaptive testing for depression may provide greatly increased efficiency without loss of accuracy in identifying MDE or in measuring depression severity.

【 授权许可】

   
2004 Gardner et al; licensee BioMed Central Ltd. This is an Open Access article: verbatim copying and redistribution of this article are permitted in all media for any purpose, provided this notice is preserved along with the article's original URL.

【 图 表 】

Figure 1.

Figure 2.

Figure 3.

【 参考文献 】

• [1]U.S. Preventive Services Task Force: Guide to Clinical Preventive Services. Screening: Depression. [http://www.ahcpr.gov/clinic/uspstf/uspsdepr.htm] webcite 3rd Edition: Periodic Updates edition. Agency for Health Care Research and Quality; 2002., 2002
• [2]Schurman RA, Kramer PD, Mitchell JB: The hidden mental health network. Archives of General Psychiatry 1985, 42:89-94.
• [3]Regier DA, Narrow WE, Rae DS, Manderscheid RW, Locke BZ, Goodwin FK: The de facto US mental and addictive disorders service system: Epidemiologic Catchment Area prospective 1-year prevalence rates of disorders and services. Archives of General Psychiatry 1993, 50:85-94.
• [4]Katon W, Schulberg H: Epidemiology of depression in primary care. General Hospital Psychiatry 1992, 14:237-247.
• [5]Simon GE, VonKorff M: Recognition, management, and outcomes of depression in primary care. Archives of Family Medicine 1995, 4:99-105.
• [6]Schulberg HC, Katon WJ, Simon GE, Rush J: Best clinical practice: Guidelines for managing major depression in primary medical care. Journal of Clinical Psychiatry 1999, 60:19-26.
• [7]Mechanic D, McAlpine DD, Rosenthal M: Are patients' office visits with physicians getting shorter? New England Journal of Medicine 2001, 344:223-225.
• [8]Von Korff M, Gruman J, Schaefer JK, Curry SJ, Wagner EH: Collaborative management of chronic illness. Annals of Internal Medicine 1997, 127:1097-1102.
• [9]Wagner EH, Austin BT, Von Korff M: Improving outcomes in chronic illness. Managed Care Quarterly 1996, 12-25.
• [10]Katon W, Rutter C, Ludman EJ, Von Korff M, Lin E, Simon G, Bush T, Walker E, Unutzer J: A randomized trial of relapse prevention of depression in primary care. Archives of General Psychiatry 2001, 58:241-247.
• [11]Rost K, Nutting P, Smith JL, Elliot CE, Dickinson M: Managing depression as a chronic disease: A randomised trial of ongoing treatment in primary care. British Medical Journal 2002, 325:934-939.
• [12]Beck AT, Steer RA: Manual for the Beck Depression Inventory. San Antonio, TX, Psychological Corporation; 1993.
• [13]Valenstein M, Vijan S, Zeber JE, Boehm K, Buttar A: The cost-utility of screening for depression in primary care. Annals of Internal Medicine 2001, 134:345-360.
• [14]World Health Organization: CIDI-Auto Version 2.1: Administrator's Guide and Reference. Sydney, Training and Reference Centre for WHO CIDI; 1997.
• [15]Peters L, Clark D, Carroll F: Are computerized interviews equivalent to human interviewers? CIDI-Auto versus CIDI in anxiety and depressive disorders. Psychological Medicine 1998, 28:893-901.
• [16]Wainer H: Computerized adaptive testing: A primer. 2nd edition. Hillsdale, NJ, Erlbaum Associates; 2000.
• [17]McHorney CA: Generic health measurement: Past accomplishments and a measurement paradigm for the 21st century. Annals of Internal Medicine 1997, 127:743-750.
• [18]Hays RD, Morales LS, Reise SP: Item Response Theory and health outcomes measurement in the 21st century. Medical Care 2000, 38:II-28-II-42.
• [19]Crocker L, Algina J: Introduction to classical and modern test theory. New York, Holt, Rinehart, & Winston; 1986.
• [20]Leon AC, Kelsey JE, Pleil A, Burgos TL, Potera L, Lowell KN: An evaluation of a computer assisted telephone interview for screening for mental disorders among primary care patients. Journal of Nervous and Mental Diseases 1999, 187:308-311.
• [21]Kobak K, Taylor L, Dottl S, Griest J, Jefferson J, Burroughs D, Mantle J, Katzelnick D, R Norton., Henk J, Serlin R: A computer-administered telephone interview to identify mental disorders. Journal of the American Medical Association 1997, 278:905-910.
• [22]Mead AD, Drasgow F: Equivalence of computerized and paper-and-pencil cognitive ability tests: A meta-analysis. Psychological Bulletin 1993, 114:449-458.
• [23]Millstein SG, Irwin CE: Acceptability of computer-acquired sexual histories in adolescent girls. Journal of Pediatrics 1983, 103:815-819.
• [24]Slack WV, Van Cura LJ: Patient reactions to computer-based medical interviewing. Computers in Biomedical Research 1968, 1:527-531.
• [25]Bagley C, Genuis M: Psychology of computer use: XX. Sexual abuse recalled: Evaluation of a computerized questionnaire in a population of young adult males. Perceptual and Motor Skills 1991, 72:287-288.
• [26]Greist JH, Gustafson DH, Strauss FF, Rowse GL, Laughren TP, Chiles JA: A computer interview for suicide-risk prediction. American Journal of Psychiatry 1973, 130:1327-1332.
• [27]Lucas RW, Mullin PJ, Luna CB, McInroy DC: Psychiatrists and a computer as interrogators of patients with alcohol-related illnesses: A comparison. Br J Psychiatry 1977, 131:160-167.
• [28]Revicki DA, Cella DF: Health status assessment for the twenty-first century: Item response theory, item banking and computerized adaptive testing. Quality of Life Research 1997, 6:595-600.
• [29]Bock RD, Mislevy RJ: Adaptive EAP estimation of ability in a microcomputer environment. Applied Psychological Measurement 1982, 6:431-444.
• [30]First MB, Spitzer RL, Gibbon M, Williams JBW: Structured Clinical Interview for DSM-IV Axis I Disorders (SCID-I). Washington, DC, American Psychiatric Press; 1997.
• [31]Weiss DJ: Adaptive testing by computer. Journal of Consulting and Clinical Psychology 1985, 53:774-789.
• [32]Gardner W, Kelleher KJ, Pajer KA: Multidimensional adaptive testing for mental health problems in primary care. Medical Care 2002, 40:812-823.
• [33]Jellinek MS, Murphy JM, Robinson J, Feins A, Lamb S, Fenton T: Pediatric symptom checklist: Screening school-age children for psychosocial dysfunction. Journal of Pediatrics 1988, 112:201-209.
• [34]Mammen O, Shear MK, Pilkonis PA, Kolko DJ, Thase MA, Greeno C: Anger attacks: Correlates and significance of an underrecognized symptom. Journal of Clinical Psychiatry 1999, 60:633-642.
• [35]Hamilton M: Development of a rating scale for primary depressive illness. British Journal of Social and Clinical Psychology 1967, 6:278-296.
• [36]Embretson SE, Reise SP: Item response theory for psychologists. Mahwah, NJ, Lawrence Erlbaum; 2000.
• [37]Hambleton RK, Swaminathan H, Rogers HJ: Fundamentals of item response theory. Newbury Park, CA, Sage; 1991.
• [38]van der Linden W, Hambleton RK: Handbook of modern item response theory. New York, Springer Verlag; 1997.
• [39]Efron B: Estimating the error rate of a prediction rule: Improvements on cross-validation. Journal of the American Statistical Association 1983, 78:316-331.
• [40]Efron B: The jackknife, the bootstrap, and other resampling plans. Philadelphia, SIAM; 1982.
• [41]Dodd BG, De Ayala RJ, Koch WR: Computerized adaptive testing with polytomous items. Applied Psychological Measurement 1995, 19:5-22.
• [42]Hambleton RK, Swaminathan H: Item response theory: Principles and applications. Boston, Kluwer-Nijhof; 1985.
• [43]Muthén BO: A general structural equation model with dichotomous, ordered categorical, and continuous latent variable indicators. Psychometrika 1984, 49:115-132.
• [44]Muthén LK, Muthén BO: Mplus user's guide. Los Angeles, CA, Muthen & Muthen; 1998.
• [45]Clark DC, vonAmmon Cavansugh S, Gibbons RD: The core symptoms of depression in medical and psychiatric patients. J Nerv & Ment Dis 1983, 171:705-713.
• [46]Gibbons RD, Clark DC, Cavanaugh S, Davis JM: Application of modern psychometric theory in psychiatric research. Journal of Psychiatric Research 1985, 19:43-55.
• [47]Tanaka Jeffrey S, Huba George J: Confirmatory hierarchical factor analyses of psychological distress measures. Journal of Personality & Social Psychology 1984, 46:621-635.
• [48]Tanaka Jeffrey S, Huba George J: Structures of psychological distress: Testing confirmatory hierarchical models. Journal of Consulting & Clinical Psychology 1984, 52:719-721.
• [49]Muraki E: Fitting a polytomous item response model to Likert-type data. Applied Psychological Measurement 1990, 14:59-71.
• [50]Muraki E, Bock RD: PARSCALE: IRT item analysis and test-scoring for rating-scale data. Chicago, Scientific Software International; 1997.
• [51]Kraemer HC: Evaluating medical tests: Objective and quantitative guidelines. Newbury Park, CA, Sage Publications; 1992.
• [52]Cohen J: A coefficient of agreement for nominal scales. Educational and Psychological Measurement 1960, 20:37-46.
• [53]Meng X-L, Rosenthal R, Rubin DB: Comparing correlated correlation coefficients. Psychological Bulletin 1992, 111:172-175.