Patient reports of health outcome for adults living with sickle cell disease: development and testing of the ASCQ-Me item banks

Health and Quality of Life Outcomes

Kathryn L Hassell⁴  Ellen M Werner²  Marsha J Treadwell¹  Manshu Yang³  San D Keller³ 

[1]Children’s Hospital & Research Center Oakland, 747 52nd Street, Oakland 94609, CA, USA

[2]The National Heart Lung and Blood Institute, 6701 Rockledge Drive MSC 7950, Bethesda 20892-7950, MD, USA

[3]Department of Health Policy and Research, Quality and Performance Measurement Program, American Institutes for Research, 100 Europa Drive, Suite 315, Chapel Hill 27517-2357, NC, USA

[4]Division of Hematology, University of Colorado, 12700 E. 19th Avenue, Rm 9122, RC 2/MS B170, Aurora 80045, CO, USA

关键词: Validity(up to 10 allowed);    Sickle cell disease;    PROs;    Patient-reported outcomes;    IRT;    Item response theory;    CAT;    Computer adaptive testing;    ASCQ-Me;   

Others  :  1164536
DOI  :  10.1186/s12955-014-0125-0

 received in 2013-12-23, accepted in 2014-08-05,  发布年份 2014

【 摘 要 】

Background

Providers and patients have called for improved understanding of the health care requirements of adults with sickle cell disease (SCD) and have identified the need for a systematic, reliable and valid method to document the patient-reported outcomes (PRO) of adult SCD care. To address this need, the Adult Sickle Cell Quality of Life Measurement System (ASCQ-Me) was designed to complement the Patient Reported Outcome Measurement Information System (PROMIS®). Here we describe methods and results of the psychometric evaluation of ASCQ-Me item banks (IBs).

Methods

At seven geographically-disbursed clinics within the US, 556 patients responded to questions generated to assess cognitive, emotional, physical and social impacts of SCD. We evaluated the construct validity of the hypothesized domains using exploratory factor analysis (EFA), parallel analysis (PA), and bi-factor analysis (Item Response Theory Graded Response Model, IRT-GRM). We used IRT-GRM and the Wald method to identify bias in responses across gender and age. We used IRT and Cronbach’s alpha coefficient to evaluate the reliability of the IBs and then tested the ability of summary scores based on IRT calibrations to discriminate among tertiles of respondents defined by SCD severity.

Results

Of the original 140 questions tested, we eliminated 48 that either did not form clean factors or provided biased measurement across subgroups defined by age and gender. Via EFA and PA, we identified three subfactors within physical impact: sleep, pain and stiffness impacts. Analysis of the resulting six item sets (sleep, pain, stiffness, cognitive, emotional and social impacts of SCD) supported their essential unidimensionality. With the exception of the cognitive impact IB, these item sets also were highly reliable across a broad range of values and highly significantly related to SCD disease severity.

Conclusion

ASCQ-Me pain, sleep, stiffness, emotional and social SCD impact IBs demonstrated exceptional measurement properties using modern and classical psychometric methods of evaluation. Further development of the cognitive impact IB is required to improve its sensitivity to differences in SCD disease severity. Future research will evaluate the sensitivity of the ASCQ-Me IBs to change in SCD disease severity over time due to health interventions.

【 授权许可】

   
2014 Keller et al.; licensee BioMed Central Ltd.

【 参考文献 】

• [1]Brawley OW, Cornelius LJ, Edwards LR, Gamble VN, Green BL, Inturrisi C, James AH, Laraque D, Mendez M, Montoya CJ, Pollock BH, Robinson L, Scholnik AP, Schori M: National institutes of health consensus development conference statement: hydroxyurea treatment for sickle cell disease. Ann Intern Med 2008, 148(12):932-938. Epub 2008 May 5. PMID: 18458271
• [2]Vichinsky EP, Neumayr LD, Gold JI, Weiner MW, Rule RR, Truran D, Kasten J, Eggleston B, Kesler K, McMahon L, Orringer EP, Harrington T, Kalinyak K, De Castro LM, Kutlar A, Rutherford CJ, Johnson C, Bessman JD, Jordan LB, Armstrong FD: Neuropsychological dysfunction and neuroimaging abnormalities in neurologically intact adults with sickle cell anemia. JAMA 2010, 303(18):1823-1831.
• [3]Claster S, Vichinsky EP: Managing sickle cell disease. BMJ 2003, 327(7424):1151-1155.
• [4]Haywood C Jr, Beach MC, Lanzkron S, Strouse JJ, Wilson R, Park H, Witkop C, Bass EB, Segal JB: A systematic review of barriers and interventions to improve appropriate use of therapies for sickle cell disease. J Natl Med Assoc 2009, 101(10):1022-1033.
• [5]Werner EM: NHLBI activities in hemoglobinopathies. NICHD Newborn Screening Translational Research Network Meeting. 2013.
• [6]Treadwell MT, Hassell KL, Levine RE, Keller SD: Adult Sickle Cell Quality of Life Measurement Information System (ASCQ-Me): Conceptual model based on review of the literature and formative research.Clin J Pain 2013, [Epub ahead of print].
• [7]Keller SD, Levine RE: The grounded item technique for developing content valid questions.[abstract]. Qual Life Res 2011, 20:54.
• [8]Flanagan JC: The critical incident technique. Psych Bull 1954, 51(4):327-358.
• [9]Stewart AL, Ware JE: Measuring Functioning and Well-being: The Medical Outcome Study Approach. Duke University Press, Durham; 1992.
• [10]DeWalt DA, Rothrock N, Yount S, Stone AA: Evaluation of item candidates: The PROMIS qualitative item review. Med Care 2007, 45(5):S12-S21.
• [11]Reise SP, Yu J: Parameter recovery in the graded response model using MULTILOG. J Educ Meas 1990, 27:133-144.
• [12]Bender MA, Hobbs W: Sickle Cell Disease. In Gene Reviews [Internet]. Edited by Pagon RA, Bird TC, Dolan CR, Stephens K. University of Washington, Seattle, Seattle (WA); 1993–2003. [updated 2009 Sep 17]
• [13]Steinberg MH: Sickle cell anemia, the first molecular disease: overview of molecular etiology, pathophysiology, and therapeutic approaches. Sci World J 2008, 25(8):1295-1324.
• [14]Steinberg MH: Predicting clinical severity in sickle cell anaemia. Br J Haematol 2005, 129(4):465-481.
• [15]Sebastiani P, Nolan VG, Baldwin CT, Abad-Grau MM, Wang L, Adewoye AH, McMahon LC, Farrer LA, Taylor JG, Kato GJ, Gladwin MT, Steinberg MH: A network model to predict the risk of death in sickle cell disease. Blood 2007, 110(7):2727-2735.
• [16]Akinola NO, Bolarinwa RA, Faponle AF: The import of abdominal pain in adults with sickle cell disorder. West Afr J Med 2009, 28(2):83-86.
• [17]Ballas SK: Sickle cell disease: current clinical management. Semin Hematol 2010, 38(4):307-314.
• [18]Sebastiani P, Solovieff N, Hartley SW, Milton JN, Riva A, Dworkis DA, Melista E, Klings ES, Garrett ME, Telen MJ, Ashley-Koch A, Baldwin CT, Steinberg MH: Genetic modifiers of the severity of sickle cell anemia identified through a genome-wide association study. Am J Hematol 2010, 85(1):29-35.
• [19]Steinberg MH, Adewoye AH: Modifier genes and sickle cell anemia. Curr Opin Hematol 2006, 13(3):131-136.
• [20]Mayer ML, Konrad TR, Dvorak CC: Hospital resource utilization among patients with sickle cell disease. J Health Care Poor Underserved 2003, 14(1):122-135.
• [21]Loureiro MM, Rozenfeld S, Sá Carvalho M, Portugal RD: Factors associated with hospital readmission in sickle cell disease. BMC Blood Disord 2009, 9:2. doi:10.1186/1471-2326-9-2 BioMed Central Full Text
• [22]Aisiku IP, Smith WR, McClish DK, Levenson JL, Penberthy LT, Roseff SD, Bovbjerg VE, Roberts JD: Comparisons of high versus low emergency department utilizers in sickle cell disease. Ann Emerg Med 2009, 53(5):587-593.
• [23]Audard V, Homs S, Habibi A, Galacteros F, Bartolucci P, Godeau B, Renaud B, Levy Y, Grimbert P, Lang P, Brun-Buisson C, Brochard L, Schortgen F, Maitre B, Mekontso Dessap A: Acute kidney injury in sickle patients with painful crisis or acute chest syndrome and its relation to pulmonary hypertension. Nephrol Dial Transplant 2010, 25(8):2524-2529.
• [24]Frei-Jones MJ, Field JJ, DeBaun MR: Risk factors for hospital readmission within 30 days: a new quality measure for children with sickle cell disease. Pediatr Blood Cancer 2009, 52(4):481-485.
• [25]Carroll CP, Haywood C Jr, Fagan P, Lanzkron S: The course and correlates of high hospital utilization in sickle cell disease: Evidence from a large, urban Medicaid managed care organization. Am J Hematol 2009, 84(10):666-670.
• [26]Smith WR, Penberthy LT, Bovbjerg VE, McClish DK, Roberts JD, Dahman B, Aisiku IP, Levenson JL, Roseff SD: Daily assessment of pain in adults with sickle cell disease. Ann Intern Med 2008, 148(2):94-101.
• [27]Dampier C, Setty BN, Eggleston B, Brodecki D, O'neal P, Stuart M: Vaso-occlusion in children with sickle cell disease: clinical characteristics and biologic correlates. J Pediatr Hematol Oncol 2004, 26(12):785-790.
• [28]Vick LR, Gosche JR, Islam S: Partial splenectomy prevents splenic sequestration crises in sickle cell disease. J Pediatr Surg 2009, 44(11):2088-2091.
• [29]Halabi-Tawil M, Lionnet F, Girot R, Bachmeyer C, Lévy PP, Aractingi S: Sickle cell leg ulcers: a frequently disabling complication and a marker of severity. Br J Dermatol 2008, 158(2):339-344.
• [30]Nolan VG, Adewoye A, Baldwin C, Wang L, Ma Q, Wyszynski DF, Farrell JJ, Sebastiani P, Farrer LA, Steinberg MH: Sickle cell leg ulcers: associations with haemolysis and SNPs in Klotho, TEK and genes of the TGF-beta/BMP pathway. Br J Haematol 2006, 133(5):570-578.
• [31]Klings ES, Wyszynski DF, Nolan VG, Steinberg MH: Abnormal pulmonary function in adults with sickle cell anemia. Am J Respir Crit Care Med 2006, 173(11):1264-1269.
• [32]Gill FM, Sleeper LA, Weiner SJ, Brown AK, Bellevue R, Grover R, Pegelow CH, Vichinsky E: Clinical events in the first decade in a cohort of infants with sickle cell disease. Cooperative study of sickle cell disease. Blood 1995, 86(2):776-783.
• [33]Van der Linden WT, Van K-S: Using response times to detect aberrant responses in computerized adaptive testing. Psychometrika 2003, 68(2):251-265.
• [34]Cheng L, Cumber S, Dumas C, Winter R, Nguyen KM, Nieman LZ: Health related quality of life in pregeriatric patients with chronic diseases at urban, public supported clinics. Health Qual Life Outcomes 2003, 1:63. BioMed Central Full Text
• [35]Wensing M, Vingerhoets E, Grol R: Functional status, health problems, age and comorbidity in primary care patients. Qual Life Res 2001, 10:141-148.
• [36]Michelson H, Bolund C, Brandberg Y: Multiple chronic health problems are negatively associated with health related quality of life (HRQoL) irrespective of age. Qual Life Res 2000, 9:1093-1104.
• [37]Meyer HH: Methods for scoring a check-list type rating scale. J Appl Psychol 1951, 35(1):46-49.
• [38]Bland AC, Kreiter CD, Gordon JA: The psychometric properties of five scoring methods applied to the script concordance test. Acad Med 2005, 80(4):395-399.
• [39]Hu L, Bentler PM: Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct Equ Model 1999, 6(1):1-55.
• [40]Suhr DD: Exploratory or confirmatory factor analysis?SUGI Proc 2006, Paper 200–31.
• [41]Horn JL: A rationale and a test for the number of factors in factor analysis. Psychometrika 1965, 30:179-185.
• [42]Cattell RB: The scree test for the number of factors. Multivar Behav Res 1966, 1:245-246.
• [43]Thurstone LL: The vectors of the mind: multiple factor analysis for the isolation of primary traits. University of Chicago Press, Chicago, IL; 1935.
• [44]Hayashi T, Hays RD: A microcomputer program for analyzing multitrait-multimethod matrices. Behav Res Methods Instrum Comput 1987, 19:345-348.
• [45]Ware JE, Harris WJ, Gandek B, Rogers BW, Reese PR: MAP-R for Windows: Multitrait/Multi-item Analysis Program - Revised User's Guide. Health Assessment Lab, Boston, MA; 1997.
• [46]Howard KI, Forehand GG: A method for correcting item-total correlations for the effect of relevant item inclusion. Ed Psych Meas 1962, 22:731-735.
• [47]Reise SP, Morizot J, Hays RD: The role of the bifactor model in resolving dimensionality issues in health outcomes measures. Qual Life Res 2007, 16:19-31.
• [48]Samejima F: Estimation of latent ability using a response pattern of graded scores. In Psychometrika Monograph, 17. Psychometric Society, Richmond, VA; 1969.
• [49]Thissen D: The MEDPRO project: An SBIR project for a comprehensive IRT and CAT software system—IRT software. [http://www.psych.umn.edu/psylabs/catcentral/pdf%20files/cat09thissen.pdf] webciteIn Proceedings of the 2009 GMAC Conference on Computerized Adaptive Testing Edited by Weiss DJ. 2009. Retrieved 12/15/2013 from http://www.psych.umn.edu/psylabs/catcentral/pdf%20files/cat09thissen.pdf
• [50]Harrison DA: Robustness of IRT parameter estimation to violations of the unidimensionality assumption. J Educ Stat 1986, 11(2):91-115.
• [51]Embretson SE, Reise SP: Item Response Theory for Psychologists. Lawrence Erlbaum Associates, Mahwah, NJ; 2000.
• [52]Woods CM: Empirical selection of anchors for tests of differential item functioning. Appl Psychol Meas 2009, 33:42-57.
• [53]Lord FM: A Study of Item Bias, using item Characteristic Curve Theory. In Basic Problems in Cross-Cultural Psychology. Edited by Poortinga YH. Swets and Zeitlinger, Amsterdam; 1977:19-29.
• [54]Lord FM: Applications of Item Response Theory to Practical Testing Problems. Lawrence Erlbaum Associates, Hillsdale, NJ; 1980.
• [55]Langer MM: A reexamination of Lord’s Wald test for differential item functioning using item response theory and modern error estimation (Doctoral Dissertation). 2008.
• [56]Bock RD, Aitkin M: Marginal maximum likelihood estimation of item parameters: Application of an EM algorithm. Psychometrika 1981, 46:443-459.
• [57]Health, United States, 2011: With Special Feature on Socioeconomic Status and Health. National Center for Health Statistics, Hyattsville, MD; 2012.
• [58]Platt OS, Thorington BD, Brambilla DJ: Pain in sickle cell disease – rates and risk factors. N Engl J Med 1991, 325:11-16.
• [59]Ballas SK, Lusardi M: Hospital readmission for adult acute sickle cell painful episodes: frequency, etiology, and prognostic significance. Am J Hematol 2005, 79:17-25.
• [60]Yusuf HR, Atrash HK, Grosse SK, Parker CS, Grant AM: Emergency department visits made by patients with sickle cell disease: A descriptive Study, 1999–2007. Am J Prev Med 2010, 38(4):S536-S541.
• [61]Hays RD, Bjorner JB, Revicki DA, Sprintzer KL, Cella D: Development of physical and mental health summary scores from the patient-reported outcomes measurement information system (PROMIS) global items. Qual Life Res 2009, 18:873-880.
• [62]Cronbach LJ: Coefficient alpha and the internal structure of tests. Psychometrika 1951, 16(3):297-334.
• [63]Tomarken AJ, Waller NG: Structural equation modeling: Strengths, limitations, and misconceptions. Annu Rev Clin Psychol 2005, 1:31-65.
• [64]Cook KF, Kallen MA, Amtmann D: Having a fit: impact of number of items and distribution of data on traditional criteria for assessing IRT’s unidimensionality assumption. Qual Life Res 2009, 18:447-460.
• [65]Kenny DA: Measuring Model Fit. 2012.
• [66]Bayliss EA, Ellis JL, Steiner JF: Subjective assessments of comorbidity correlate with quality of life health outcomes: Initial validation of a comorbidity assessment instrument. Health Qual Life Outcomes 2005, 3:51. BioMed Central Full Text
• [67][http://www.cdc.gov/ncbddd/sicklecell] webcite Registry and Surveillance System for Hemoglobinopathies Pilot Project (RuSH). []
• [68]Dampier C, LeBeau P, Rhee S, Lieff S, Kesler K, Ballas S, Rogers Z, Wang W: Health-related quality of life in adults with sickle cell disease (SCD): a report from the comprehensive sickle cell centers clinical trial consortium. Am J Hematol 2011, 86:203-205.
• [69]Levenson JL, McClish DK, Dahman BA, Bovbjerg VE, De ACitero V, Penberthy LT, Aisiku IP, Roberts JD, Roseff SD, Smith WR: Depression and anxiety in adults with sickle cell disease: the PiSCES project. Psychosom Med 2008, 70:192-196.
• [70]McClish DK, Levenson JL, Penberthy LT, Roseff SD, Bovbjerg VE, Roberts JD, Aisiku IP, Smith WR: Gender differences in pain and healthcare utilization for adult sickle cell patients: The PiSCES Project. J Womens Health (Larchmt) 2006, 15(2):146-154.
• [71]Reeve BB, Hays RD, Bjorner JB, Cook KF, Crane PK, Teresi JA, Thissen D, Revicki DA, Weiss DJ, Hambleton RK, Liu H, Gershon R, Reise SP, Lai JS, Cella D: Psychometric evaluation and calibration of health-related quality of life item banks: Plans for the Patient-Reported Outcomes Measurement Information System (PROMIS). Med Care 2007, 45(5,Suppl 1):S22-S31.