Cognitive interviews guide design of a new CAM patient expectations questionnaire

BMC Complementary and Alternative Medicine

Judith A Turner⁴  Daniel C Cherkin²  Clarissa Hsu³  Cheryl Ritenbaugh¹  Emery R Eaves¹  Karen J Sherman² 

[1] Department of Family and Community Medicine, University of Arizona, 1450 N Cherry Avenue, Tucson AZ 85719, USA;Group Health Research Institute, 1730 Minor Avenue, Suite 1600, Seattle WA 98101, USA;Center for Community Health and Evaluation, Group Health Research Institute, 1730 Minor Avenue, Suite 1600, Seattle WA 98101, USA;Department of Psychiatry and Behavioral Sciences, University of Washington, Box 356560, Seattle WA 98195-6560, USA

关键词: Yoga;    Massage therapy;    Chiropractic;    Acupuncture;    Low back pain;    Expectations;    Questionnaires;    Cognitive interviews;   

Others  :  1220281
DOI  :  10.1186/1472-6882-14-39

 received in 2013-11-04, accepted in 2014-01-17,  发布年份 2014

【 摘 要 】

Background

No consistent relationship exists between pre-treatment expectations and therapeutic benefit from various complementary and alternative medicine (CAM) therapies in clinical trials. However, many different expectancy measures have been used in those studies, with no validated questionnaires clearly focused on CAM and pain. We undertook cognitive interviews as part of a process to develop and validate such a questionnaire.

Methods

We reviewed questions about expectations of benefits of acupuncture, chiropractic, massage, or yoga for pain. Components of the questions – verbs, nouns, response options, terms and phrases describing back pain – were identified. Using seven different cognitive interview scripts, we conducted 39 interviews to evaluate how individuals with chronic low back pain understood these individual components in the context of expectancy questions for a therapy they had not yet received. Chosen items were those with the greatest agreement and least confusion among participants, and were closest to the meanings intended by the investigators.

Results

The questionnaire drafted for psychometric evaluation had 18 items covering various domains of expectancy. “Back pain” was the most consistently interpreted descriptor for this condition. The most understandable response options were 0-10 scales, a structure used throughout the questionnaire, with 0 always indicating no change, and 10 anchored with an absolute descriptor such as “complete relief”. The use of words to describe midpoints was found to be confusing. The word “expect” held different and shifting meanings for participants. Thus paired items comparing “hope” and “realistically expect” were chosen to evaluate 5 different aspects of treatment expectations (back pain; back dysfunction and global effects; impact of back pain on specific areas of life; sleep, mood, and energy; coping). “Impact of back pain” on various areas of life was found to be a consistently meaningful concept, and more global than “interference”.

Conclusions

Cognitive interviews identified wordings with considerable agreement among both participants and investigators. Some items widely used in clinical studies had different meanings to participants than investigators, or were confusing to participants. The final 18-item questionnaire is undergoing psychometric evaluation with goals of streamlining as well as identifying best items for use when questionnaire length is constrained.

【 授权许可】

   
2014 Sherman et al.; licensee BioMed Central Ltd.

【 参考文献 】

• [1]Crow R, Gage H, Hampson S, Hart J, Kimber A, Thomas H: The role of expectancies in the placebo effect and their use in the delivery of health care: a systematic review. Health Technol Assess 1999, 3:1-96.
• [2]Constantino MJ, Arnkoff DB, Glass CR, Ametrano RM, Smith JZ: Expectations. J Clin Psychol 2011, 67:184-192.
• [3]van Hartingsveld F, Ostelo RWJG, Cuijpers P, de Vos R, Riphagen II, de Vet HCW: Treatment-related and patient-related expectations of patients with musculoskeletal disorders: a systematic review of published measurement tools. Clin J Pain 2010, 26:470-488.
• [4]Bialosky JE, Bishop MD, Cleland JA: Individual expectation: an overlooked, but pertinent, factor in the treatment of individuals experiencing musculoskeletal pain. Phys Ther 2010, 90:1345-1355.
• [5]Bishop MD, Bialosky JE, Cleland JA: Patient expectations of benefit from common interventions for low back pain and effects on outcome: secondary analysis of a clinical trial of manual therapy interventions. J Man Manip Ther 2011, 19:20-25.
• [6]Iles R, Davidson M, Taylor N, O’Halloran P: Systematic review of the ability of recovery expectations to predict outcomes in Non-chronic Non-specific Low back pain. J Occup Rehabil 2009, 19:25-40.
• [7]Kalauokalani D, Cherkin DC, Sherman KJ, Koepsell TD, Deyo RA: Lessons from a trial of acupuncture and massage for Low back pain: patient expectations and treatment effects. Spine 2001, 26:1418-1424.
• [8]Linde K, Witt CM, Streng A, Weidenhammer W, Wagenpfeil S, Brinkhaus B, Willich SN, Melchart D: The impact of patient expectations on outcomes in four randomized controlled trials of acupuncture in patients with chronic pain. Pain 2007, 128:264-271.
• [9]Sherman KJ, Cherkin DC, Ichikawa L, Avins AL, Delaney K, Barlow WE, Khalsa PS, Deyo RA: Treatment expectations and preferences as predictors of outcome of acupuncture for chronic back pain. Spine 2010, 35:1471-1477.
• [10]Thomas KJ, MacPherson H, Thorpe L, Brazier J, Fitter M, Campbell MJ, Roman M, Walters SJ, Nicholl J: Randomised controlled trial of a short course of traditional acupuncture compared with usual care for persistent non-specific low back pain. BMJ 2006, 333:623.
• [11]Haanstra TM, Hanson L, Evans R, Nes FA, Vet HCW, Cuijpers P, Ostelo RWJG: How do low back pain patients conceptualize their expectations regarding treatment? Content analysis of interviews. Eur Spine J 2013, 22:1986-1995.
• [12]Kravitz RL: Measuring Patients' expectations and requests. Ann Intern Med 2001, 134:881-888.
• [13]Borkovec TD, Nau SD: Credibility of analogue therapy rationales. J Behav Ther Exp Psychiatry 1972, 3:257-260.
• [14]Mao J, Armstrong K, Farrar J, Bowman M: Acupuncture expectancy scale: development and preliminary validation in China. EXPLORE 2007, 3:372-377.
• [15]Younger J, Gandhi V, Hubbard E, Mackey S: Development of the Stanford Expectations of Treatment Scale (SETS): a tool for measuring patient outcome expectancy in clinical trials. Clin Trials 2012, 9:767-776.
• [16]Irwin DE, Varni JW, Yeatts K, DeWalt DA: Cognitive interviewing methodology in the development of a pediatric item bank: a patient reported outcomes measurement information system (PROMIS) study. Health Qual Life Outcomes 2009, 7:1-10. BioMed Central Full Text
• [17]Thompson JJ, Kelly KL, Ritenbaugh C, Hopkins AL, Sims CM, Coons SJ: Developing a patient-centered outcome measure for complementary and alternative medicine therapies II: refining content validity through cognitive interviews. BMC Complement Altern Med 2011, 11:136-153. BioMed Central Full Text
• [18]Guidance for industry: patient-reported outcome measures: use in medical product development to support labeling claims: draft guidance In Book Guidance for industry: patient-reported outcome measures: use in medical product development to support labeling claims: draft guidance. Volume 4. City: FDA Center for Drug Evaluation and Research; FDA Center for Biologics Evaluation and Research; FDA Center for Devices and Radiological Health; 2006::79.
• [19]Barnes PM, Bloom B, Nahin RL: Complementary and Alternative Medicine Use Among Adults and Children: United States, 2007. In Book Complementary and Alternative Medicine Use Among Adults and Children: United States. Volume 12. City; 2007::2008.
• [20]Schafer LM, Hsu C, Eaves ER, Ritenbaugh C, Turner J, Cherkin DC, Sims CM, Sherman KJ: Complementary and alternative medicine (CAM) providers’ views of chronic low back pain patients’ expectations of CAM therapies: a qualitative study. BMC Complement Altern Med 2012, 12:234. BioMed Central Full Text
• [21]Beatty PC, Willis GB: Research synthesis: the practice of cognitive interviewing. Pub Opin Q 2007, 71:287-311.
• [22]Drennan J: Cognitive interviewing: verbal data in the design and pretesting of questionnaires. J Adv Nurs 2003, 42:57-63.
• [23]Willis GB: Cognitive Interviewing: A Tool for Improving Questionnaire Design. Thousands Oaks: Sage Publications; 2005.
• [24]Conrad F, Blair J, Tracy E: Verbal reports are data! A theoretical approach to cognitive interviews. In Proceedings of the 1999 Federal Committee on Statistical Methodology Research Conference. Washington, DC: Office of Management and Budget; 1999.
• [25]Renberg T, Kettis Lindblad Å, Tully MP: Testing the validity of a translated pharmaceutical therapy-related quality of life instrument, using qualitative ‘think aloud’ methodology. J Clin Pharm Ther 2008, 33:279-287.
• [26]Conrad F, Blair J: Data Quality in Cognitive Interviews: The Case of Verbal Reports. In Methods for Testing and Evaluating Survey Questions. Edited by Presser S, Rothgeb JM, Couper MP, Lessler JT, Martin E, Martin J, Singer E. John Wiley & Sons, Inc; 2004.
• [27]Strauss AL, Corbin JM: Basics of Qualitative Research: grounded theory procedures and techniques. Newbury Park, California: Sage Publications; 1990.
• [28]Muhr T: ATLASti Qualitative Data Analysis Program. In Book ATLASti Qualitative Data Analysis Program. 60th edition. City: ATLAS.ti Scientific Software Development GmbH; 2011.
• [29]Bombardier C: Outcome assessments in the evaluation of treatment of spinal disorders: summary and general recommendations. Spine 2000, 25:3100-3103.
• [30]Turk DC, Dworkin RH, Allen RR, Bellamy N, Brandenburg N, Carr DB, Cleeland C, Dionne R, Farrar JT, Galer BS: Core outcome domains for chronic pain clinical trials: IMMPACT recommendations. Pain 2003, 106:337-345.
• [31]van de Water A, Eadie J, Hurley DA: Investigation of sleep disturbance in chronic low back pain: an age-and gender-matched case-control study over a 7-night period. Man Ther 2011, 16:550-556.
• [32]White P, Lewith G, Hopwood V, Prescott P: The placebo needle, is it a valid and convincing placebo for use in acupuncture trials? A randomised, single-blind, cross-over pilot trial. Pain 2003, 106:401-409.
• [33]Pariente J, White P, Frackowiak RS, Lewith G: Expectancy and belief modulate the neuronal substrates of pain treated by acupuncture. Neuroimage 2005, 25:1161-1167.
• [34]Moyer CA, Rounds J: The Attitudes toward Massage (ATOM) scale: reliability, validity, and associated findings. J Bodyw Mov Ther 2009, 13:22-33.
• [35]Mao J, Armstrong K, Farrar J, Bowman M: Acupuncture expectancy scale: development and preliminary validation in China. EXPLORE (NY) 2007, 3:372-377.
• [36]Mao J: Validation of acupuncture expectancy scale in cancer patients. In Book Validation of acupuncture expectancy scale in cancer patients. City; 2009.
• [37]Eaves ER, Ritenbaugh C, Nichter M, Hopkins AL, Sherman KJ: Modes of hoping: understanding hope and expectation in the context of a clinical trial of complementary and alternative medicine for chronic pain. EXPLORE (NY)In press