Towards understanding the de-adoption of low-value clinical practices: a scoping review

BMC Medicine

Henry Thomas Stelfox²  Lianne P. Jeffs³  Brenda R. Hemmelgarn²  Sharon E. Straus³  Jessalyn K. Holodinsky¹  Kelly J. Mrklas¹  Daniel J. Niven¹ 

[1] Department of Community Health Sciences, University of Calgary, Calgary T2N 4Z6, Alberta, Canada;Department of Medicine, University of Calgary, Calgary T2N 4Z6, Alberta, Canada;Li Ka Shing Knowledge Institute of St. Michael’s Hospital, Toronto M5B 1T8, Ontario, Canada

关键词: Withdrawal;    Reassess;    Obsolete;    Medical reversal;    Low-value;    Disinvestment;    De-implementation;    De-adoption;    Contradict;    Abandon;   

Others  :  1229152
DOI  :  10.1186/s12916-015-0488-z

 received in 2015-07-28, accepted in 2015-09-15,  发布年份 2015

【 摘 要 】

Background

Low-value clinical practices are common in healthcare, yet the optimal approach to de-adopting these practices is unknown. The objective of this study was to systematically review the literature on de-adoption, document current terminology and frameworks, map the literature to a proposed framework, identify gaps in our understanding of de-adoption, and identify opportunities for additional research.

Methods

MEDLINE, EMBASE, the Cochrane Central Register of Controlled Trials, the Cochrane Database of Systematic Reviews, the Cochrane Database of Abstracts and Reviews of Effects, and CINAHL Plus were searched from 1 January 1990 to 5 March 2014. Additional citations were identified from bibliographies of included citations, relevant websites, the PubMed ‘related articles’ function, and contacting experts in implementation science. English-language citations that referred to de-adoption of clinical practices in adults with medical, surgical, or psychiatric illnesses were included. Citation selection and data extraction were performed independently and in duplicate.

Results

From 26,608 citations, 109 were included in the final review. Most citations (65 %) were original research with the majority (59 %) published since 2010. There were 43 unique terms referring to the process of de-adoption—the most frequently cited was “disinvest” (39 % of citations). The focus of most citations was evaluating the outcomes of de-adoption (50 %), followed by identifying low-value practices (47 %), and/or facilitating de-adoption (40 %). The prevalence of low-value practices ranged from 16 % to 46 %, with two studies each identifying more than 100 low-value practices. Most articles cited randomized clinical trials (41 %) that demonstrate harm (73 %) and/or lack of efficacy (63 %) as the reason to de-adopt an existing clinical practice. Eleven citations described 13 frameworks to guide the de-adoption process, from which we developed a model for facilitating de-adoption. Active change interventions were associated with the greatest likelihood of de-adoption.

Conclusions

This review identified a large body of literature that describes current approaches and challenges to de-adoption of low-value clinical practices. Additional research is needed to determine an ideal strategy for identifying low-value practices, and facilitating and sustaining de-adoption. In the meantime, this study proposes a model that providers and decision-makers can use to guide efforts to de-adopt ineffective and harmful practices.

【 授权许可】

   
2015 Niven et al.

【 图 表 】

Fig. 1.

Fig. 2.

Fig. 3.

Fig. 4.

【 参考文献 】

• [1]Randomised trial of intravenous streptokinase, oral aspirin, both, or neither among 17,187 cases of suspected acute myocardial infarction: ISIS-2. Lancet. 1988; 332:349-360.
• [2]Van De Werf F, Adgey J, Ardissino D, Armstrong PW, Aylward P et al.. Single-bolus tenecteplase compared with front-loaded alteplase in acute myocardial infarction: the ASSENT-2 double-blind randomised trial. Lancet. 1999; 354:716-722.
• [3]Echt DS, Liebson PR, Mitchell LB, Peters RW, Obias-Manno D, Barker AH et al.. Mortality and morbidity in patients receiving encainide, flecainide, or placebo. The Cardiac Arrhythmia Suppression Trial. N Engl J Med. 1991; 324:781-788.
• [4]Prasad V, Cifu A. Medical reversal: why we must raise the bar before adopting new technologies. Yale J Biol Med. 2011; 84:471-478.
• [5]Prasad V, Gall V, Cifu A. The frequency of medical reversal. Arch Intern Med. 2011; 171:1675-1676.
• [6]Cameron C, Coyle D, Ur E, Klarenbach S. Cost-effectiveness of self-monitoring of blood glucose in patients with type 2 diabetes mellitus managed without insulin. CMAJ. 2010; 182:28-34.
• [7]Prasad V, Vandross A, Toomey C, Cheung M, Rho J, Quinn S et al.. A decade of reversal: an analysis of 146 contradicted medical practices. Mayo Clinic Proc. 2013; 88:790-798.
• [8]Elshaug AG, Watt AM, Mundy L, Willis CD. Over 150 potentially low-value health care practices: an Australian study. Med J Austr. 2012; 197:556-560.
• [9]Rogers EM. The innovation-decision process. In: Diffusion of Innovations. 5th ed. Free Press, New York, New York; 2003: p.168-218.
• [10]Arksey H, O'Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol. 2005; 8:19-32.
• [11]Levac D, Colquhoun H, O'Brien KK. Scoping studies: advancing the methodology. Implement Sci. 2010; 5:69. BioMed Central Full Text
• [12]Moher D, Liberati A, Tetzlaff J, Altman DG, Group P. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med. 2009; 151:264-269.
• [13]Sampson M, McGowan J, Cogo E, Grimshaw J, Moher D, Lefebvre C. An evidence-based practice guideline for the peer review of electronic search strategies. J Clin Epidemiol. 2009; 62:944-952.
• [14]Grey Matters: a practical search tool for evidence-based medicine. Canadian Agency for Drugs and Technologies in Health. 2013. http://www.cadth.ca/en/resources/grey-matters. Accessed 1 Mar 2014.
• [15]Straus SE, Tetroe J, Graham ID. Knowledge translation in health care: moving from evidence to practice. 2nd ed. John Wiley & Sons, Ltd., Oxford, UK; 2013.
• [16]Greenhalgh T, Robert G, Bate P, Macfarlane F, Kyriakidou O. Diffusion of innovations in health service organisations: a systematic literature review. Blackwell Publishing Ltd., Malden, MA; 2005.
• [17]Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977; 33:159-174.
• [18]Hauptman PJ, Schnitzler MA, Swindle J, Burroughs TE. Use of nesiritide before and after publications suggesting drug-related risks in patients with acute decompensated heart failure. JAMA. 2006; 296:1877-1884.
• [19]Polisena J, Clifford T, Elshaug AG, Mitton C, Russell E, Skidmore B. Case studies that illustrate disinvestment and resource allocation decision-making processes in health care: a systematic review. Int J Technol Assess Health Care. 2013; 29:174-184.
• [20]Levin L. Disinvestment strategies based on evidence guided adoption and obsolescence of technologies: the Ontario experience. Canadian Foundation for Healthcare Improvement. 2011. http://www.cfhi-fcass.ca/Libraries/CEO_Forum_files/LevinENG.sflb.ashx. Accessed 4 Mar 2014.
• [21]Choosing Wisely: Five Things Physicians and Patients Should Question. American Board of Internal Medicine Foundation. 2012. http://www.choosingwisely.org/clinician-lists/. Accessed 4 Mar 2014.
• [22]Choosing Wisely Canada. Canadian Medical Association. 2014. http://www.choosingwiselycanada.org. Accessed 1 May 2014.
• [23]Hollingworth W, Busby J, Jones H, Sterne J. Can variation in hospital procedure rates identify candidates for health technology reassessment and disinvestment? Value Health. 2013; 16:A470.
• [24]Ioannidis JP. Contradicted and initially stronger effects in highly cited clinical research. JAMA. 2005; 294:218-228.
• [25]Roumie CL, Grogan EL, Falbe W, Awad J, Speroff T, Dittus RS et al.. A three-part intervention to change the use of hormone replacement therapy in response to new evidence. Ann Intern Med. 2004; 141:118-125.
• [26]Sindby JE, Brocki BC, Rasmussen BS, Gorst-Rasmussen A, Andreasen JJ. Efforts to change transfusion practice behaviour and reduce transfusion rates are effective in coronary artery bypass surgery. J Cardiothorac Vasc Anesth. 2011; 1:S46.
• [27]Krol N, Wensing M, Haaijer-Ruskamp F, Muris JWM, Numans ME, Schattenberg G et al.. Patient-directed strategy to reduce prescribing for patients with dyspepsia in general practice: a randomized trial. Aliment Pharmacol Ther. 2004; 19:917-922.
• [28]Kulawik D, Sands JJ, Mayo K, Fenderson M, Hutchinson J, Woodward C et al.. Focused vascular access education to reduce the use of chronic tunneled hemodialysis catheters: results of a network quality improvement initiative. Semin Dial. 2009; 22:692-697.
• [29]Ross-Degnan D, Soumerai SB, Fortess EE, Gurwitz JH. Examining product risk in context. Market withdrawal of zomepirac as a case study. JAMA. 1993; 270:1937-1942.
• [30]Williams D, Singh M, Hind C. The effect of the withdrawal of rofecoxib on prescribing patterns of COX-2 inhibitors in Scotland. Br J Clin Pharmacol. 2006; 62:366-368.
• [31]Thiebaud P, Patel BV, Nichol MB. Impact of rofecoxib withdrawal on cyclooxygenase-2 utilization among patients with and without cardiovascular risk. Value Health. 2006; 9:361-368.
• [32]Barozzi N, Tett SE. What happened to the prescribing of other COX-2 inhibitors, paracetamol and non-steroidal anti-inflammatory drugs when rofecoxib was withdrawn in Australia? Pharmacoepidemiol Drug Saf. 2007; 16:1184-1191.
• [33]Sun SX, Lee KY, Bertram CT, Goldstein JL. Withdrawal of COX-2 selective inhibitors rofecoxib and valdecoxib: impact on NSAID and gastroprotective drug prescribing and utilization. Curr Med Res Opin. 2007; 23:1859-1866.
• [34]Setakis E, Leufkens HG, van Staa TP. Changes in the characteristics of patients prescribed selective cyclooxygenase 2 inhibitors after the 2004 withdrawal of rofecoxib. Arthritis Rheum. 2008; 59:1105-1111.
• [35]Sukel MP, van der Linden MW, Chen C, Erkens JA, Herings RM. Large-scale stopping and switching treatment with COX-2 inhibitors after the rofecoxib withdrawal. Pharmacoepidemiol Drug Saf. 2008; 17:9-19.
• [36]Hsiao FY, Tsai YW, Huang WF. Changes in physicians’ practice of prescribing cyclooxygenase-2 inhibitor after market withdrawal of rofecoxib: a retrospective study of physician-patient pairs in Taiwan. Clin Ther. 2009; 31:2618-2627.
• [37]Stafford RS, Radley DC. National trends in antiobesity medication use. Arch Intern Med. 2003; 163:1046-1050.
• [38]Grady D, Redberg RF. Less is more: how less health care can result in better health. Arch Intern Med. 2010; 170:749-750.
• [39]Macleod MR, Michie S, Roberts I, Dirnagl U, Chalmers I, Ioannidis JP et al.. Biomedical research: increasing value, reducing waste. Lancet. 2014; 383:101-104.
• [40]Cassel CK, Guest JA. Choosing wisely: helping physicians and patients make smart decisions about their care. JAMA. 2012; 307:1801-1802.
• [41]Graham ID, Logan J, Harrison MB, Straus SE, Tetroe J, Caswell W et al.. Lost in knowledge translation: time for a map? J Contin Educ Health Prof. 2006; 26:13-24.
• [42]Haas M, Hall J, Viney R, Gallego G. Breaking up is hard to do: why disinvestment in medical technology is harder than investment. Aust Health Rev. 2012; 36:148-152.
• [43]Montini T, Graham ID. “Entrenched practices and other biases”: unpacking the historical, economic, professional, and social resistance to de-implementation. Implement Sci. 2015; 10:24. BioMed Central Full Text
• [44]Duhigg C. The power of habit: why we do what we do in life and business. Random House Trade Paperbacks, New York; 2012.
• [45]Niven DJ, Rubenfeld GD, Kramer AA, Stelfox HT. Effect of published scientific evidence on glycemic control in adult intensive care units. JAMA Intern Med. 2015; 175:801-809.
• [46]Watt AM, Hiller JE, Braunack-Mayer AJ, Moss JR, Buchan H, Wale J et al.. The ASTUTE Health study protocol: deliberative stakeholder engagements to inform implementation approaches to healthcare disinvestment. Implement Sci. 2012; 7:101. BioMed Central Full Text
• [47]Watt AM, Willis CD, Hodgetts K, Elshaug AG, Hiller JE. Engaging clinicians in evidence-based disinvestment: role and perceptions of evidence. Int J Technol Assess Health Care. 2012; 28:211-219.
• [48]Elshaug AG, Moss JR, Littlejohns P, Karnon J, Merlin TL, Hiller JE. Identifying existing health care services that do not provide value for money. Med J Austr. 2009; 190:269-273.
• [49]Elshaug AG, Hiller JE, Moss JR. Exploring policy-makers’ perspectives on disinvestment from ineffective healthcare practices. Int J Technol Assess Health Care. 2008; 24:1-9.
• [50]Nieuwlaat R, Schwalm JD, Khatib R, Yusuf S. Why are we failing to implement effective therapies in cardiovascular disease? Eur Heart J. 2013; 34:1262-1269.
• [51]Garner S, Littlejohns P. Disinvestment from low value clinical interventions: NICEly done? BMJ. 2011; 343:d4519.
• [52]Henshall C, Schuller T, Mardhani-Bayne L. Using health technology assessment to support optimal use of technologies in current practice: the challenge of “disinvestment”. Int J Technol Assess Health Care. 2012; 28:203-210.
• [53]Moynihan RN. A healthy dose of disinvestment. Med J Austr. 2012; 196:158-8.
• [54]Ibargoyen-Roteta N, Gutierrez-Ibarluzea I, Asua J, Benguria-Arrate G, Galnares-Cordero L. Scanning the horizon of obsolete technologies: possible sources for their identification. Int J Technol Assess Health Care. 2009; 25:249-254.
• [55]Ibargoyen-Roteta N, Gutierrez-Ibarluzea I, Asua J. Guiding the process of health technology disinvestment. Health Policy. 2010; 98:218-226.
• [56]Chamberlain CA, Martin RM, Busby J, Gilbert R, Cahill DJ, Hollingworth W. Trends in procedures for infertility and caesarean sections: was NICE disinvestment guidance implemented? NICE recommendation reminders. BMC Public Health. 2013; 13:112. BioMed Central Full Text
• [57]Gerdvilaite J, Nachtnebel A. Disinvestment: overview of disinvestment experiences and challenges in selected countries. Ludwig Boltzman Institut fur Health Technology Assessment. 2011. http://eprints.hta.lbg.ac.at/926/##. Accessed 4 Mar 2014.
• [58]Leggett L, Noseworthy TW, Zarrabi M, Lorenzetti D, Sutherland LR, Clement FM. Health technology reassessment of non-drug technologies: current practices. Int J Technol Assess Health Care. 2012; 28:220-227.
• [59]Leggett LE, Mackean G, Noseworthy TW, Sutherland L, Clement F. Current status of health technology reassessment of non-drug technologies: survey and key informant interviews. Health Res Policy Syst. 2012; 10:38. BioMed Central Full Text
• [60]Cooper C, Starkey K. Disinvestment in health care. BMJ. 2010; 340:c1413-3.
• [61]Karnon J, Carlton J, Czoski-Murray C, Smith K. Informing disinvestment through cost-effectiveness modelling: is lack of data a surmountable barrier? Appl Health Econ Health Policy. 2009; 7:1-9.
• [62]Hodgetts K, Elshaug AG, Hiller JE. What counts and how to count it: physicians constructions of evidence in a disinvestment context. Soc Sci Med. 2012; 75:2191-2199.
• [63]Hughes DA, Ferner RE. New drugs for old: disinvestment and NICE. BMJ. 2010; 340:c572.
• [64]Street JM, Hennessy SE, Watt AM, Hiller JE, Elshaug AG. News and social media: windows into community perspectives on disinvestment. Int J Technol Assess Health Care. 2011; 27:376-383.
• [65]Prasad V, Ioannidis JP. Evidence-based de-implementation for contradicted, unproven, and aspiring healthcare practices. Implement Sci. 2014; 9:1. BioMed Central Full Text
• [66]Elshaug AG, Hiller JE, Tunis SR, Moss JR. Challenges in Australian policy processes for disinvestment from existing, ineffective health care practices. Aust New Zealand Health Policy. 2007; 4:23. BioMed Central Full Text
• [67]Williams IP, Bryan S. Cost-effectiveness analysis and formulary decision making in England: findings from research. Soc Sci Med. 2007; 65:2116-2129.
• [68]Mortimer D. Reorienting programme budgeting and marginal analysis (PBMA) towards disinvestment. BMC Health Serv Res. 2010; 10:288. BioMed Central Full Text
• [69]Nuti S, Vainieri M, Bonini A. Disinvestment for re-allocation: a process to identify priorities in healthcare. Health Policy. 2010; 95:137-143.
• [70]Garner S, Docherty M, Somner J, Sharma T, Choudhury M, Clarke M et al.. Reducing ineffective practice: challenges in identifying low-value health care using Cochrane systematic reviews. J Health Serv Res Policy. 2013; 18:6-12.
• [71]Noseworthy T, Clement F. Health technology reassessment: scope, methodology, & language. Int J Technol Assess Health Care. 2012; 28:201-202.
• [72]Donaldson C, Bate A, Mitton C, Dionne F, Ruta D. Rational disinvestment. QJM. 2010; 103:801-807.
• [73]Haines T, O'Brien L, McDermott F, Markham D, Mitchell D, Watterson D et al.. A novel research design can aid disinvestment from existing health technologies with uncertain effectiveness, cost-effectiveness, and/or safety. J Clin Epidemiol. 2014; 67:144-151.
• [74]Paulden M. Investment and disinvestment of health technologies: The need for two cost-effectiveness thresholds. Value Health. 2012; 15:A33.
• [75]Pearson S, Littlejohns P. Reallocating resources: how should the National Institute for Health and Clinical Excellence guide disinvestment efforts in the National Health Service? J Health Serv Res Policy. 2007; 12:160-165.
• [76]Hislop JM. Societal preferences for health technology disinvestment policy: Views of Scottish taxpayers - a qualitative study. Value Health. 2011; 14:A356-A357.
• [77]Kelly M. Public health programmes and interventions and disinvestment. National Institute for Health and Care Excellence. 2006. https://www.nice.org.uk/proxy/?sourceUrl=http%3A%2F%2Fwww.nice.org.uk%2FniceMedia%2Fpdf%2Fsmt%2F040406item5.pdf . Accessed 4 Mar 2014.
• [78]Garner S. Disinvestment: the UK experience. International Society for Pharmacoeconomics and Outcomes Research, 15th Annual European Congress. 2012. http://www.ispor.org/congresses/berlin1112/presentations/W10_Garner.pdf. Accessed 4 Mar 2014.
• [79]Harris E, Mundy L, Hewson K, Jacobsen N. Disinvestment in Australia and New Zealand. HealthPACT. 2013. http://www.health.qld.gov.au/healthpact. Accessed 4 Mar 2014.
• [80]Joshi NP, Stahnisch FW, Noseworthy TW. Reassessment of health technologies: obsolescence and waste. Canadian Agency for Drugs & Technologies in Health. 2009. https://www.cadth.ca/reassessment-health-technologies-obsolescence-and-waste. Accessed 22 October 2013.
• [81]Leng G. Introduction of new disinvestment programmes. National Institute for Health & Care Excellence. 2006. https://www.nice.org.uk/proxy/?sourceUrl=http%3A%2F%2Fwww.nice.org.uk%2FniceMedia%2Fpdf%2Fsmt%2F210206item3.pdf. Accessed 4 Mar 2014.
• [82]Kowalczyk KJ, Levy JM, Caplan CF, Lipsitz SR, Yu H-y. Gu X, et al. Temporal national trends of minimally invasive and retropubic radical prostatectomy outcomes from 2003 to 2007: results from the 100 % Medicare sample. Eur Urol. 2012; 61:803-809.
• [83]Ioannidis JP. In reply II-reversal of medical practices. Mayo Clinic Proc. 2013; 88:1184.
• [84]Bonakdar tehrani A, Howard D. Potential cost savings from comparative effectiveness research: lessons from COURAGE study. Value Health. 2011; 14:A2.
• [85]Prasad V, Cifu A. In reply I-reversal of medical practices. Mayo Clinic Proc. 2013; 88:1183-1184.
• [86]Tatsioni A, Siontis GCM, Ioannidis JPA. Partisan perspectives in the medical literature: a study of high frequency editorialists favoring hormone replacement therapy. J Gen Intern Med. 2010; 25:914-919.
• [87]Koo KK, Sun JC, Zhou Q, Guyatt G, Cook DJ, Walter SD et al.. Pulmonary artery catheters: evolving rates and reasons for use. Crit Care Med. 2011; 39:1613-1618.
• [88]Luetmer MT, Kallmes DF. Have referral patterns for vertebroplasty changed since publication of the placebo-controlled trials? Am J Neuroradiol. 2011; 32:647-648.
• [89]Deyell MW, Buller CE, Miller LH, Wang TY, Dai D, Lamas GA et al.. Impact of National Clinical Guideline recommendations for revascularization of persistently occluded infarct-related arteries on clinical practice in the United States. Arch Int Med. 2011; 171:1636-1643.
• [90]Atwater BD, Oujiri J, Wolff MR. The immediate impact of the Clinical Outcomes Utilizing Revascularization and Aggressive Drug Evaluation (COURAGE) trial on the management of stable angina. Clin Cardiol. 2009; 32:E1-E3.
• [91]Wiener RS, Welch HG. Trends in the use of the pulmonary artery catheter in the United States, 1993–2004. JAMA. 2007; 298:423-429.
• [92]Murphy DJ, Needham DM, Netzer G, Zeger SL, Colantuoni E, Ness P et al.. RBC transfusion practices among critically ill patients. Crit Care Med. 2013; 41:2344-2353.
• [93]Ahmed B, Dauerman HL, Piper WD, Robb JF, Verlee MP, Ryan TJ et al.. Recent changes in practice of elective percutaneous coronary intervention for stable angina. Circ Cardiovasc Qual Outcomes. 2011; 4:300-305.
• [94]Ehrenstein V, Hernandez RK, Ulrichsen SP, Rungby J, Lash TL, Riis AH et al.. Rosiglitazone use and post-discontinuation glycaemic control in two European countries, 2000–2010. BMJ Open. 2013; 3: Article ID e003424
• [95]Xie F, Petitti DB, Chen W. Prescribing patterns for antihypertensive drugs after the Antihypertensive and Lipid-Lowering Treatment to Prevent Heart Attack Trial: report of experience in a health maintenance organization. Am J Hypertens. 2005; 18:464-469.
• [96]Stafford RS, Furberg CD, Finkelstein SN, Cockburn IM, Alehegn T, Ma J. Impact of clinical trial results on national trends in alpha-blocker prescribing, 1996–2002. JAMA. 2004; 291:54-62.
• [97]Majumdar SR, Inui TS, Gurwitz JH, Gillman MW, McLaughlin TJ, Soumerai SB. Influence of physician specialty on adoption and relinquishment of calcium channel blockers and other treatments for myocardial infarction. J Gen Intern Med. 2001; 16:351-359.
• [98]Majumdar SR, Almasi EA, Stafford RS. Promotion and prescribing of hormone therapy after report of harm by the Women’s Health Initiative. JAMA. 2004; 292:1983-1988.
• [99]Austin PC, Mamdani MM, Tu K, Jaakkimainen L. Prescriptions for estrogen replacement therapy in Ontario before and after publication of the Women’s Health Initiative Study. JAMA. 2003; 289:3241-3242.
• [100]Massatti RR, Sweeney HA, Panzano PC, Roth D. The de-adoption of innovative mental health practices (IMHP): why organizations choose not to sustain an IMHP. Adm Policy Mental Health. 2008; 35:50-65.
• [101]Howard DH, Kenline C, Lazarus HM, Lemaistre CF, Maziarz RT, McCarthy PL et al.. Abandonment of high-dose chemotherapy/hematopoietic cell transplants for breast cancer following negative trial results. Health Serv Res. 2011; 46:1762-1777.
• [102]Azermai M, Vander Stichele RR, Van Bortel LM, Elseviers MM. Barriers to antipsychotic discontinuation in nursing homes: an exploratory study. Aging Ment Health. 2014; 18:346-353.
• [103]Hersh AL, Stefanick ML, Stafford RS. National use of postmenopausal hormone therapy: annual trends and response to recent evidence. JAMA. 2004; 291:47-53.
• [104]Tatsioni A, Bonitsis NG, Ioannidis JPA. Persistence of contradicted claims in the literature. JAMA. 2007; 298:2517-2526.
• [105]Duffy SQ, Farley DE. The protracted demise of medical technology. The case of intermittent positive pressure breathing. Med Care. 1992; 30:718-736.
• [106]Howard DH, Shen YC. Comparative effectiveness research, technological abandonment, and health care spending. Adv Health Econ Health Serv Res. 2012; 23:103-121.
• [107]Prasad V, Cifu A, Ioannidis JPA. Reversals of established medical practices: evidence to abandon ship. JAMA. 2012; 307:37-38.
• [108]Banta HD, Thacker SB. The case for reassessment of health care technology. Once is not enough. JAMA. 1990; 264:235-240.
• [109]Elshaug AG, Watt AM, Moss JR, Hiller JE. Policy perspectives on the obsolescence of health technologies in Canada. Canadian Agency for Drugs and Technologies in Health. 2009. https://www.cadth.ca/media/pdf/Obsolescence%20of%20Health%20Technologies%20in%20Canada_Policy_Forum_e.pdf. Accessed 21 Oct 2013.
• [110]MacKean G, Noseworthy T, Elshaug AG, Leggett L, Littlejohns P, Berezanski J et al.. Health technology reassessment: the art of the possible. Int J Technol Assess Health Care. 2013; 29:418-423.
• [111]Towards better patient care: drugs to avoid. Prescrire Int. 2013, 22:108–111.
• [112]Kiechle FL, Arcenas RC, Rogers LC. Establishing benchmarks and metrics for disruptive technologies, inappropriate and obsolete tests in the clinical laboratory. Clin Chim Acta. 2014; 427:131-136.
• [113]Prasad V, Vandross A. Cardiovascular primary prevention: how high should we set the bar? Arch Intern Med. 2012; 172:656-659.
• [114]Warner JL, Yang P, Alterovitz G. Reversal of medical practices. Mayo Clinic Proc. 2013; 88:1182-1183.
• [115]Medical Reversal. Life in the FastLane. 2014. http://lifeinthefastlane.com/education/ccc/medical-reversal. Accessed 3 Jun 2014.
• [116]Moscucci M. Medical reversal, clinical trials, and the “late” open artery hypothesis in acute myocardial infarction. Arch Intern Med. 2011; 171:1643-1644.
• [117]Fatovich DM. Medical reversal: what are you doing wrong for your patient today? Emerg Med Australas. 2013; 25:1-3.
• [118]Haas JS, Kaplan CP, Gerstenberger EP, Kerlikowske K. Changes in the use of postmenopausal hormone therapy after the publication of clinical trial results. Ann Intern Med. 2004; 140:184-188.
• [119]Siontis GCM, Tatsioni A, Katritsis DG, Ioannidis JPA. Persistent reservations against contradicted percutaneous coronary intervention indications: citation content analysis. Am Heart J. 2009; 157:695-701.
• [120]Brunt ME, Murray MD, Hui SL, Kesterson J, Perkins AJ, Tierney WM. Mass media release of medical research results: an analysis of antihypertensive drug prescribing in the aftermath of the calcium channel blocker scare of March 1995. J Gen Intern Med. 2003; 18:84-94.
• [121]Smalley W, Shatin D, Wysowski DK, Gurwitz J, Andrade SE, Goodman M et al.. Contraindicated use of cisapride: impact of food and drug administration regulatory action. JAMA. 2000; 284:3036-3039.
• [122]Huang WF, Tsai YW, Hsiao FY, Liu WC. Changes of the prescription of hormone therapy in menopausal women: an observational study in Taiwan. BMC Public Health. 2007; 7:56. BioMed Central Full Text
• [123]Naylor CD. The complex world of prescribing behavior. JAMA. 2004; 291:104-106.
• [124]Lawton B, Rose S, McLeod D, Dowell A. Changes in use of hormone replacement therapy after the report from the Women’s Health Initiative: cross sectional survey of users. BMJ. 2003; 327:845-846.
• [125]Voorn VM, de Mheen PJ. M-v, So-Osman C, Vlieland TP, Koopman-van Gemert AW, Nelissen RG, et al. Designing a strategy to implement cost-effective blood transfusion management in elective hip and knee arthroplasties: a study protocol. Implement Sci. 2012; 7:58. BioMed Central Full Text
• [126]Atkins D. Connecting research and patient care: lessons from the VA’s Quality Enhancement Research Initiative. J General Intern Med. 2009; 25:1-2.
• [127]Elshaug AG, McWilliams JM, Landon BE. The value of low-value lists. JAMA. 2013; 309:775-776.
• [128]Gershengorn HB, Wunsch H. Understanding changes in established practice: pulmonary artery catheter use in critically ill patients. Crit Care Med. 2013; 41:2667-2676.
• [129]Colmenares P. Proposal for a state health technology assessment program. WMJ. 2012; 111:176-182.
• [130]‘Do not do’ recommendations. National Institute for Health and Care Excellence. 2014 http://www.nice.org.uk/proxy/?sourceUrl=http%3a%2f%2fwww.nice.org.uk%2fusingguidance%2fdonotdorecommendations%2fsearch.jsp. Accessed 3 Jun 2014.