A review of methods and tools to assess the implementation of government policies to create healthy food environments for preventing obesity and diet-related non-communicable diseases

Implementation Science

Viroj Tangcharoensathien⁴  Anthony Worsley²  Gary Sacks¹  Stefanie Vandevijvere⁵  Mark Lawrence²  Sirinya Phulkerd³ 

[1] WHO Collaborating Centre for Obesity Prevention, Deakin University, Victoria, Australia;Centre for Physical Activity and Nutrition Research, Faculty of Health, Deakin University, Victoria, Australia;School of Exercise and Nutrition Sciences, Faculty of Health, Deakin University, Victoria, Australia;International Health Policy Program, Ministry of Public Health, Nonthaburi, Thailand;Department of Epidemiology and Biostatistics, School of Population Health, Faculty of Medical and Health Sciences, University of Auckland, Auckland, New Zealand

关键词: Obesity;    Food policy;    Healthy food environments;    Implementation;    Assessment;   

Others  :  1235781
DOI  :  10.1186/s13012-016-0379-5

 received in 2015-09-24, accepted in 2016-01-31,  发布年份 2016

【 摘 要 】

Background

Policies to create healthy food environments are recognized as critical components of efforts to prevent obesity and diet-related non-communicable diseases. There has not been a systematic review of existing methods and tools used to assess the implementation of these government policies. The purpose of this study was to review methods and tools used for assessing the implementation of government policies to create healthy food environments.

The study conducted a systematic literature search. Multiple databases as well as the grey literature were searched. All study designs and review papers on assessing the implementation of government policies to create healthy food environments were included. A quality assessment of the methods and tools identified from relevant studies was carried out using the following four criteria: comprehensiveness, relevance, generalizability and feasibility. This quality assessment was completed by two independent reviewers.

Results

The review identified 52 studies across different policy areas, levels and settings. Self-administered questionnaires and policy checklists were most commonly applied to assess the extent of policy implementation, whereas semi-structured interviews were most commonly used to evaluate the implementation process. Measures varied widely, with the existence of policy implementation the aspect most commonly assessed. The most frequently identified barriers and facilitators for policy implementation were infrastructure support, resources and stakeholder engagement. The assessment of policy implementation on food environments was usually undertaken in combination with other policy areas, particularly nutrition education and physical activity. Three tools/methods were rated ‘high’ quality and 13 tools/methods received ‘medium’ quality ratings.

Conclusions

Harmonization of the available high-quality methods and tools is needed to ensure that assessment of government policy implementation can be compared across different countries and settings and over time. This will contribute to efforts to increase government accountability for their actions to improve the healthiness of food environments.

【 授权许可】

   
2016 Phulkerd et al.

【 图 表 】

Fig. 1.

【 参考文献 】

• [1]Swinburn B, Sacks G, Hall K, McPherson K, Finegood D, Moodie M et al.. The global obesity pandemic: shaped by global drivers and local environments. Lancet. 2011; 378:804-14.
• [2]Ledikwe J, Blanck H, Kettel Khan L, Serdula M, Seymour J, Tohill B et al.. Dietary energy density is associated with energy intake and weight status in US adults. Am J Clin Nutr. 2006; 83:1362-8.
• [3]Perez-Escamilla R, Obbagy J, Altman J, Essery E, McGrane M, Wong Y et al.. Dietary energy density and body weight in adults and children: a systematic review. J Acad Nutr Diet. 2012; 112:671-84.
• [4]Global status report on noncommunicable diseases 2010. World Health Organization, Geneva; 2011.
• [5]Swinburn B, Vandevijvere S, Kraak V, Sacks G, Snowdon W, Hawkes C et al.. Monitoring and benchmarking government policies and actions to improve the healthiness of food environments: a proposed government healthy food environment policy index. Obes Rev. 2013; 14 Suppl 1:24-37.
• [6]Story M, Kaphingst K, Robinson-O’Brien R, Glanz K. Creating healthy food and eating environments: policy and environmental approaches. Annu Rev Public Health. 2008; 29:253-72.
• [7]Global action plan for the prevention and control of noncommunicable diseases 2013–2020. World Health Organization, Geneva; 2013.
• [8]Global nutrition policy review: what does it take to scale up nutrition action?. World Health Organization, Geneva; 2013.
• [9]NOURISHING framework. World Cancer Research Fund International, London; 2014. http://www. wcrf.org/int/policy/nourishing-framework. Accessed 6 Nov 2014
• [10]Beaglehole R, Bonita R, Ezzati M, Alleyne G, Dain K, Kishore S et al.. NCD countdown 2025: accountability for the 25 × 25 NCD mortality reduction target. Lancet. 2014; 384(9938):105-7.
• [11]Kraak V, Swinburn B, Lawrence M, Harrison P. An accountability framework to promote healthy food environments. Public Health Nutr. 2014; 17(11):1-17.
• [12]Beaglehole R, Bonita R, Horton R. Independent global accountability for NCDs. Lancet. 2013; 381(9867):602-5.
• [13]Swinburn B, Kraak V, Rutter H, Vandevijvere S, Lobstein T, Sacks G et al.. Strengthening of accountability systems to create healthy food environments and reduce global obesity. Lancet. 2015; 385:2534-45.
• [14]Swinburn B, Sacks G, Vandevijvere S, Kumanyika S, Lobstein T, Neal B et al.. INFORMAS (International Network for Food and Obesity/non-communicable diseases Research, Monitoring and Action Support): overview and key principles. Obes Rev. 2013; 14(S1):1-12.
• [15]Bonita R, Beaglehole R, Kjellstrom T. Basic epidemiology. 2nd ed. World Health Organization, Geneva; 2007.
• [16]Bowling A. Research methods in health: investigating health and health services. 4th ed. McGraw-Hill Education, Maidenhead; 2014.
• [17]Hagger-Johnson G. Introduction to research methods and data analysis in the health sciences. Taylor and Francis, Hoboken; 2014.
• [18]Hammond M, Wellington J. Research methods: the key concepts. Taylor and Francis, Hoboken; 2012.
• [19]Lawrence M, Worsley A. Public health nutrition: from principles to practice. Allen & Unwin, Crows Nest; 2007.
• [20]Lovegrove JA, Hodson L, Sharma S, Lanham-New SA. Nutrition research methodologies. 1st ed. Wiley, Hoboken; 2015.
• [21]Hill R. What sample size is “enough” in Internet survey research? An electronic journal for the 21st century. 1998;6(3–4).
• [22]Isaac S, Michael WB. Handbook in research and evaluation. Educational and Industrial Testing Services, San Diego, CA; 1995.
• [23]Treece EW, Treece JW. Elements of research in nursing. 3rd ed. Mosby, St. Louis, MO; 1982.
• [24]Hertzog MA. Considerations in determining sample size for pilot studies. Res Nurs Health. 2008; 31(2):180-91.
• [25]Connelly LM. Pilot studies. Medsurg Nurs. 2008; 17(6):411-2.
• [26]Evans N, Lasen M, Tsey K. Chapter 2. Research method. A systematic review of rural development research: characteristics, design quality and engagement with sustainability. Springer, Cham; 2015.
• [27]Organisation for Economic Co-operation and Development. Chapter 3. Assessment of learning outcomes and teaching quality in Kazakhstan. Reviews of national policies for education: secondary education in Kazakhstan. Paris: Paris Organisation for Economic Co-operation and Development (OECD); 2014.
• [28]Fink A. Conducting research literature reviews: from the internet to paper. 4th ed. Sage, Thousand Oaks, California; 2014.
• [29]Social Care Institute for Excellence. Guidelines for preparing a research review. Social Care Institute for Excellence. 2016. http://www.scie.org.uk/opportunities/commissions/. Accessed 7 January 2016.
• [30]MacDermott L, Stead M, Hastings G. Does food promotion influence children’s diet? A review of evidence. Childhood obesity: contemporary issues. Cameron N, Norgan NG, Ellison GTH, editors. Taylor & Francis, Boca Raton, FL; 2005.
• [31]Willis BH, Quigley M. The assessment of the quality of reporting of meta-analyses in diagnostic research: a systematic review. BMC Med Res Methodol. 2011; 11(1):1-11. BioMed Central Full Text
• [32]Harper SL, Edge VL, Schuster-Wallace CJ, Ar-Rushdi M, McEwen SA. Improving aboriginal health data capture: evidence from a health registry evaluation. Epidemiol Infect. 2011; 139(11):1774-83.
• [33]Ardzejewska K, Tadros R, Baxter D. A descriptive study on the barriers and facilitators to implementation of the NSW (Australia) Healthy School Canteen Strategy. Health Educ J. 2013; 72(2):136-45.
• [34]Hawkes C, Lobstein T, Polmark C. Regulating the commercial promotion of food to children: a survey of actions worldwide. Int J Pediatr Obes. 2011; 6(2):83-94.
• [35]Holthe A, Larsen T, Samdal O. Implementation of national guidelines for healthy school meals: the relationship between process and outcome. Scan J Educ Res. 2011; 55(4):357-78.
• [36]Rodriguez-Fernandez R, Siopa M, Simpson SJ, Amiya RM, Breda J, Cappuccio FP. Current salt reduction policies across gradients of inequality-adjusted human development in the WHO European region: minding the gaps. Public Health Nutr. 2014; 17(8):1894-904.
• [37]Seo D. Comparison of school food policies and food preparation practices before and after the local wellness policy among Indiana high schools. Am J Health Ed. 2009; 40(3):165-73.
• [38]Silberfarb LO, Savre S, Geber G. An approach to assessing multicity implementation of healthful food access policy, systems, and environmental changes. Prev Chronic Dis. 2014; 11:130233.
• [39]Vandevijvere S, Swinburn B. Towards global benchmarking of food environments and policies to reduce obesity and diet-related non-communicable diseases: design and methods for nation-wide surveys. BMJ Open. 2014; 4(5): Article ID e005339
• [40]Vandevijvere S, Swinburn B. Pilot test of the Healthy Food Environment Policy Index (Food-EPI) to increase government actions for creating healthy food environments. BMJ Open. 2015; 5(1): Article ID e006194
• [41]Olstad DL, Raine KD, Nykiforuk CIJ. Development of a report card on healthy food environments and nutrition for children in Canada. Prev Med. 2014; 69:287-95.
• [42]Evaluation of the Norwegian nutrition policy with a focus on the Action Plan on Nutrition 2007–2011. The Regional Office for Europe of the World Health Organization, Copenhagen; 2013.
• [43]Mâsse LC, Naiman D, Naylor PJ. From policy to practice: implementation of physical activity and food policies in schools. Int J Behav Nutr Phys Act. 2013; 10:71. BioMed Central Full Text
• [44]Martin J, Peeters A, Honisett S, Mavoa H, Swinburn B, de Silva-Sanigorski A. Benchmarking government action for obesity prevention-an innovative advocacy strategy. Obes Res Clin Pract. 2013; 8(4):e388-98.
• [45]Barnidge EK, Radvanyi C, Duggan K, Motton F, Wiggs I, Baker EA et al.. Understanding and addressing barriers to implementation of environmental and policy interventions to support physical activity and healthy eating in rural communities. J Rural Health. 2013; 29(1):97-105.
• [46]Anderson L, Foster S, Flynn R, Fitterman M. Assessing public policies and assets that affect obesity risk while building new public health partnerships, New Hampshire, 2011. Prev Chronic Dis. 2013; 10(8):120349.
• [47]Schwartz MB, Henderson KE, Falbe J, Novak SA, Wharton CM, Long MW et al.. Strength and comprehensiveness of district school wellness policies predict policy implementation at the school level. J Sch Health. 2012; 82(6):262-7.
• [48]Phillips M, Goodell M, Raczynski J, Philyaw Perez A. Creating and using index scores in the analysis of school policy implementation and impact. J Sch Health. 2012; 82(6):253-61.
• [49]Budd EL, Schwarz C, Yount BW, Haire-Joshu D. Factors influencing the implementation of school wellness policies in the United States, 2009. Prev Chronic Dis. 2012; 9:110296.
• [50]Beam M, Ehrlich G, Donze Black J, Block A, Leviton LC. Evaluation of the healthy schools program: part I. Interim progress. Prev Chronic Dis. 2012; 9(3):110106.
• [51]Pitt Barnes S, Robin L, O’Toole TP, Dawkins N, Kettel Khan L, Leviton LC. Results of evaluability assessments of local wellness policies in 6 US school districts. J Sch Health. 2011; 81(8):502-11.
• [52]Gaines AB, Lonis-Shumate SR, Gropper SS. Evaluation of Alabama public school wellness policies and state school mandate implementation. J Sch Health. 2011; 81(5):281-7.
• [53]Haire-Joshu D, Elliott M, Schermbeck R, Taricone E, Green S, Brownson RC. Surveillance of obesity-related policies in multiple environments: the Missouri Obesity, Nutrition, and Activity Policy Database, 2007–2009. Prev Chronic Dis. 2010; 7(4):A80.
• [54]Belansky ES, Cutforth N, Delong E, Litt J, Gilbert L, Scarbro S et al.. Early effects of the federally mandated local wellness policy on school nutrition environments appear modest in Colorado’s rural, low-income elementary schools. J Am Diet Assoc. 2010; 110(11):1712-7.
• [55]Longley CH, Sneed J. Effects of federal legislation on wellness policy formation in school districts in the United States. J Am Diet Assoc. 2009; 109(1):95-101.
• [56]Leowski J, Krishnan A. Capacity to control noncommunicable diseases in the countries of South-East Asia. Health Pol. 2009; 92(1):43-8.
• [57]Yeatman H. Action or inaction? Food and nutrition in Australian local governments. Public Health Nutr. 2008; 12(9):1399-407.
• [58]Probart C, McDonnell E, Weirich JE, Schilling L, Fekete V. Statewide assessment of local wellness policies in Pennsylvania public school districts. J Am Diet Assoc. 2008; 108(9):1497-502.
• [59]Progress or promises? What’s working for and against healthy schools. Action for Healthy Kids, Skokie; 2008.
• [60]Molaison E, Carr D, Federico H. Investigation of school professionals’ and parents’ attitudes toward school wellness implementation in elementary schools. University: National Food Service Management Institute and University of Mississippi; 2007
• [61]Yee S, Williams-Piehota P, Sorensen A, Roussel A, Hersey J, Hamre R. The nutrition and physical activity program to prevent obesity and other chronic diseases: monitoring progress in funded states. Prev Chronic Dis. 2006; 3(1):A23.
• [62]Lang T, Dowler E, Hunter D. Review of the Scottish Diet Action Plan: progress and impacts 1996–2005. Health Scotland, Edinburgh; 2006.
• [63]Lower T, Durham G, Bow D, Larson A. Implementation of the Australian core public health functions in rural Western Australia. Aust N Z J Public Health. 2004; 28(5):418-25.
• [64]Evaluating obesity prevention efforts: a plan for measuring progress. Institute of Medicine of the National Academies Press, Washington; 2013.
• [65]Global strategy on diet, physical activity and health: a framework to monitor and evaluate implementation. World Health Organization, Geneva; 2008.
• [66]Tagtow A, Roberts S. Cultivating resilience: a food system blueprint that advances health of Iowans, farms & communities. Iowa Food Systems Council, Elkhart; 2011.
• [67]Fox A, Balarajan Y, Cheng C, Reich M. Measuring political commitment and opportunities to advance food and nutrition security: piloting a rapid assessment tool. Health Policy Plan. 2014; 30(5):1-13.
• [68]Sanchez V, Hale R, Andrews M, Cruz Y, Bettencourt V, Wexler P et al.. School wellness policy implementation: insights and recommendations from two rural school districts. Health Promot Pract. 2014; 15(3):340-8.
• [69]Middleton G, Henderson H, Evans D. Implementing a community-based obesity prevention programme: experiences of stakeholders in the north east of England. Health Prom Int. 2014; 29(2):201-11.
• [70]Fagen MC, Asada Y, Welch S, Dombrowski R, Gilmet K, Welter C et al.. Policy, systems, and environmentally oriented school-based obesity prevention: opportunities and challenges. J Prev Intervention Community. 2014; 42(2):95-111.
• [71]Taylor J, McKenna M, Butler G. Monitoring and evaluating school nutrition and physical activity policies. Can J Public Health. 2010; 101:S24-7.
• [72]MacLellan D, Holland A, Taylor J, McKenna M, Hernandez K. Implementing school nutrition policy: student and parent perspectives. Can J Diet Pract Res. 2010; 71(4):172-7.
• [73]Harris CV, Bradlyn AS, Tompkins NO, Purkey MB, Kennedy KA, Kelley GA. Evaluating the West Virginia Healthy Lifestyles Act: methods and procedures. J Phys Act Health. 2010; 7 Suppl 1:S31-9.
• [74]Agron P, Berends V, Ellis K, Gonzalez M. School wellness policies: perceptions, barriers, and needs among school leaders and wellness advocates. J Sch Health. 2010; 80(11):527-35.
• [75]Allender S, Gleeson E, Crammond B, Sacks G, Lawrence M, Peeters A et al.. Moving beyond ‘rates, roads and rubbish’: how do local governments make choices about healthy public policy to prevent obesity? Australia and New Zealand Health Policy. 2009; 6:20. BioMed Central Full Text
• [76]McDonnell E, Probart C, Weirich J. School foodservice directors’ perceptions and concerns about local wellness policy development, implementation, and enforcement. J Child Nutr Manag. 2006;30(1). http://docs. schoolnutrition.org/newsroom/jcnm/06spring/mcdonnell/index.asp
• [77]Dunět D, Butterfoss F, Hamre R, Kuester S. Using the State Plan Index to evaluate the quality of state plans to prevent obesity and other chronic diseases. Prev Chronic Dis. 2005; 2:1-10.
• [78]Abery E, Drummond C. Implementation of mandatory nutritional guidelines in South Australian primary school canteens: a qualitative study. Improv Sch. 2014; 17(1):41-53.
• [79]Crammond B, Van C, Allender S, Peeters A, Lawrence M, Sacks G et al.. The possibility of regulating for obesity prevention—understanding regulation in the Commonwealth Government. Obes Rev. 2013; 14(3):213-21.
• [80]Shill J, Mavoa H, Allender S, Lawrence M, Sacks G, Peeters A et al.. Government regulation to promote healthy food environments—a view from inside state governments. Obes Rev. 2012; 13(2):162-73.
• [81]Chung A, Shill J, Swinburn B, Mavoa H, Lawrence M, Loff B et al.. An analysis of potential barriers and enablers to regulating the television marketing of unhealthy foods to children at the state government level in Australia. BMC Public Health. 2012; 12:1123. BioMed Central Full Text
• [82]Krueger R, Casey M. Focus groups: a practical guide for applied research. Sage Publications, Thousand Oaks; 2000.
• [83]Rekve D, editor. Implementation of the global strategy to reduce the harmful use of alcohol. Committee on National Alcohol Policy and Action 8th Meeting; 2011 March 1st-2nd; Luxembourg-Kirchberg, rue Alcide De Gasperi: World Health Organization; 2011.
• [84]The International Baby Food Action Network Asia. World Breastfeeding Trends Initiative (WBTi). Dehli: the International Baby Food Action Network Asia. 2008.
• [85]Infant and young child feeding: a tool for assessing national practices and policies and programmes. World Health Organization, Geneva; 2003.
• [86]Country implementation of the international code of marketing of breast-milk substitutes: status report 2011. World Health Organisation, Geneva; 2013.
• [87]WHO report on the global tobacco epidemic, 2013: enforcing bans on tobacco advertising, promotion and sponsorship. World Health Organization, Luxembourg; 2013.
• [88]Cox A, Lutz B, Webb D, Sahal-Estime M, Small R, Trivedi V. Development planning and tobacco control: integrating the who framework convention on tobacco control into UN and national development planning instruments. United Nations Development Programme, New York; 2014.
• [89]Infant and young child feeding programming status. United Nations Children’s Fund, New York; 2012.