Use of the Environment and Policy Evaluation and Observation as a Self-Report Instrument (EPAO-SR) to measure nutrition and physical activity environments in child care settings: validity and reliability evidence

International Journal of Behavioral Nutrition and Physical Activity

Derek Hales²  Christina McWilliams¹  Stephanie Mazzucca²  Dianne S. Ward³ 

[1] Center for Health Promotion and Disease Prevention, University of North Carolina at Chapel Hill, 1700 Martin L. King Jr. Blvd., CB 7426, Chapel Hill 27599-7426, NC, USA;Department of Nutrition, Gillings School of Global Public Health, and Center for Health Promotion and Disease Prevention, University of North Carolina at Chapel Hill, 1700 Martin L. King Jr. Blvd., CB 7426, Chapel Hill 27599-7426, NC, USA;Department of Nutrition, Gillings School of Global Public Health, University of North Carolina at Chapel Hill, 2207 McGavran-Greenberg Hall, CB 7461, Chapel Hill 27599-7461, NC, USA

关键词: Measurement;    Physical activity;    Nutrition;    Preschoolers;    Child care;   

Others  :  1231258
DOI  :  10.1186/s12966-015-0287-0

 received in 2015-03-13, accepted in 2015-09-17,  发布年份 2015

【 摘 要 】

Background

Early care and education (ECE) centers are important settings influencing young children’s diet and physical activity (PA) behaviors. To better understand their impact on diet and PA behaviors as well as to evaluate public health programs aimed at ECE settings, we developed and tested the Environment and Policy Assessment and Observation – Self-Report (EPAO-SR), a self-administered version of the previously validated, researcher-administered EPAO.

Methods

Development of the EPAO-SR instrument included modification of items from the EPAO, community advisory group and expert review, and cognitive interviews with center directors and classroom teachers. Reliability and validity data were collected across 4 days in 3–5 year old classrooms in 50 ECE centers in North Carolina. Center teachers and directors completed relevant portions of the EPAO-SR on multiple days according to a standardized protocol, and trained data collectors completed the EPAO for 4 days in the centers. Reliability and validity statistics calculated included percent agreement, kappa, correlation coefficients, coefficients of variation, deviations, mean differences, and intraclass correlation coefficients (ICC), depending on the response option of the item.

Results

Data demonstrated a range of reliability and validity evidence for the EPAO-SR instrument. Reporting from directors and classroom teachers was consistent and similar to the observational data. Items that produced strongest reliability and validity estimates included beverages served, outside time, and physical activity equipment, while items such as whole grains served and amount of teacher-led PA had lower reliability (observation and self-report) and validity estimates. To overcome lower reliability and validity estimates, some items need administration on multiple days.

Conclusions

This study demonstrated appropriate reliability and validity evidence for use of the EPAO-SR in the field. The self-administered EPAO-SR is an advancement of the measurement of ECE settings and can be used by researchers and practitioners to assess the nutrition and physical activity environments of ECE settings.

【 授权许可】

   
2015 Ward et al.

【 参考文献 】

• [1]Ogden CL, Carroll MD, Kit BK, Flegal KM. Prevalence of obesity and trends in body mass index among US children and adolescents, 1999–2010. JAMA. 2012; 307(5):483-90.
• [2]Singh AS, Mulder C, Twisk JW, van Mechelen W, Chinapaw MJ. Tracking of childhood overweight into adulthood: a systematic review of the literature. Obes Rev. 2008; 9(5):474-88.
• [3]Dietz WH. Health consequences of obesity in youth: childhood predictors of adult disease. Pediatrics. 1998; 101(3):518-525.
• [4]Freedman DS, Serdula MK, Srinivasan SR, Berenson GS. Relation of circumferences and skinfold thicknesses to lipid and insulin concentrations in children and adolescents: the Bogalusa Heart Study. Am J Clin Nutr. 1999; 69(2):308-17.
• [5]Pinhas-Hamiel O, Dolan LM, Daniels SR, Standiford D, Khoury PR, Zeitler P. Increased incidence of non-insulin-dependent diabetes mellitus among adolescents. J Pediatr. 1996; 128(5 Pt 1):608-15.
• [6]Schwimmer JB, Deutsch R, Kahen T, Lavine JE, Stanley C, Behling C. Prevalence of fatty liver in children and adolescents. Pediatrics. 2006; 118(4):1388-1393.
• [7]Dietz W. Overweight in childhood and adolescence. N Engl J Med. 2004; 350(9):855-7.
• [8]Monteiro PO, Victora CG. Rapid growth in infancy and childhood and obesity in later life—a systematic review. Obes Rev. 2005; 6(2):143-54.
• [9]Nader PR, O'Brien M, Houts R, Bradley R, Belsky J, Crosnoe R et al.. Identifying risk for obesity in early childhood. Pediatrics. 2006; 118(3):e594-601.
• [10]Story M, Kaphingst KM, Robinson-O'Brien R, Glanz K. Creating healthy food and eating environments: policy and environmental approaches. Annu Rev Public Health. 2008; 29:253-72.
• [11]Larson N, Ward DS, Neelon SB, Story M. What role can child-care settings play in obesity prevention? A review of the evidence and call for research efforts. J Am Diet Assoc. 2011; 111(9):1343-62.
• [12]Early childhood program participation survey of the national household education surveys program. 2006.
• [13]Stang J, Bayerl CT. Position of the American Dietetic Association: child and adolescent food and nutrition programs. J Am Diet Assoc. 2003; 103(7):887-93.
• [14]Caring for our children: National health and safty performance standards; guidelines for early care and education programs. American Academy of Pediatrics; Washington: American Public Health Association, Elk Grove Village; 2011.
• [15]Ball SC, Benjamin SE, Ward DS. Dietary intakes in North Carolina child-care centers: are children meeting current recommendations? J Am Diet Assoc. 2008; 108(4):718-21.
• [16]Padget A, Briley ME. Dietary intakes at child-care centers in central Texas fail to meet Food Guide Pyramid recommendations. J Am Diet Assoc. 2005; 105(5):790-3.
• [17]Reilly JJ. Low levels of objectively measured physical activity in preschoolers in child care. Med Sci Sports Exerc. 2010; 42(3):502-7.
• [18]Ward DS, Vaughn A, Story M. Expert and stakeholder consensus on priorities for obesity prevention research in early care and education settings. Child Obes. 2013; 9(2):116-24.
• [19]Ward D, Hales D, Haverly K, Marks J, Benjamin S, Ball S et al.. An instrument to assess the obesogenic environment of child care centers. Am J Health Behav. 2008; 32(4):380-6.
• [20]Ward DS, Benjamin SE, Ammerman AS, Ball SC, Neelon BH, Bangdiwala SI. Nutrition and physical activity in child care: results from an environmental intervention. Am J Prev Med. 2008; 35(4):352-356.
• [21]Ammerman AS, Ward DS, Benjamin SE, Ball SC, Sommers JK, Molloy M et al.. An intervention to promote healthy weight: Nutrition and Physical Activity Self-Assessment for Child Care (NAP SACC) theory and design. Prev Chronic Dis. 2007; 4(3):A67.
• [22]Benjamin Neelon SE, Vaughn A, Ball SC, McWilliams C, Ward DS. Nutrition practices and mealtime environments of North Carolina child care centers. Child Obes. 2012; 8(3):216-23.
• [23]McWilliams C, Ball SC, Benjamin SE, Hales D, Vaughn A, Ward DS. Best-practice guidelines for physical activity at child care. Pediatrics. 2009; 124(6):1650-9.
• [24]Benjamin Neelon SE, Taveras EM, Ostbye T, Gillman MW. Preventing obesity in infants and toddlers in child care: results from a pilot randomized controlled trial. Matern Child Health J. 2014; 18(5):1246-57.
• [25]Gubbels JS, Van Kann DH, Jansen MW. Play equipment, physical activity opportunities, and children’s activity levels at childcare. J Environ Public Health. 2012; 2012:326520.
• [26]Gubbels JS, Kremers SP, van Kann DH, Stafleu A, Candel MJ, Dagnelie PC et al.. Interaction between physical environment, social environment, and child characteristics in determining physical activity at child care. Health Psychol. 2011; 30(1):84-90.
• [27]Bower JK, Hales DP, Tate DF, Rubin DA, Benjamin SE, Ward DS. The childcare environment and children’s physical activity. Am J Prev Med. 2008; 34(1):23-9.
• [28]Lyn R, Maalouf J, Evers S, Davis J, Griffin M. Nutrition and physical activity in child care centers: the impact of a wellness policy initiative on environment and policy assessment and observation outcomes, 2011. Prev Chronic Dis. 2013; 10:E83.
• [29]Maalouf J, Evers SC, Griffin M, Lyn R. Assessment of mealtime environments and nutrition practices in child care centers in Georgia. Child Obes. 2013;9(5):437–45.
• [30]Vanderloo LM, Tucker P, Johnson AM, van Zandvoort MM, Burke SM, Irwin JD. The influence of centre-based childcare on preschoolers’ physical activity levels: a cross-sectional study. Int J Environ Res Public Health. 2014; 11(2):1794-802.
• [31]Tucker P, Vanderloo LM, Newnham-Kanas C, Burke SM, Irwin JD, Johnson AM et al.. Learning Environments’ Activity Potential for Preschoolers (LEAPP): study rationale and design. J Public Health Res. 2013; 2(2):e19.
• [32]Gubbels JS, Kremers SP, Stafleu A, Dagnelie PC, de Vries NK, Thijs C. Child-care environment and dietary intake of 2- and 3-year-old children. J Hum Nutr Diet. 2010; 23(1):97-101.
• [33]Falbe J, Kenney EL, Henderson KE, Schwartz MB. The Wellness Child Care Assessment Tool: a measure to assess the quality of written nutrition and physical activity policies. J Am Diet Assoc. 2011; 111(12):1852-60.
• [34]Copeland KA, Sherman SN, Khoury JC, Foster KE, Saelens BE, Kalkwarf HJ. Wide variability in physical activity environments and weather-related outdoor play policies in child care centers within a single county of Ohio. Arch Pediatr Adolesc Med. 2011; 165(5):435-42.
• [35]Henderson KE, Grode GM, Middleton AE, Kenney EL, Falbe J, Schwartz MB. Validity of a measure to assess the child-care nutrition and physical activity environment. J Am Diet Assoc. 2011;111(9):1306–13.
• [36]Willis GB. Cognitive interviewing: a tool for improving questionnaire design. Sage Publications, Thousand Oaks; 2005.
• [37]Shrout PE. Measurement reliability and agreement in psychiatry. Stat Methods Med Res. 1998; 7(3):301-17.
• [38]Frazier BN et al.. I’ll have what she’s having: the impact of model characteristics on children’s food choices. Dev Sci. 2012; 15(1):87-98.
• [39]Gibson EL, Kreichauf S, Wildgruber A, Vögele C, Summerbell CD, Nixon C, et al. A narrative review of psychological and educational strategies applied to young children’s eating behaviours aimed at reducing obesity risk. Obes Rev. 2012;13 Suppl 1:85–95.
• [40]Hendy HM, Raudenbush B. Effectiveness of teacher modeling to encourage food acceptance in preschool children. Appetite. 2000; 34(1):61-76.
• [41]Summerbell CD, Moore HJ, Vögele C, Kreichauf S, Wildgruber A, Manios Y et al.. Evidence-based recommendations for the development of obesity prevention programs targeted at preschool children. Obes Rev. 2012; 13 Suppl 1:129-32.
• [42]Horne PJ, Hardman CA, Lowe CF, Tapper K, Le Noury J, Madden P, et al. Increasing parental provision and children’s consumption of lunchbox fruit and vegetables in Ireland: the Food Dudes intervention. Eur J Clin Nutr. 2009;63(5):613–8.
• [43]Murashima M, Hoerr SL, Hughes SO, Kaplowitz S. Confirmatory factor analysis of a questionnaire measuring control in parental feeding practices in mothers of Head Start children. Appetite. 2011; 56(3):594-601.
• [44]Murashima M, Hoerr SL, Hughes SO, Kaplowitz SA. Feeding behaviors of low-income mothers: directive control relates to a lower BMI in children, and a nondirective control relates to a healthier diet in preschoolers. Am J Clin Nutr. 2012; 95(5):1031-7.
• [45]Berge JM. A review of familial correlates of child and adolescent obesity: what has the 21st century taught us so far? Int J Adolesc Med Health. 2009; 21(4):457-83.
• [46]Hughes SO, Patrick H, Power TG, Fisher JO, Anderson CB, Nicklas TA. The impact of child care providers’ feeding on children’s food consumption. J Dev Behav Pediatr. 2007; 28(2):100-7.
• [47]Cosco NG, Moore RC, Islam MZ. Behavior mapping: a method for linking preschool physical activity and outdoor design. Med Sci Sports Exerc. 2010; 42(3):513-9.
• [48]Cosco NG, Moore RC, Smith WR. Childcare outdoor renovation as a built environment health promotion strategy: evaluating the preventing obesity by design intervention. Am J Health Promot. 2014; 28(3 Suppl):S27-32.
• [49]Cardon G, Van Cauwenberghe E, Labarque V, Haerens L, De Bourdeaudhuij I. The contribution of preschool playground factors in explaining children’s physical activity during recess. Int J Behav Nutr Phys Act. 2008; 5:11. BioMed Central Full Text