Unique Views on Obesity-Related Behaviors and Environments: Research Using Still and Video Images

in Journal for the Measurement of Physical Behaviour
Restricted access

Purchase article

USD $24.95

Student 1 year subscription

USD $37.00

1 year subscription

USD $50.00

Student 2 year subscription

USD $71.00

2 year subscription

USD $93.00

Objectives: To document challenges to and benefits from research involving the use of images by capturing examples of such research to assess physical activity– or nutrition-related behaviors and/or environments. Methods: Researchers (i.e., key informants) using image capture in their research were identified through knowledge and networks of the authors of this paper and through literature search. Twenty-nine key informants completed a survey covering the type of research, source of images, and challenges and benefits experienced, developed specifically for this study. Results: Most respondents used still images in their research, with only 26.7% using video. Image sources were categorized as participant generated (n = 13; e.g., participants using smartphones for dietary assessment), researcher generated (n = 10; e.g., wearable cameras with automatic image capture), or curated from third parties (n = 7; e.g., Google Street View). Two of the major challenges that emerged included the need for automated processing of large datasets (58.8%) and participant recruitment/compliance (41.2%). Benefit-related themes included greater perspectives on obesity with increased data coverage (34.6%) and improved accuracy of behavior and environment assessment (34.6%). Conclusions: Technological advances will support the increased use of images in the assessment of physical activity, nutrition behaviors, and environments. To advance this area of research, more effective collaborations are needed between health and computer scientists. In particular development of automated data extraction methods for diverse aspects of behavior, environment, and food characteristics are needed. Additionally, progress in standards for addressing ethical issues related to image capture for research purposes is critical.

Carlson is with the Center for Children’s Healthy Lifestyles and Nutrition, Children’s Mercy Kansas City, Kansas City, MO. Hipp is with the Dept. of Parks, Recreation, and Tourism Management, College of Natural Resources, and a Fellow at the Center for Geospatial Analytics, North Carolina State University, Raleigh, NC. Kerr is with the Dept. of Family Medicine and Public Health, Moores Cancer Center, University of California San Diego, La Jolla, CA. Horowitz and Berrigan are with the Division of Cancer Control and Population Sciences, National Cancer Institute, Bethesda, MD. Carlson and Hipp are co-first authors.

Carlson (jacarlson@cmh.edu) is corresponding author.
Journal for the Measurement of Physical Behaviour
Article Sections
References
  • BaderM.D.M.MooneyS.J.BennettB. & RundleA.G. (2017). The promise, practicalities, and perils of virtually auditing neighborhoods using Google street view. The ANNALS of the American Academy of Political and Social Science 669(1) 1840. doi:10.1177/0002716216681488

    • Crossref
    • Search Google Scholar
    • Export Citation
  • BaderM.D.M.MooneyS.J.LeeY.J.SheehanD.NeckermanK.M.RundleA.G. & TeitlerJ.O. (2015). Development and deployment of the Computer Assisted Neighborhood Visual Assessment System (CANVAS) to measure health-related neighborhood conditions. Health & Place 31163172. PubMed ID: 25545769 doi:10.1016/j.healthplace.2014.10.012

    • Crossref
    • Search Google Scholar
    • Export Citation
  • BarrettD.P.XuR.YuH. & SiskindJ.M. (2016). Collecting and annotating the large continuous action dataset. Machine Vision and Applications 27(7) 983995. doi:10.1007/s00138-016-0768-4

    • Crossref
    • Search Google Scholar
    • Export Citation
  • BossardL.GuillauminM. & Van GoolL. (2014). Food-101 – Mining discriminative components with random forests. In D. FleetT. PajdlaB. Schiele & T. Tuytelaars (Eds.) Computer vision – ECCV 2014: 13th European Conference Zurich Switzerland September 6–12 2014 proceedings part VI (pp. 446461). Cham, Switzerland: Springer International Publishing.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • BousheyC.J.SpodenM.DelpE.J.ZhuF.BoschM.AhmadZ.KerrD. (2017). Reported energy intake accuracy compared to doubly labeled water and usability of the mobile food record among community dwelling adults. Nutrients 9(3) 312. doi:10.3390/nu9030312

    • Crossref
    • Search Google Scholar
    • Export Citation
  • BousheyC.J.SpodenM.ZhuF.M.DelpE.J. & KerrD.A. (2016). New mobile methods for dietary assessment: Review of image-assisted and image-based dietary assessment methods. Proceedings of the Nutrition Society 76(3) 283294. PubMed ID: 27938425 doi:10.1017/S0029665116002913

    • Crossref
    • Search Google Scholar
    • Export Citation
  • CarlsonJ.A.LiuB.SallisJ.F.KerrJ.HippJ.A.StaggsV.S.VasconcelosN.M. (2017). Automated ecological assessment of physical activity: Advancing direct observation. International Journal of Environmental Research and Public Health 14(12) 1487. PubMed ID: 29194358 doi:10.3390/ijerph14121487

    • Crossref
    • Search Google Scholar
    • Export Citation
  • ColabianchiN. (2015). Improving environmental measures in obesity research using innovative technology. (1R21CA188481-01-A1). Washington, DC: NIH, Research Portfolio Online Reporting Tools (RePORT); Retrieved from https://projectreporter.nih.gov/.

    • Search Google Scholar
    • Export Citation
  • CowburnG.MatthewsA.DohertyA.HamiltonA.KellyP.WilliamsJ.NelsonM. (2015). Exploring the opportunities for food and drink purchasing and consumption by teenagers during their journeys between home and school: A feasibility study using a novel method. Public Health Nutrition 19(1) 93103. PubMed ID: 25874731 doi:10.1017/S1368980015000889

    • Crossref
    • Search Google Scholar
    • Export Citation
  • DavisD.S.GoldmonM.V. & Coker-AppiahD.S. (2011). Using a community-based participatory research approach to develop a faith-based obesity intervention for african american children. Health Promotion Practice 12(6) 811822. PubMed ID: 21540194 doi:10.1177/1524839910376162

    • Crossref
    • Search Google Scholar
    • Export Citation
  • DengJ.DongW.SocherR.LiL.J.KaiL. & LiF.F. (2009June 20–25). ImageNet: A large-scale hierarchical image database. Paper presented at the 2009 IEEE Conference on Computer Vision and Pattern RecognitionMiami, FL.

    • Search Google Scholar
    • Export Citation
  • EvensonK.R.JonesS.A.HollidayK.M.CohenD.A. & McKenzieT.L. (2016). Park characteristics, use, and physical activity: A review of studies using SOPARC (System for Observing Play and Recreation in Communities). Preventive Medicine 86153166. PubMed ID: 26946365 doi:10.1016/j.ypmed.2016.02.029

    • Crossref
    • Search Google Scholar
    • Export Citation
  • EylerA.A.BlanckH.M.GittelsohnJ.KarpynA.McKenzieT.L.PartingtonS.WintersM. (2015). Physical activity and food environment assessments: Implications for practice. American Journal of Preventive Medicine 48(5) 639645. PubMed ID: 25891064 doi:10.1016/j.amepre.2014.10.008

    • Crossref
    • Search Google Scholar
    • Export Citation
  • FultonJ.E.CarlsonS.A.AinsworthB.E.BerriganD.CarlsonC.DornJ.M.WendelA. (2016). Strategic priorities for physical activity surveillance in the United States. Translational Journal of the American College of Sports Medicine 1(13) 111123. doi:10.1249/tjx.0000000000000020

    • Search Google Scholar
    • Export Citation
  • GlanzK.SallisJ.F.SaelensB.E. & FrankL.D. (2007). Nutrition Environment Measures Survey in Stores (NEMS-S): Development and evaluation. American Journal of Preventive Medicine 32(4) 282289. PubMed ID: 17383559 doi:10.1016/j.amepre.2006.12.019

    • Crossref
    • Search Google Scholar
    • Export Citation
  • GrahamD.J. & HippJ.A. (2014). Emerging technologies to promote and evaluate physical activity: Cutting-edge research and future directions. Front Public Health 266. PubMed ID: 25019066 doi:10.3389/fpubh.2014.00066

    • Crossref
    • Search Google Scholar
    • Export Citation
  • GreeneM.R. (2016). Estimations of object frequency are frequently overestimated. Cognition 149610. PubMed ID: 26774103 doi:10.1016/j.cognition.2015.12.011

    • Crossref
    • Search Google Scholar
    • Export Citation
  • HallK.L.VogelA.L.StipelmanB.StokolsD.MorganG. & GehlertS. (2012). A four-phase model of transdisciplinary team-based research: Goals, team processes, and strategies. Translational Behavioral Medicine 2(4) 415430. PubMed ID: 23483588 doi:10.1007/s13142-012-0167-y

    • Crossref
    • Search Google Scholar
    • Export Citation
  • HippJ.A.AdlakhaD.EylerA.A.ChangB. & PlessR. (2013). Emerging technologies: Webcams and crowd-sourcing to identify active transportation. American Journal of Preventive Medicine 44(1) 9697. PubMed ID: 23253658 doi:10.1016/j.amepre.2012.09.051

    • Crossref
    • Search Google Scholar
    • Export Citation
  • HippJ.A.AdlakhaD.EylerA.A.GernesR.KargolA.StylianouA.H. & PlessR. (2017). Learning from outdoor webcams: Surveillance of physical activity across environments. In P. ThakuriahN. Tilahun & M. Zellner (Eds.) Seeing cities through big data: Research methods and applications in urban informatics (pp. 471490). Cham, Switzerland: Springer International Publishing.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • JamesP.JankowskaM.MarxC.HartJ.E.BerriganD.KerrJ.LadenF. (2016). “Spatial Energetics”: Integrating data from GPS, accelerometry, and GIS to address obesity and inactivity. American Journal of Preventive Medicine 51(5) 792800. PubMed ID: 27528538 doi:10.1016/j.amepre.2016.06.006

    • Crossref
    • Search Google Scholar
    • Export Citation
  • JennyY.RussellB.CeL. & TorralbaA. (2009September 29October 2). LabelMe video: Building a video database with human annotations. Paper presented at the 2009 IEEE 12th International Conference on Computer VisionKyoto, Japan.

    • Search Google Scholar
    • Export Citation
  • JohanssonG. (1973). Visual perception of biological motion and a model for its analysis. Perception and Psychophysics 14(2) 201211. doi:10.3758/bf03212378

    • Crossref
    • Search Google Scholar
    • Export Citation
  • JosephR.P. & MaddockJ.E. (2016). Observational park-based physical activity studies: A systematic review of the literature. Preventive Medicine 89257277. PubMed ID: 27311337 doi:10.1016/j.ypmed.2016.06.016

    • Crossref
    • Search Google Scholar
    • Export Citation
  • KellyC.M.WilsonJ.S.BakerE.A.MillerD.K. & SchootmanM. (2013). Using Google street view to audit the built environment: Inter-rater reliability results. Annals of Behavioral Medicine 45(Suppl. 1) S108112. doi:10.1007/s12160-012-9419-9

    • Crossref
    • Search Google Scholar
    • Export Citation
  • KellyP.MarshallS.J.BadlandH.KerrJ.OliverM.DohertyA.R. & FosterC. (2013). An ethical framework for automated, wearable cameras in health behavior research. American Journal of Preventive Medicine 44(3) 314319. PubMed ID: 23415131 doi:10.1016/j.amepre.2012.11.006

    • Crossref
    • Search Google Scholar
    • Export Citation
  • KerrJ.DuncanS. & SchipperjinJ. (2011). Using global positioning systems in health research: A practical approach to data collection and processing. American Journal of Preventive Medicine 41(5) 532540. PubMed ID: 22011426 doi:10.1016/j.amepre.2011.07.017

    • Crossref
    • Search Google Scholar
    • Export Citation
  • KerrJ.MarshallS.J.GodboleS.ChenJ.LeggeA.DohertyA.R.FosterC. (2013). Using the SenseCam to improve classifications of sedentary behavior in free-living settings. American Journal of Preventive Medicine 44(3) 290296. PubMed ID: 23415127 doi:10.1016/j.amepre.2012.11.004

    • Crossref
    • Search Google Scholar
    • Export Citation
  • KingA.C.WinterS.J.SheatsJ.L.RosasL.G.BumanM.P.SalvoD.DommarcoJ.R. (2016). Leveraging citizen science and information technology for population physical activity promotion. Translational Journal of the American College of Sports Medicine 1(4) 3044. PubMed ID: 27525309 doi:10.1249/tjx.0000000000000003

    • Search Google Scholar
    • Export Citation
  • KrizhevskyA.SutskeverI. & HintonG.E. (2017). ImageNet classification with deep convolutional neural networks. Communications of the ACM 60(6) 8490. doi:10.1145/3065386

    • Crossref
    • Search Google Scholar
    • Export Citation
  • LeCunY.BengioY. & HintonG. (2015). Deep learning. Nature 521436. PubMed ID: 26017442 doi:10.1038/nature14539

  • LovedayA.SherarB.L.SandersP.J.SandersonW.P. & EsligerW.D. (2015). Technologies that assess the location of physical activity and sedentary behavior: A systematic review. Journal of Medical Internet Research 17(8) e192. PubMed ID: 26245157 doi:10.2196/jmir.4761

    • Crossref
    • Search Google Scholar
    • Export Citation
  • MacerP.J.ThomasP.J.ChalabiN. & MeechJ.F. (1996). Finding the cut of the wrong trousers: Fast video search using automatic storyboard generation. Paper presented at the Conference Companion on Human Factors in Computing SystemsVancouver, Canada.

    • Search Google Scholar
    • Export Citation
  • MartinC.K.HanH.CoulonS.M.AllenH.R.ChampagneC.M. & AntonS.D. (2009). A novel method to remotely measure food intake of free-living individuals in real time: The remote food photography method. British Journal of Nutrition 101(3) 446456. PubMed ID: 18616837 doi:10.1017/s0007114508027438

    • Crossref
    • Search Google Scholar
    • Export Citation
  • MartinD.FowlkesC.TalD. & MalikJ. (2001). A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. Paper presented at the Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001Vancouver, BC.

    • Search Google Scholar
    • Export Citation
  • McKenzieT.L.CohenD.A.SehgalA.WilliamsonS. & GolinelliD. (2006). System for Observing Play and Recreation in Communities (SOPARC): Reliability and feasibility measures. Journal of Physical Activity and Health 3(s1) S208S222. PubMed ID: 28834508 doi:10.1123/jpah.3.s1.s208

    • Crossref
    • Search Google Scholar
    • Export Citation
  • MedlerD.A. (1998). A brief history of connectionism. Neural Computing Surveys 161101.

  • MoghimiM.KerrJ.JohnsonE.GodboleS. & BelongieS. (2015). Discriminative regions: A substrate for analyzing life-logging image sequences. In X. HeS. LuoD. TaoC. XuJ. Yang & M.A. Hasan (Eds.) MultiMedia Modeling: 21st International Conference MMM 2015 Sydney NSW Australia January 5-7 2015 Proceedings Part II (pp. 357368). Cham, Switzerland: Springer International Publishing.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • MooneyS.J.BaderM.D.M.LovasiG.S.TeitlerJ.O.KoenenK.C.AielloA.E.RundleA.G. (2017). Street audits to measure neighborhood disorder: Virtual or in-person? American Journal of Epidemiology 186(3) 265273. PubMed ID: 28899028 doi:10.1093/aje/kwx004

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Nahum-ShaniI.HeklerE.B. & Spruijt-MetzD. (2015). Building health behavior models to guide the development of just-in-time adaptive interventions: A pragmatic framework. Health Psychology: Official Journal of the Division of Health Psychology American Psychological Association 34(0) 12091219. doi:10.1037/hea0000306

    • Crossref
    • Search Google Scholar
    • Export Citation
  • National Institutes of Health. (2017). Certificates of Confidentiality (CoC). Retrieved from https://humansubjects.nih.gov/coc/index

  • NebekerC.LagareT.TakemotoM.LewarsB.CristK.BlossC.S. & KerrJ. (2016). Engaging research participants to inform the ethical conduct of mobile imaging, pervasive sensing, and location tracking research. Translational Behavioral Medicine 6(4) 577586. PubMed ID: 27688250 doi:10.1007/s13142-016-0426-4

    • Crossref
    • Search Google Scholar
    • Export Citation
  • OlivaA. & TorralbaA. (2006). Building the gist of a scene: The role of global image features in recognition. Progress in Brain Research 1552336. PubMed ID: 17027377 doi:10.1016/S0079-6123(06)55002-2

    • Crossref
    • Search Google Scholar
    • Export Citation
  • ParkK. & EwingR. (2017). The usability of Unmanned Aerial Vehicles (UAVs) for measuring park-based physical activity. Landscape and Urban Planning 167157164. doi:10.1016/j.landurbplan.2017.06.010

    • Crossref
    • Search Google Scholar
    • Export Citation
  • PlessR. & SouvenirR. (2009). A survey of manifold learning for images. IPSJ Transactions on Computer Vision and Applications 18394. doi:10.2197/ipsjtcva.1.83

    • Crossref
    • Search Google Scholar
    • Export Citation
  • RamananD. (2012). Detecting activities of daily living in first-person camera views. Paper presented at the Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI.

    • Search Google Scholar
    • Export Citation
  • RileyW.T.RiveraD.E.AtienzaA.A.NilsenW.AllisonS.M. & MermelsteinR. (2011). Health behavior models in the age of mobile interventions: are our theories up to the task? Translational Behavioral Medicine 1(1) 5371. PubMed ID: 21796270 doi:10.1007/s13142-011-0021-7

    • Crossref
    • Search Google Scholar
    • Export Citation
  • RuiY. & AnandanP. (2000). Segmenting visual actions based on spatio-temporal motion patterns. Paper presented at the Proceedings IEEE Conference on Computer Vision and Pattern Recognition. (Cat. No. PR00662) Hilton Head Island, SC.

    • Search Google Scholar
    • Export Citation
  • SpiegelP.K. (1995). The first clinical X-ray made in America--100 years. American Journal of Roentgenology 164(1) 241243. PubMed ID: 7998549 doi:10.2214/ajr.164.1.7998549

    • Crossref
    • Search Google Scholar
    • Export Citation
  • StreuberS.Quiros-RamirezM.A.HillM.Q.HahnC.A.ZuffiS.O’TooleA. & BlackM.J. (2016). Body talk: Crowdshaping realistic 3D avatars with words. ACM Translation Graph 35(4) 114. doi:10.1145/2897824.2925981

    • Crossref
    • Search Google Scholar
    • Export Citation
  • ThorntonI.M.RensinkR.A. & ShiffrarM. (2002). Active versus passive processing of biological motion. Perception 31(7) 837853. PubMed ID: 12206531 doi:10.1068/p3072

    • Crossref
    • Search Google Scholar
    • Export Citation
  • TorralbaA.RussellB.C. & YuenJ. (2010). LabelMe: Online image annotation and applications. Proceedings of the IEEE 98(8) 14671484. doi:10.1109/JPROC.2010.2050290

    • Crossref
    • Search Google Scholar
    • Export Citation
  • U.S. Department of Health and Human Services. (2016). Child Welfare Information Gateway: Mandatory reporters of child abuse and neglect. Retrieved from https://www.childwelfare.gov/

    • Search Google Scholar
    • Export Citation
  • Vaca-CastanoG.DasS.SousaJ.P.LoboN.D. & ShahM. (2017). Improved scene identification and object detection on egocentric vision of daily activities. Computer Vision and Image Understanding 15692103. doi:10.1016/j.cviu.2016.10.016

    • Crossref
    • Search Google Scholar
    • Export Citation
  • WangC. & BurrisM.A. (1997). Photovoice: Concept, methodology, and use for participatory needs assessment. Health Education and Behavior 24(3) 369387. PubMed ID: 9158980 doi:10.1177/109019819702400309

    • Crossref
    • Search Google Scholar
    • Export Citation
  • WangC.C. & PiesC.A. (2004). Family, maternal, and child health through photovoice. Maternal and Child Health Journal 8(2) 95102. PubMed ID: 15198177 doi:10.1023/B:MACI.0000025732.32293.4f

    • Crossref
    • Search Google Scholar
    • Export Citation
  • WhyteW.H. (1980). The social life of small urban spaces (2nd ed.). New York, NY: Project for Public Spaces.

  • WoodG.LynchT.P.DevineC.KellerK. & FigueiraW. (2016). High-resolution photo-mosaic time-series imagery for monitoring human use of an artificial reef. Ecology and Evolution 6(19) 69636968. PubMed ID: 28725373 doi:10.1002/ece3.2342

    • Crossref
    • Search Google Scholar
    • Export Citation
  • WoodS.A.GuerryA.D.SilverJ.M. & LacayoM. (2013). Using social media to quantify nature-based tourism and recreation. Scientific Reports 32976. PubMed ID: 24131963 doi:10.1038/srep02976

    • Crossref
    • Search Google Scholar
    • Export Citation
  • ZacksJ.M. & SwallowK.M. (2007). Event segmentation. Current Directions in Psychological Science 16(2) 8084. PubMed ID: 22468032 doi:10.1111/j.1467-8721.2007.00480.x

    • Crossref
    • Search Google Scholar
    • Export Citation
  • ZhangZ.HuY.ChanS. & ChiaL.T. (2008). Motion context: A new representation for human action recognition. In D. ForsythP. Torr & A. Zisserman (Eds.) Computer Vision– ECCV 2008: 10th European Conference on Computer Vision Marseille France October 12–18 2008 Proceedings Part IV (pp. 817829). Berlin, Heidelberg: Springer.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • ZhuangY.BelkinM. & DennisS. (2013). Metric based automatic event segmentation. In D. UhlerK. Mehta & J.L. Wong (Eds.) Mobile Computing Applications and Services: 4th International Conference MobiCASE 2012 Seattle WA USA October 11–12 2012. Revised Selected Papers (pp. 129148). Berlin, Heidelberg: Springer.

    • Crossref
    • Search Google Scholar
    • Export Citation
Article Metrics
All Time Past Year Past 30 Days
Abstract Views 37 37 16
Full Text Views 0 0 0
PDF Downloads 0 0 0
Altmetric Badge
PubMed
Google Scholar