criterion systems, the Optotrak Certus 3-dimensional motion capture system (OC3D) is a reliable and valid criterion measurement of movement velocity. 3 Investigations examining validity of LPTs have limitations including not comparing the devices to a true criterion, 4 or performing insufficient
Jacob A. Goldsmith, Cameron Trepeck, Jessica L. Halle, Kristin M. Mendez, Alex Klemp, Daniel M. Cooke, Michael H. Haischer, Ryan K. Byrnes, Robert F. Zoeller, Michael Whitehurst and Michael C. Zourdos
Pamela L.Y.H. Ching and William H. Dietz Jr.
Nonobese, preadolescent girls self-reported, and their parents provided proxy reports of daughters’ daily activities using questionnaires. Responses were evaluated for test-retest reliability, and for validity using one-week diaries. Results indicated all three respondents provided reproducible estimates of time daughters spent watching TV; daughters and mothers, of time daughters spent sleeping; and parents, of time daughters spent in vigorous activities. However, only daughters >10 years of age could provide valid reports for time spent in moderate activities and in sedentary and light activities on school days. Study results suggest that daughters and parents have difficulty providing reliable and valid estimates of activity level.
Lisa S. Jutte, Kenneth L. Knight and Blaine C. Long
Examine thermocouple model uncertainty (reliability + validity).
First, a 3 × 3 repeated measures design with independent variables electrothermometers and thermocouple model. Second, a 1 × 3 repeated measures design with independent variable subprobe.
Three electrothermometers, 3 thermocouple models, a multi-sensor probe and a mercury thermometer measured a stable water bath.
Main Outcome Measures:
Temperature and absolute temperature differences between thermocouples and a mercury thermometer.
Thermocouple uncertainty was greater than manufactures’ claims. For all thermocouple models, validity and reliability were better in the Iso-Themex than the Datalogger, but there were no practical differences between models within an electrothermometers. Validity of multi-sensor probes and thermocouples within a probe were not different but were greater than manufacturers’ claims. Reliability of multiprobes and thermocouples within a probe were within manufacturers claims.
Thermocouple models vary in reliability and validity. Scientists should test and report the uncertainty of their equipment rather than depending on manufactures’ claims.
Franco M. Impellizzeri and Samuele M. Marcora
We propose that physiological and performance tests used in sport science research and professional practice should be developed following a rigorous validation process, as is done in other scientific fields, such as clinimetrics, an area of research that focuses on the quality of clinical measurement and uses methods derived from psychometrics. In this commentary, we briefly review some of the attributes that must be explored when validating a test: the conceptual model, validity, reliability, and responsiveness. Examples from the sport science literature are provided.
Marieke J.G. van Heuvelen, Gertrudis I.J.M. Kempen, Johan Ormel and Mathieu H.G. de Greef
To evaluate the validity of self-report measures of physical fitness as substitutes for performance-based tests, self-reports and performance-based tests of physical fitness were compared. Subjects were a community-based sample of older adults (N = 624) aged 57 and over. The performance-based tests included endurance, flexibility, strength, balance, manual dexterity, and reaction time. The self-report evaluation assessed selected individual subcomponents of fitness and used both peers and absolute standards as reference. The results showed that compared to performance-based tests, the self-report items were more strongly interrelated and they less effectively evaluated the different subdomains of physical fitness. Corresponding performance-based tests and self-report items were weakly to moderately associated. All self-report items were related most strongly with the performance-based endurance test. Apparently. older people tend to estimate overall fitness, in which endurance plays an important part, rather than individual subcomponents of Illness. Therefore, the self-report measures have limited validity as predictors of performance-based physical fitness.
Akitomo Yasunaga, Hyuntae Park, Eiji Watanabe, Fumiharu Togo, Sungjin Park, Roy J. Shephard and Yukitoshi Aoyagi
The Physical Activity Questionnaire for Elderly Japanese (PAQ-EJ) is a self-administered physical activity questionnaire for elderly Japanese; the authors report here on its repeatability and direct and indirect validity. Reliability was assessed by repeat administration after 1 month. Direct validation was based on accelerometer data collected every 4 s for 1 month in 147 individuals age 65–85 years. Indirect validation against a 10-item Barthel index (activities of daily living [ADL]) was completed in 3,084 individuals age 65–99 years. The test–retest coefficient was high (r = .64–.71). Total and subtotal scores for lower (transportation, housework, and labor) and higher intensity activities (exercise/sports) were significantly correlated with step counts and durations of physical activity <3 and ≥3 METs (r = .41, .28, .53), respectively. Controlling for age and ADL, scores for transportation, exercise/sports, and labor were greater in men, but women performed more housework. Sex- and ADL- or age-adjusted PAQ-EJ scores were significantly lower in older and dependent people. PAQ-EJ repeatability and validity seem comparable to those of instruments used in Western epidemiological studies.
Stephan R. Walk and Lenny D. Wiersma
Nixon’s (1994a; 1994b; 1996a; 1996b) research using a Risk, Pain, and Injury Questionnaire (RPIQ) is perhaps the most systematic in the risk, pain, and injury literature. The RPIQ is intended to measure the acceptance of dominant discourses on risk, pain, and injury among athletes and others. This article presents a face validity critique of the RPIQ and results of a subsequent content validity analysis based on a study of 171 athletes from a West Coast university. Structural equation modeling used to test Nixon’s original 3-factor model (M1) revealed poor model fit. Two alternate models (M2 and M3) tested reformulated subscale constructs and items. Whereas M2 demonstrated poor construct validity, limited support was found for items in M3. Further replications of this research are recommended.
Jason S. Scibek and Christopher R. Carcia
The purpose of our study was to establish criterion-related validity and repeatability of a shoulder biomechanics testing protocol involving an electromagnetic tracking system (Flock of Birds [FoB]). Eleven subjects completed humeral elevation tasks in the sagittal, scapular, and frontal planes on two occasions. Shoulder kinematics were assessed with a digital inclinometer and the FoB. Intrasession and intersession repeatability for orthopedic angles, and humeral and scapular kinematics ranged from moderate to excellent. Correlation analyses revealed strong relationships between inclinometer and FoB measures of humeral motion, yet considerable mean differences were noted between the measurement devices. Our results validate use of the FoB for measuring humeral kinematics and establish our testing protocol as reliable. We must continue to consider factors that can impact system accuracy and the effects they may have on kinematic descriptions and how data are reported.
Chris Riddoch, Dawn Edwards, Angie Page, Karsten Froberg, Sigmund A. Anderssen, Niels Wedderkopp, Søren Brage, Ashley R. Cooper, Luis B. Sardinha, Maarike Harro, Lena Klasson-Heggebø, Willem van Mechelen, Colin Boreham, Ulf Ekelund, Lars Bo Andersen and The European Youth Heart Study Team
The aim of the European Youth Heart Study (EYHS) is to establish the nature, strength, and interactions between personal, environmental, and lifestyle influences on cardiovascular disease (CVD) risk factors in European children.
The EYHS is an international study measuring CVD risk factors, and their associated influences, in children. Relationships between these independent factors and risk of disease will inform the design of CVD interventions in children. A minimum of 1000 boys and girls ages 9 and 15 y were recruited from four European countries—Denmark, Estonia, Norway, and Portugal. Variables measured included physical, biochemical, lifestyle, psychosocial, and sociodemographic data.
Of the 5664 children invited to participate, 4169 (74%) accepted. Response rates for most individual tests were moderate to high. All test protocols were well received by the children.
EYHS protocols are valid, reliable, acceptable to children, and feasible for use in large, field-based studies.
Roberta E. Rikli and C. Jessie Jones
Preventing or delaying the onset of physical frailty is an increasingly important goal because more individuals are living well into their 8th and 9th decades. We describe the development and validation of a functional fitness test battery that can assess the physiologic parameters that support physical mobility in older adults. The procedures involved in the test development were (a) developing a theoretical framework for the test items, (b) establishing an advisory panel of experts, (c) determining test selection criteria, (d) selecting the test items, and (e) establishing test reliability and validity. The complete battery consists of 6 items (and one alternative) designed to assess the physiologic parameters associated with independent functioning—lower and upper body strength, aerobic endurance, lower and upper body flexibility, and agility/dynamic balance. We also assessed body mass index as an estimate of body composition. We concluded that the tests met the established criteria for scientific rigor and feasibility for use in common community settings.