Determining Validity and Reliability of Caloric Expenditure Recorded by Wearable Technology While Walking and Running

Authors

Bianca C. Weyers, University of Nevada, Las VegasFollow
Dustin W. Davis, University of Nevada, Las VegasFollow
Nicole R. Vargas, University of Nevada, Las VegasFollow
Jorge Perdomo Rodriguez, University of Nevada, Las VegasFollow
Elias M. Malek, University of Nevada, Las VegasFollow
Katherine V. Carlos, University of Nevada, Las VegasFollow
Bryson Carrier, University of Nevada, Las VegasFollow
James W. Navalta, University of Nevada, Las VegasFollow

Abstract

With growing interest in tracking exercise progress, wearable technology is increasingly popular. While heart rate and step count are typically accurate for consumer-available devices, research from our laboratory indicates that caloric expenditure is not. PURPOSE: The current investigation aimed to evaluate the validity and reliability of caloric expenditure in multiple wearable devices during a self-paced walk and run. METHODS: Ten participants were tested (5F, 5M, age = 26.9± 9.43 years, body mass = 72.64± 7.73 kg, height = 168.66± 9.37 cm). Participants were asked to wear 5 devices: 2 Garmin Instinct watches (one on each wrist), 2 Polar Vantage M2 watches, and a K5 portable metabolic analysis system (criterion measure). Data was collected from all devices while participants completed a 5-minute self-paced walk, followed by a 5-minute rest period, then a 5-minute self-paced run. Validity was evaluated using the mean absolute percent error (MAPE) with a threshold of below 10 percent and Lin’s Concordance Correlation Coefficient (CCC) with significance above 0.7. Reliability was evaluated using the Intraclass Correlation Coefficient (ICC) and Coefficient of Variation (CV). RESULTS: For validity, neither device met the predetermined threshold for MAPE or CCC (see results table for reference). For reliability, only the Polar device during the running condition returned consistent results for both measures. CONCLUSION: These results indicate neither brand of watch produced valid energy expenditure estimates. Reliability was also poor. This poses a challenge to people relying on wearable devices to keep an accurate, consistent log of caloric expenditure. Our research does not indicate that technology is keeping up with how rapidly it is being developed and sold to the public.

Recommended Citation

Weyers, Bianca C.; Davis, Dustin W.; Vargas, Nicole R.; Perdomo Rodriguez, Jorge; Malek, Elias M.; Carlos, Katherine V.; Carrier, Bryson; and Navalta, James W. (2022) "Determining Validity and Reliability of Caloric Expenditure Recorded by Wearable Technology While Walking and Running," International Journal of Exercise Science: Conference Proceedings: Vol. 14: Iss. 2, Article 183.
Available at: https://digitalcommons.wku.edu/ijesab/vol14/iss2/183