Validity and Reliability of the Apple Watch for Measuring Heart Rate During Exercise

Abstract

We examined the validity and reliability of the Apple Watch heart rate sensor during and in recovery from exercise. Twenty-one males completed treadmill exercise while wearing two Apple Watches (left and right wrists) and a Polar S810i monitor (criterion). Exercise involved 5-min bouts of walking, jogging, and running at speeds of 4 km.h⁻¹, 7 km.h⁻¹, and 10 km.h⁻¹, followed by 11 min of rest between bouts. At all exercise intensities the mean bias was trivial. There were very good correlations with the criterion during walking (L: r=0.97; R: r=0.97), but good (L: r=0.93; R: r=0.92) and poor/good (L: r=0.81; R: r=0.86) correlations during jogging and running. Standardised typical error of the estimate was small, moderate, and moderate to large. There were good correlations following walking, but poor correlations following jogging and running. The percentage of heart rates recorded reduced with increasing intensity but increased over time. Intra-device standardised typical errors decreased with intensity. Inter-device standardised typical errors were small to moderate with very good to nearly perfect intraclass correlations. The Apple Watch heart rate sensor has very good validity during walking but validity decreases with increasing intensity.

Key words

smartwatch - wearables - technology

• References

• 1 Allen J. Photoplethysmography and its application in clinical physiological measurement. Physiol Meas 2007; 28: R1-R39
• 2 Anastasopoulou P, Tubic M, Schmidt S, Neumann R, Woll A, Härtel S. Validation and comparison of two methods to assess human energy expenditure during free-living activities. PLoS One 2014; 9: e90606
• 3 Canalys. Apple Watch has its best quarter and takes nearly 80 % of total smartwatch revenue in Q4. Available from: https://www.canalys.com/newsroom/media-alert-apple-watch-has-its-best-quarter-andtakes-nearly-80-total-smartwatch-revenue-q
• 4 Cole CR, Blackstone EH, Pashkow FJ, Snader CE, Lauer MS. Heart-rate recovery immediately after exercise as a predictor of mortality. N Engl J Med 1999; 341: 1351-1357
• 5 Crisafulli A, Pittau G, Lorrai L, Carcassi AM, Cominu M, Tocco F, Melis F, Concu A. Poor reliability of heart rate monitoring to assess oxygen uptake during field training. Int J Sports Med 2006; 27: 55-59
• 6 Harriss DJ, Atkinson G. Ethical standards in sport and exercise science research. Int J Sports Med 2009; 30: 701-702
• 7 Hopkins WG. Spreadsheets for analysis of validity and reliability. Available from: sportsci.org/2015/ValidRely.htm
• 8 Hopkins WG. Validity thresholds and error rates for test measures used to assess individuals. 21st Annual Congress of the European College of Sport Science; 2016; Vienna, Austria
• 9 Johnson JM. Physical training and the control of skin blood flow. Med Sci Sports Exerc 1998; 30: 382-386
• 10 Lee CM, Gorelick M. Validity of the smarthealth watch to measure heart rate during rest and exercise. Meas Phys Educ Exerc Sci 2011; 15: 18-25
• 11 Priyadarsini P, Priyameenakshi K. The non-invasive PPG method of heart rate monitoring in smart phone device. Int J Innov Res Sci Eng Technol 2015; 4: 894-898
• 12 Shetler K, Marcus R, Froelicher VF, Vora S, Kalisetti D, Prakash M, Do D, Myers J. Heart rate recovery: validation and methodologic issues. J Am Coll Cardiol 2001; 38: 1980-1987
• 13 Tocco F, Sanna I, Mulliri G, Magnani S, Todde F, Mura R, Ghiani G, Concu A, Melis F, Crisafulli A. Heart rate unreliability during interval training recovery in middle distance runners. J Sports Sci Med 2015; 14: 466-472
• 14 Vanderlei LCM, Silva RA, Pastre CM, Azevedo FM, Godoy MF. Comparison of the Polar S810i monitor and the ECG for the analysis of heart rate variability in the time and frequency domains. Braz J Med Biol Res 2008; 41: 854-859
• 15 Wallen MP, Gomersall SR, Keating SE, Wisløff U, Coombes JS. Accuracy of heart rate watches: implications for weight management. PLoS One 2016; 11: e0154420
• 16 Wang R, Blackburn G, Desai M, Phelan D, Gillinov L, Houghtaling P, Gillinov M. Accuracy of wrist-worn heart rate monitors. JAMA Cardiol 2016; DOI: 10.1001/jamacardio.2016.3340.
• 17 Warren JM, Ekelund U, Besson H, Mezzani A, Geladas N, Vanhees L, Panel E. Assessment of physical activity – a review of methodologies with reference to epidemiological research: a report of the exercise physiology section of the European Association of Cardiovascular Prevention and Rehabilitation. Eur J Cardiovasc Prev Rehabil 2010; 17: 127-139
• 18 Weippert M, Kumar M, Kreuzfeld S, Arndt D, Rieger A, Stoll R. Comparison of three mobile devices for measuring R-R intervals and heart rate variability: Polar S810i, Suunto t6 and an ambulatory ECG system. Eur J Appl Physiol 2010; 109: 779-786