Abstract

This work presents a virtual reality (VR) Exergame application designed to prevent work-related musculoskeletal disorders (WMSDs). Moreover, to help adapt the tasks of the exergame, a machine learning model that predicts users’ exercise intensity level is presented. WMSDs are an important issue that can have a direct economic impact to an organization. Exercise and stretching is one method that can benefit workers and help prevent WMSDs. While several applications have been developed to prevent WMSDs, most of them suffer from a lack of immersivity or they just focus on education and not necessarily on helping workers warm-up or stretch. In light of this, an Exergame application that leverages VR and Depth-sensor technology to help provide users with an immersive first-person experience that engages them in physical activities is introduced in this work. The objective of the Exergame is to motivate users to perform full-body movements in order to pass through a series of obstacles. While in the game, users can visualize their motions by controlling the virtual avatar with their body movements. It is expected that this immersivity will motivate and encourage the users. Initial findings show the positive effects that the base exergame has on individuals’ motivation and physical activity. The results indicate that the application was able to engage individuals in low-intensity exercises that produced significant and consistent increases in their heart rate. Lastly, the results show that the machine learning model predicted users’ exercise activity level with an accuracy of 76.67%.

References

1.
“Work-Related Musculoskeletal Disorders & Ergonomics,” CDC.gov, https://www.cdc.gov/workplacehealthpromotion/health-strategies/musculoskeletal-disorders/index.html, Accessed January 3, 2021.
2.
“Employer-Reported Workplace Injuries and Illnesses (Annual) News Release,” BLS.gov, https://www.bls.gov/news.release/archives/osh_11042020.htm, Accessed January 3, 2021.
3.
Soares
,
C. O.
,
Pereira
,
B. F.
,
Pereira Gomes
,
M. V.
,
Marcondes
,
L. P.
,
de Campos Gomes
,
F.
, and
de Melo-Neto
,
J. S.
,
2020
, “
Preventive Factors Against Work-Related Musculoskeletal Disorders: Narrative Review
,”
Rev. Bras. Med. Trab.
,
17
(
3
), pp.
415
430
.
4.
“What Is Exergaming?,” HealthySD.gov, https://healthysd.gov/what-is-exergaming-5/, Accessed January 3, 2021.
5.
Bock
,
B. C.
,
Dunsiger
,
S. I.
,
Ciccolo
,
J. T.
,
Serber
,
E. R.
,
Wu
,
W.-C.
,
Sillice
,
M.
, and
Marcus
,
B. H.
,
2019
, “
Mediators of Physical Activity Between Standard Exercise and Exercise Video Games
,”
Health Psychol.
,
38
(
12
), pp.
1107
1115
.
6.
Whitehead
,
A.
,
Johnston
,
H.
,
Nixon
,
N.
, and
Welch
,
J.
,
2010
, “
Exergame Effectiveness: What the Numbers can Tell Us
,”
Proceedings of the Fifth ACM SIGGRAPH Symposium on Video Games
,
Los Angeles, CA
,
July
, pp.
55
62
.
7.
Muñoz
,
J. E.
,
Cao
,
S.
, and
Boger
,
J.
,
2019
, “
Kinematically Adaptive Exergames: Personalizing Exercise Therapy Through Closed-Loop Systems
,”
2019 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR)
,
San Diego, CA
,
Dec. 9–11
, pp.
118
1187
.
8.
Lopez
,
C. E.
, and
Tucker
,
C. S.
,
2021
, “Adaptive Gamification and Its Impact on Performance,”
HCI in Games: Experience Design and Game Mechanics
,
X.
Fang
, ed.,
Springer International Publishing
,
Cham
, pp.
327
341
.
9.
Mütterlein
,
J.
,
2018
, “
The Three Pillars of Virtual Reality? Investigating the Roles of Immersion, Presence, and Interactivity
,”
Proceedings of the 51st Hawaii International Conference on System Sciences
,
Koloa, HI
,
Jan. 8
.
10.
Yoo
,
S.
, and
Kay
,
J.
,
2016
, “
VRun: Running-in-Place Virtual Reality Exergame
,”
Proceedings of the 28th Australian Conference on Computer-Human Interaction, Association for Computing Machinery
,
New York
,
Nov. 29–Dec. 2
, pp.
562
566
.
11.
Lopez
,
C. E.
, and
Tucker
,
C. S.
,
2019
, “
The Effects of Player Type on Performance: A Gamification Case Study
,”
Comput. Hum. Behav.
,
91
(
1
), pp.
333
345
.
12.
Stranick
,
T.
, and
Lopez
,
C. E.
, “
Virtual Reality Exergames: Promoting Physical Health among Industry Workers
,”
ASME IDETC-CIE 2020
,
Virtual Conference
,
Aug. 17–20
.
13.
2007
, “Simple Solutions: Ergonomics for Construction Workers,” CDC Workplace Saf. Health, https://www.cdc.gov/niosh/docs/2007-122/pdfs/2007-122.pdf, Accessed January 3, 2021.
14.
Sisto
,
M.
,
Zare
,
M.
,
Ouerhani
,
N.
,
Bolinhas
,
C.
,
Divernois
,
M.
,
Mignot
,
B.
,
Sagot
,
J.-C.
, and
Gobron
,
S.
,
2018
, “
Virtual Reality Serious Game for Musculoskeletal Disorder Prevention
5th International Conference, AVR 2018, Proceedings, Part II
,
Otranto, Italy
,
June 24–27
, pp.
43
59
.
15.
“Preventing Musculoskeletal Disorders in the Workplace,” WHO.int, https://apps.who.int/iris/bitstream/handle/10665/42651/924159053X.pdf, Accessed January 3, 2021.
16.
Comper
,
M.
, and
Dennerlein
,
J.
,
2017
, “
Effectiveness of Job Rotation for Preventing Work-Related Musculoskeletal Diseases: A Cluster Randomised Controlled Trial
,”
Occup. Environ. Med.
,
74
(
8
), pp.
543
544
.
17.
“Nintendo: 2nd Quarter Results for Fiscal Year Ending March 2021,” Nintendo.co.jp [Online]. https://www.nintendo.co.jp/ir/pdf/2020/201105_4e.pdf, Accessed January 8, 2021.
18.
Horton
,
J. F.
,
Stergiou
,
P.
,
Fung
,
T. S.
, and
Katz
,
L.
,
2017
, “
Comparison of Polar M600 Optical Heart Rate and ECG Heart Rate During Exercise
,”
Med. Sci. Sports Exercise
,
49
(
12
), pp.
2600
2607
.
19.
Thai
,
T.
,
2019
,
The Influence Of Exergaming On Heart Rate, Perceived Exertion, Motivation To Exercise, And Time Spent Exercising, Honor Thesis
.
20.
Quer
,
G.
,
Gouda
,
P.
,
Galarnyk
,
M.
,
Topol
,
E. J.
, and
Steinhubl
,
S. R.
,
2020
, “
Inter- and Intraindividual Variability in Daily Resting Heart Rate and Its Associations With Age, Sex, Sleep, BMI, and Time of Year: Retrospective, Longitudinal Cohort Study of 92,457 Adults
,”
PLoS One
,
15
(
2
), p.
e0227709
.
21.
Seo
,
N. J.
,
Kumar
,
J. A.
,
Hur
,
P.
,
Crocher
,
V.
,
Motawar
,
B.
, and
Lakshminarayanan
,
K.
,
2016
, “
Usability Evaluation of Low-Cost Virtual Reality Hand and Arm Rehabilitation Games
,”
J. Rehabil. Res. Dev.
,
53
(
3
), pp.
321
334
.
22.
Orji
,
R.
,
Mandryk
,
R. L.
, and
Vassileva
,
J.
,
2017
, “
Improving the Efficacy of Games for Change Using Personalization Models
,”
ACM Trans. Comput. Hum. Interact.
,
24
(
5
), pp.
32:1
32:22
.
23.
Lopez
,
C. E.
, and
Tucker
,
C. S.
,
2017
, “
A Quantitative Method for Evaluating the Complexity of Implementing and Performing Game Features in Physically-Interactive Gamified Applications
,”
Comput. Hum. Behav.
,
71
(
C
), pp.
42
58
.
24.
Göbel
,
S.
,
Hardy
,
S.
,
Wendel
,
V.
,
Mehm
,
F.
, and
Steinmetz
,
R.
,
2010
, “
Serious Games for Health: Personalized Exergames
,”
Proceedings of the 18th ACM International Conference on Multimedia, Association for Computing Machinery
,
New York, NY
,
Oct. 25–29
, pp.
1663
1666
.
25.
Yoo
,
S.
,
Parker
,
C.
, and
Kay
,
J.
,
2017
, “
Designing a Personalized VR Exergame
,”
Adjunct Publication of the 25th Conference on User Modeling, Adaptation and Personalization, Association for Computing Machinery
,
New York, NY
,
July 9–12
, pp.
431
435
.
26.
Lopez
,
C.
, and
Tucker
,
C.
,
2020
, “
Toward Personalized Adaptive Gamification: A Machine Learning Model for Predicting Performance
,”
IEEE Trans. Games
,
12
(
2
), pp.
155
168
.
27.
Muñoz
,
J. E.
,
Goncalves
,
A.
,
Cameirao
,
M. S.
,
Bermúdez i Badia
,
S.
, and
Gouveia
,
E. R.
,
2018
, “
Measured and Perceived Physical Responses in Multidimensional Fitness Training Through Exergames in Older Adults
,”
2018 10th International Conference on Virtual Worlds and Games for Serious Applications (VS-Games)
,
Würzburg, Germany
,
Sept. 5–7
, pp.
1
4
.
28.
Nikolaidis
,
P. T.
,
Rosemann
,
T.
, and
Knechtle
,
B.
,
2018
, “
Age-Predicted Maximal Heart Rate in Recreational Marathon Runners: A Cross-Sectional Study on Fox’s and Tanaka’s Equations
,”
Front. Physiol.
,
9
(
226
), pp.
1-6
.
29.
Subramanian
,
S.
,
Dahl
,
Y.
,
Skjæret Maroni
,
N.
,
Vereijken
,
B.
, and
Svanæs
,
D.
,
2020
, “
Assessing Motivational Differences Between Young and Older Adults When Playing an Exergame
,”
Games Health J.
,
9
(
1
), pp.
24
30
.
30.
Cao
,
L.
,
Peng
,
C.
, and
Dong
,
Y.
,
2021
, “
Ellic’s Exercise Class: Promoting Physical Activities During Exergaming with Immersive Virtual Reality
,”
Virtual Reality
,
25
(
3
), pp.
597
612
.
31.
Yoo
,
S.
,
Heywood
,
T.
,
Tang
,
L. M.
,
Kummerfeld
,
B.
, and
Kay
,
J.
,
2017
, “
Towards a Long Term Model of Virtual Reality Exergame Exertion
,”
Proceedings of the 25th Conference on User Modeling, Adaptation and Personalization
,
Bratislava, Slovakia
,
July 9–12
, pp.
247
255
.
32.
Thomas
,
J. S.
,
France
,
C. R.
,
Applegate
,
M. E.
,
Leitkam
,
S. T.
, and
Walkowski
,
S.
,
2016
, “
Feasibility and Safety of a Virtual Reality Dodgeball Intervention for Chronic low Back Pain: a Randomized Clinical Trial
,”
J. Pain
,
17
(
12
), pp.
1302
1317
.
33.
Davis
,
D.
,
Kizilcec
,
R. F.
,
Hauff
,
C.
, and
Houben
,
G.-J.
,
2018
, “
The Half-Life of MOOC Knowledge: A Randomized Trial Evaluating Knowledge Retention and Retrieval Practice in MOOCs
,”
Proceedings of the 8th International Conference on Learning Analytics and Knowledge
,
Sydney, New South Wales, Australia
,
Mar. 7–9
, ACM, pp.
1
10
.
34.
Subedi
,
S.
,
Pradhananga
,
N.
,
Carrasquillo
,
A.
, and
Lopez
,
F.
,
2017
, “
Virtual Reality-Based Personalized Learning Environment for Repetitive Labor-Intensive Construction Tasks
,”
53rd ASC Annual International Conference Proceedings
,
Seattle, WA
,
Apr. 5–9
, pp.
787
794
.
35.
Hanson
,
L.
,
2020
, “
The Use and Usage of Virtual Reality Technologies in Planning and Implementing New Workstations
,”
DHM2020: Proceedings of the 6th International Digital Human Modeling Symposium
,
Aug. 31–Sept. 2
,
IOS Press
, Vol. 11, p.
388
.
36.
Azizi
,
A.
,
Ghafoorpoor Yazdi
,
P.
, and
Hashemipour
,
M.
,
2019
, “
Interactive Design of Storage Unit Utilizing Virtual Reality and Ergonomic Framework for Production Optimization in Manufacturing Industry
,”
Int. J. Interact. Des. Manuf.
,
13
(
1
), pp.
373
381
.
37.
Mazéas
,
A.
,
Duclos
,
M.
,
Pereira
,
B.
, and
Chalabaev
,
A.
,
2020
, “
Does Gamification Improve Physical Activity? A Systematic Review and Meta-Analysis
,”
SportRxiv
. December, 14.
38.
Nan
,
P.
,
Tongtib
,
A.
, and
Wongratanaphisan
,
T.
,
2019
, “
Evaluation of Upper Limb Joint’s Range of Motion Data by Kinect Sensor for Rehabilitation Exercise Game
,”
Proceedings of the third International Conference on Medical and Health Informatics
,
Xiamen China
,
May 17–19
.
39.
“Skeleton Tracking with the Kinect SDK—Kinect for Windows SDK Programming Guide.”
40.
D’Mello
,
S.
,
Kappas
,
A.
, and
Gratch
,
J.
,
2018
, “
The Affective Computing Approach to Affect Measurement
,”
Emot. Rev.
,
10
(
2
), pp.
174
183
.
41.
Miller
,
W. C.
,
Wallace
,
J. P.
, and
Eggert
,
K. E.
,
1993
, “
Predicting Max HR and the HR-VO2 Relationship for Exercise Prescription in Obesity
,”
Med. Sci. Sports Exercise
,
25
(
9
), pp.
1077
1081
.
42.
Mesquita
,
A.
,
Trabulo
,
M.
,
Mendes
,
M.
,
Viana
,
J. F.
, and
Seabra-Gomes
,
R.
,
1996
, “
The Maximum Heart Rate in the Exercise Test: The 220-age Formula or Sheffield’s Table?
,” Rev.
Port. Cardiol.
,
15
(
2
), pp.
139
144
.
43.
Fox
,
S. M.
, and
Haskell
,
W. L.
,
1968
, “
Physical Activity and the Prevention of Coronary Heart Disease
,”
Bull. N. Y. Acad. Med.
,
44
(
8
), pp.
950
965
.
44.
Brad
,
Ferguson
, and
American College of Sports Medicine
,
2018
,
ACSM’s Guidelines for Exercise Testing and Prescription
, 9th ed.,
Lippincott Williams & Wilkins
,
Philadelphia, PA
.
45.
Keytel
,
L. R.
,
Goedecke
,
J. H.
,
Noakes
,
T. D.
,
Hiiloskorpi
,
H.
,
Laukkanen
,
R.
,
van der Merwe
,
L.
, and
Lambert
,
E. V.
,
2005
, “
Prediction of Energy Expenditure From Heart Rate Monitoring During Submaximal Exercise
,”
J. Sports Sci.
,
23
(
3
), pp.
289
297
.
46.
Hutto
,
C.
, and
Gilbert
,
E.
,
2014
, “
VADER: A Parsimonious Rule-Based Model for Sentiment Analysis of Social Media Text
,”
Proceedings of the International AAAI Conference on Web and Social Media
, Vol. 8.
You do not currently have access to this content.