Evaluation of user satisfaction and usability of a mobile app for smoking cessation

Francisco Luna-Perejon, Shwetambara Malwade, Charis Styliadis, Javier Civit, Daniel Cascado-Caballero, Evdokimos Konstantinidis, Shabbir Syed Abdul, Panagiotis D. Bamidis, Anton Civit, Yu Chuan (Jack) Li

Research output: Contribution to journalArticle

Abstract

Background: Mobile apps have a great potential to support patients in healthcare, and to encourage healthy behavioral changes such as smoking cessation. Nevertheless, the user rejection levels are still high. A set of factors that has impact on the app effectiveness is related to the quality of those features that lead to positive user experiences when using the app. This work aims to evaluate the user experience, and more specifically the usability and the user satisfaction with a mobile application for smoking cessation. This will also provide a basis for future improvements. Methods: We provided a smoking cessation mobile Android app to two different user cohorts, the smokers as valid users and the experts, for three weeks. The app featured usual functionalities to help quit smoking, including an achieved benefits section, mini-games to distract during cravings, and supportive motivational messages. We collected information about user experience, through game playability and message satisfaction questionnaires, and the experts’ opinions. We also considered usage of app sections, the duration of the mini-game sessions, and the user ratings for motivational messages. Results: We included 45 valid users and 25 experts in this study. The questionnaire indicated 80% satisfaction rate for the motivational messages. According to game questionnaires, over 69% of the participants agreed that the games have good usability features, however, for questions related to mobility and gameplay heuristics, agreements were below 67%. The most accessed app sections were achieved benefits and the one with motivational messages. The experts described issues that could help to improve the application. Conclusions: The combination of questionnaires with expert reports allowed to identify several problems and possible corrections. Our study showed that motivational messages have a good satisfaction rate, although it is necessary to consider technical features of some mobile devices that may hinder message reception. Games have good usability and it's expected that the addition of difficulty levels and a better accessibility to the game menu could make them more attractive and increase its usage. Future development of mHealth apps based on gamification and motivational messages need to consider these factors for better user satisfaction and usability.

Original languageEnglish
Article number105042
JournalComputer Methods and Programs in Biomedicine
Volume182
DOIs
Publication statusPublished - Dec 2019

Fingerprint

Mobile Applications
Smoking Cessation
Application programs
Telemedicine
Expert Testimony
Smoking
Delivery of Health Care
Equipment and Supplies
Mobile devices
Surveys and Questionnaires

Keywords

  • Game heuristics
  • Mhealth application
  • Motivational messages
  • Serious games
  • Smoking cessation
  • User experience

ASJC Scopus subject areas

  • Software
  • Computer Science Applications
  • Health Informatics

Cite this

Luna-Perejon, F., Malwade, S., Styliadis, C., Civit, J., Cascado-Caballero, D., Konstantinidis, E., ... Li, Y. C. J. (2019). Evaluation of user satisfaction and usability of a mobile app for smoking cessation. Computer Methods and Programs in Biomedicine, 182, [105042]. https://doi.org/10.1016/j.cmpb.2019.105042

Evaluation of user satisfaction and usability of a mobile app for smoking cessation. / Luna-Perejon, Francisco; Malwade, Shwetambara; Styliadis, Charis; Civit, Javier; Cascado-Caballero, Daniel; Konstantinidis, Evdokimos; Abdul, Shabbir Syed; Bamidis, Panagiotis D.; Civit, Anton; Li, Yu Chuan (Jack).

In: Computer Methods and Programs in Biomedicine, Vol. 182, 105042, 12.2019.

Research output: Contribution to journalArticle

Luna-Perejon, F, Malwade, S, Styliadis, C, Civit, J, Cascado-Caballero, D, Konstantinidis, E, Abdul, SS, Bamidis, PD, Civit, A & Li, YCJ 2019, 'Evaluation of user satisfaction and usability of a mobile app for smoking cessation', Computer Methods and Programs in Biomedicine, vol. 182, 105042. https://doi.org/10.1016/j.cmpb.2019.105042
Luna-Perejon F, Malwade S, Styliadis C, Civit J, Cascado-Caballero D, Konstantinidis E et al. Evaluation of user satisfaction and usability of a mobile app for smoking cessation. Computer Methods and Programs in Biomedicine. 2019 Dec;182. 105042. https://doi.org/10.1016/j.cmpb.2019.105042
Luna-Perejon, Francisco ; Malwade, Shwetambara ; Styliadis, Charis ; Civit, Javier ; Cascado-Caballero, Daniel ; Konstantinidis, Evdokimos ; Abdul, Shabbir Syed ; Bamidis, Panagiotis D. ; Civit, Anton ; Li, Yu Chuan (Jack). / Evaluation of user satisfaction and usability of a mobile app for smoking cessation. In: Computer Methods and Programs in Biomedicine. 2019 ; Vol. 182.
@article{4b33a2baf22c4fe1af3453fcc0da934f,
title = "Evaluation of user satisfaction and usability of a mobile app for smoking cessation",
abstract = "Background: Mobile apps have a great potential to support patients in healthcare, and to encourage healthy behavioral changes such as smoking cessation. Nevertheless, the user rejection levels are still high. A set of factors that has impact on the app effectiveness is related to the quality of those features that lead to positive user experiences when using the app. This work aims to evaluate the user experience, and more specifically the usability and the user satisfaction with a mobile application for smoking cessation. This will also provide a basis for future improvements. Methods: We provided a smoking cessation mobile Android app to two different user cohorts, the smokers as valid users and the experts, for three weeks. The app featured usual functionalities to help quit smoking, including an achieved benefits section, mini-games to distract during cravings, and supportive motivational messages. We collected information about user experience, through game playability and message satisfaction questionnaires, and the experts’ opinions. We also considered usage of app sections, the duration of the mini-game sessions, and the user ratings for motivational messages. Results: We included 45 valid users and 25 experts in this study. The questionnaire indicated 80{\%} satisfaction rate for the motivational messages. According to game questionnaires, over 69{\%} of the participants agreed that the games have good usability features, however, for questions related to mobility and gameplay heuristics, agreements were below 67{\%}. The most accessed app sections were achieved benefits and the one with motivational messages. The experts described issues that could help to improve the application. Conclusions: The combination of questionnaires with expert reports allowed to identify several problems and possible corrections. Our study showed that motivational messages have a good satisfaction rate, although it is necessary to consider technical features of some mobile devices that may hinder message reception. Games have good usability and it's expected that the addition of difficulty levels and a better accessibility to the game menu could make them more attractive and increase its usage. Future development of mHealth apps based on gamification and motivational messages need to consider these factors for better user satisfaction and usability.",
keywords = "Game heuristics, Mhealth application, Motivational messages, Serious games, Smoking cessation, User experience",
author = "Francisco Luna-Perejon and Shwetambara Malwade and Charis Styliadis and Javier Civit and Daniel Cascado-Caballero and Evdokimos Konstantinidis and Abdul, {Shabbir Syed} and Bamidis, {Panagiotis D.} and Anton Civit and Li, {Yu Chuan (Jack)}",
year = "2019",
month = "12",
doi = "10.1016/j.cmpb.2019.105042",
language = "English",
volume = "182",
journal = "Computer Methods and Programs in Biomedicine",
issn = "0169-2607",
publisher = "Elsevier Ireland Ltd",

}

TY - JOUR

T1 - Evaluation of user satisfaction and usability of a mobile app for smoking cessation

AU - Luna-Perejon, Francisco

AU - Malwade, Shwetambara

AU - Styliadis, Charis

AU - Civit, Javier

AU - Cascado-Caballero, Daniel

AU - Konstantinidis, Evdokimos

AU - Abdul, Shabbir Syed

AU - Bamidis, Panagiotis D.

AU - Civit, Anton

AU - Li, Yu Chuan (Jack)

PY - 2019/12

Y1 - 2019/12

N2 - Background: Mobile apps have a great potential to support patients in healthcare, and to encourage healthy behavioral changes such as smoking cessation. Nevertheless, the user rejection levels are still high. A set of factors that has impact on the app effectiveness is related to the quality of those features that lead to positive user experiences when using the app. This work aims to evaluate the user experience, and more specifically the usability and the user satisfaction with a mobile application for smoking cessation. This will also provide a basis for future improvements. Methods: We provided a smoking cessation mobile Android app to two different user cohorts, the smokers as valid users and the experts, for three weeks. The app featured usual functionalities to help quit smoking, including an achieved benefits section, mini-games to distract during cravings, and supportive motivational messages. We collected information about user experience, through game playability and message satisfaction questionnaires, and the experts’ opinions. We also considered usage of app sections, the duration of the mini-game sessions, and the user ratings for motivational messages. Results: We included 45 valid users and 25 experts in this study. The questionnaire indicated 80% satisfaction rate for the motivational messages. According to game questionnaires, over 69% of the participants agreed that the games have good usability features, however, for questions related to mobility and gameplay heuristics, agreements were below 67%. The most accessed app sections were achieved benefits and the one with motivational messages. The experts described issues that could help to improve the application. Conclusions: The combination of questionnaires with expert reports allowed to identify several problems and possible corrections. Our study showed that motivational messages have a good satisfaction rate, although it is necessary to consider technical features of some mobile devices that may hinder message reception. Games have good usability and it's expected that the addition of difficulty levels and a better accessibility to the game menu could make them more attractive and increase its usage. Future development of mHealth apps based on gamification and motivational messages need to consider these factors for better user satisfaction and usability.

AB - Background: Mobile apps have a great potential to support patients in healthcare, and to encourage healthy behavioral changes such as smoking cessation. Nevertheless, the user rejection levels are still high. A set of factors that has impact on the app effectiveness is related to the quality of those features that lead to positive user experiences when using the app. This work aims to evaluate the user experience, and more specifically the usability and the user satisfaction with a mobile application for smoking cessation. This will also provide a basis for future improvements. Methods: We provided a smoking cessation mobile Android app to two different user cohorts, the smokers as valid users and the experts, for three weeks. The app featured usual functionalities to help quit smoking, including an achieved benefits section, mini-games to distract during cravings, and supportive motivational messages. We collected information about user experience, through game playability and message satisfaction questionnaires, and the experts’ opinions. We also considered usage of app sections, the duration of the mini-game sessions, and the user ratings for motivational messages. Results: We included 45 valid users and 25 experts in this study. The questionnaire indicated 80% satisfaction rate for the motivational messages. According to game questionnaires, over 69% of the participants agreed that the games have good usability features, however, for questions related to mobility and gameplay heuristics, agreements were below 67%. The most accessed app sections were achieved benefits and the one with motivational messages. The experts described issues that could help to improve the application. Conclusions: The combination of questionnaires with expert reports allowed to identify several problems and possible corrections. Our study showed that motivational messages have a good satisfaction rate, although it is necessary to consider technical features of some mobile devices that may hinder message reception. Games have good usability and it's expected that the addition of difficulty levels and a better accessibility to the game menu could make them more attractive and increase its usage. Future development of mHealth apps based on gamification and motivational messages need to consider these factors for better user satisfaction and usability.

KW - Game heuristics

KW - Mhealth application

KW - Motivational messages

KW - Serious games

KW - Smoking cessation

KW - User experience

UR - http://www.scopus.com/inward/record.url?scp=85071382777&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85071382777&partnerID=8YFLogxK

U2 - 10.1016/j.cmpb.2019.105042

DO - 10.1016/j.cmpb.2019.105042

M3 - Article

C2 - 31473444

AN - SCOPUS:85071382777

VL - 182

JO - Computer Methods and Programs in Biomedicine

JF - Computer Methods and Programs in Biomedicine

SN - 0169-2607

M1 - 105042

ER -