Estimación del atributo de satisfacción en test con usuarios mediante técnicas de análisis de sentimientos
DOI:
https://doi.org/10.15665/rp.v21i2.3248Keywords:
Percepción, análisis de sentimientos, atributo satisfacción, nivel de satisfacción, test con usuarios, usabilidadAbstract
With the growth in the number of applications deployed in the cloud, one of the aspects that contributes to improving user productivity and enterprise competitiveness is usability. According to ISO 9241-11, usability is defined in terms of the attributes of effectiveness, efficiency, and satisfaction, where satisfaction is the subjective attribute. In a user test developed in a usability laboratory, the satisfaction attribute is obtained using perception surveys, so one of the challenges is to contribute to the objective determination of this attribute, given the subjectivity of the surveys. This paper proposes a new approach for the determination of the satisfaction attribute is user tests based on the use of sentiment analysis techniques. The proposed approach was developed using the four methodological phases of the iterative research pattern: observe the application, identify the problem, develop the solution, and test the solution. As a result, the proposed approach was implemented through a tool developed in Java and Python, which combines the conventional approach with the opinion mining approach for the determination of the level of satisfaction per user and across the entire test. This approach is intended to serve as a reference at the academic and business level in the objective determination of the satisfaction attribute based on affective computing techniques.
References
D. Hering, T. Schwartz, A. Boden, and V. Wulf, “Integrating usability-engineering into the software developing processes of SME: A case study of software developing SME in Germany,” in 2015 IEEE/ACM 8th International Workshop on Cooperative and Human Aspects of Software Engineering, Florence, Italy, May 2015. doi: 10.1109/CHASE.2015.22.
K. Radle and S. Young, “Partnering usability with development: how three organizations succeeded,” IEEE Software, vol. 18, no. 1, pp. 38–45, 2001, doi: 10.1109/52.903164.
C. Dinkel, D. Billenstein, D. Goller, and F. Rieg, “User-oriented optimization of the GUI of a finite element programme to enhance the usability of simulation tools,” in 2018 South-Eastern European Design Automation, Computer Engineering, Computer Networks and Society Media Conference (SEEDA_CECNSM), Kastoria, Greece, Sep. 2018. doi: 10.23919/SEEDA-CECNSM.2018.8544936.
G. Çetin and M. Göktürk, “A measurement based framework for assessment of usability-centricness of open source software projects,” in 2008 IEEE International Conference on Signal Image Technology and Internet Based Systems, Bali, Indonesia, Nov. 2008. doi: 10.1109/SITIS.2008.106.
F. H. Nakagawa, A. S. Felinto, and M. T. Omori, “Inclusion of teaching slides in games: Analysis of the efficiency, effectiveness and satisfaction,” IEEE Latin America Transactions, vol. 11, no. 6, pp. 1372–1377, Dec. 2013, doi: 10.1109/TLA.2013.6710386.
P. Weichbroth, “Usability of mobile applications: A systematic literature study,” IEEE Access, vol. 8, pp. 55563–55577, 2020, doi: 10.1109/ACCESS.2020.2981892.
K. Finstad, “The usability metric for user experience,” Interacting with Computers, vol. 22, no. 5, pp. 323–327, Sep. 2010, doi: 10.1016/J.INTCOM.2010.04.004.
R. Medina-Flores and R. Morales-Gamboa, “Usability evaluation by experts of a learning management system,” IEEE Revista Iberoamericana de Tecnologias del Aprendizaje, vol. 10, no. 4, pp. 197–203, Nov. 2015, doi: 10.1109/RITA.2015.2486298.
M. Sánchez, G.-E. Chanchí-Golondrino, and W.-Y. Campo-Muñoz, “Sistema software para el análisis del estrés mental en test de usuarios,” Campus Virtuales, vol. 7, no. 2, pp. 105–114, 2018.
G. Enríquez and S. Casas, “Usabilidad en aplicaciones móviles,” Informes Científicos y Técnicos - UNPA, vol. 5, no. 2, pp. 25–47, 2013.
D. M. Delgado, D. F. Girón Timaná, G. E. Chanchí, and K. Márceles Villalba, “Estimación del atributo satisfacción en test de usuarios a partir del análisis de la expresión facial,” Revista Ingenierías Universidad de Medellín, vol. 19, no. 36, pp. 13–28, Jun. 2019, doi: 10.22395/rium.v19n36a1.
D. A. Albornoz, S. A. Moncayo, S. Ruano-Hoyos, G.-E. Chanchí-Golondrino, and K. Márceles-Villalba, “Sistema software para la ejecución de pruebas de usabilidad bajo el enfoque de mouse tracking,” TecnoLógicas, vol. 22, pp. 19–31, Dec. 2019, doi: 10.22430/22565337.1511.
G.-E. Chanchí-Golondrino, W.-Y. Campo-Muñoz, and L.-F. Muñoz-Sanabria, “Herramienta automatizada para el análisis de la satisfacción en pruebas de pensamiento en voz alta,” Revista Ibérica de Sistemas e Tecnologias de Informação, no. E17, pp. 11–24, 2019.
M. Kitabata, Y. Inazumi, T. Misawa, Y. Horita, O. Sugimoto, and S. Naito, “Can brain activity be used to evaluate the usability of smartphone devices?,” in 2017 IEEE 6th Global Conference on Consumer Electronics (GCCE), Nagoya, Japan, Oct. 2017. doi: 10.1109/GCCE.2017.8229346.
R. Abiri, S. Borhani, J. Kilmarx, C. Esterwood, Y. Jiang, and X. Zhao, “A usability study of low-cost wireless brain-computer interface for cursor control using online linear model,” IEEE Transactions on Human-Machine Systems, vol. 50, no. 4, pp. 287–297, Aug. 2020, doi: 10.1109/THMS.2020.2983848.
G.-E. Chanchí-Golondrino, M.-A. Ospina-Alarcón, and J.-L. Pérez, “Sistema IoT para la monitorización de la variabilidad del ritmo cardiaco en pruebas de usabilidad,” Revista Espacios, vol. 41, no. 25, 2020, [Online]. Available: https://www.revistaespacios.com/a20v41n25/a20v41n25p07.pdf
S. Baldassarri, “Computación Afectiva: tecnología y emociones para mejorar la experiencia de usuario,” Bit & Byte, vol. 2, no. 3, 2016, [Online]. Available: http://sedici.unlp.edu.ar/handle/10915/53441
P. Mukherjee, Y. Badr, S. Doppalapudi, S. M. Srinivasan, R. S. Sangwan, and R. Sharma, “Effect of negation in sentences on sentiment analysis and polarity detection,” Procedia Computer Science, vol. 185, pp. 370–379, 2021, doi: 10.1016/j.procs.2021.05.038.
F. H. Khan, U. Qamar, and S. Bashir, “eSAP: A decision support framework for enhanced sentiment analysis and polarity classification,” Information Sciences, vol. 367–368, pp. 862–873, Nov. 2016, doi: 10.1016/j.ins.2016.07.028.
A. Moreno-Ortiz and J. Fernández-Cruz, “Identifying polarity in financial texts for sentiment analysis: A corpus-based approach,” Procedia - Social and Behavioral Sciences, vol. 198, pp. 330–338, Jul. 2015, doi: 10.1016/j.sbspro.2015.07.451.
B. A. Januario, A. E. de O. Carosia, A. E. A. da Silva, and G. P. Coelho, “Sentiment analysis applied to news from the Brazilian stock market,” IEEE Latin America Transactions, vol. 20, no. 3, pp. 512–518, Mar. 2022, doi: 10.1109/TLA.2022.9667151.
R. Cai et al., “Sentiment analysis about investors and consumers in energy market based on BERT-BiLSTM,” IEEE Access, vol. 8, pp. 171408–171415, 2020, doi: 10.1109/ACCESS.2020.3024750.
D. D. Wu, L. Zheng, and D. L. Olson, “A decision support approach for online stock forum sentiment analysis,” IEEE Transactions on Systems, Man, and Cybernetics: Systems, vol. 44, no. 8, pp. 1077–1087, Aug. 2014, doi: 10.1109/TSMC.2013.2295353.
K. S. Pratt and H. R. Bright, “Design patterns for research methods: Iterative field research.” [Online]. Available: http://kpratt.net/wp-content/uploads/2009/01/research_methods.pdf
G. E. Chanchí-Golondrino, M.-A. Ospina-Alarcón, and M.-E. Ospino-Pinedo, “Hacia el desarrollo de las competencias digitales de la UNESCO durante el confinamiento en un curso de Interacción Humano Computador,” Revista REDIPE, vol. 11, no. 2, 2022, [Online]. Available: https://revista.redipe.org/index.php/1/article/view/1672/1582
G.-E. Chanchí-Golondrino, L.-F. Muñoz-Sanabria, and L. Sierra, “Determinación del nivel de percepción de usuario a través de estudios de análisis de sentimientos en el contexto del marketing,” Revista INGE CUC, vol. 18, no. 2, 2022, doi: 10.17981/ingecuc.18.2.2022.19.
S. Makunda Rao, N. Monica, P. Nikhila, T. Tejasri, and B. Maram, “Positivity Calculation using Vader Sentiment Analyser,” International Journal of Academic Engineering Research (IJAER), vol. 4, no. 3, pp. 13–17.
Downloads
Published
Issue
Section
License
Copyright (c) 2023 Gabriel Elías Chanchí Golondrino, Luis Freddy Muñoz Sanabria, Luz Marina Sierra Martínez
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
The authors to publish in this journal agree to the following conditions:
- The authors transfer the copyright and give the the journal first publication right of the work registered with Creative Commons Attribution License, which allows third parties to use the published work on the condition of always mentioning the authorship and first publication in this journal.
- The authors may perform other independent and additional contractual arrangements for the non-exclusive distribution of the version of the article published in this issue (E.g., Inclusion in an institutional repository or publication in a book), it must be indicated clearly that the work was first published in this journal.
- It allows and encourages the authors to publish their work online (eg institutional or personal pages) before and during the review and publication process. It can lead to productive exchanges and greater and faster dissemination of the published work (see The Effect of Open Access)
Instructions to fill out Certificate of Originality and Copyright Assignment
- Click here and get the forms of Certificate of Originality and Copyright Assignment .
- In each field to fill out, click and complete the corresponding information.
- Once the fields are filled out, at the end of the form copy your scanned signature or digital signature. Please adjust the size of the signature on the form.
- Finally, you can save them as pdf files and send them through the OJS platform as an attachment.
