Proposal of a Tool for the Analysis of Usability Heuristic Evaluations Using Fuzzy Logic

https://doi.org/10.25100/iyc.v24i1.11095
fuzzy logic heuristic evaluation usability usability inspection

Article Sidebar

PDF XML (Español)

Published: Jan 15, 2022
Issue: Vol. 24 No. 1 (2022): Ingenieria y Competitividad
Section Artículos de investigacion

Publcation metrics

272 | 112 | 135




 


Main Article Content

Authors

  Gabriel Elías Chanchí-Golondrino Universidad de Cartagena, Facultad de Ingeniería, Ingeniería de Sistemas, Cartagena de Indias, Colombia
  Manuel Alejandro Ospina-Alarcón Universidad de Cartagena, Facultad de Ingeniería, Ingeniería de Sistemas, Cartagena de Indias, Colombia
  Wilmar Yesid Campo-Muñoz Universidad del Quindío, Facultad de Ingeniería, Ingeniería Electrónica, Armenia, Colombia
Abstract

With the growth in the number of applications deployed on the Internet and the number of users that can consume them, aspects such as usability have become fundamental to promote user-centered design. In this sense, one of the most widespread methods to evaluate the usability of a software application is heuristic evaluation, in which a group of experts identifies a set of problems according to usability principles and evaluates said problems using the criteria of: severity, frequency and criticality. In order to more clearly determine the level of criticality of the different problems identified within an inspection, this article proposes as a contribution the development of a tool based on fuzzy logic for determining the percentage of output criticality, based on the input values of severity and frequency of each problem. Both the inputs and outputs have membership functions and inference rules, which were described in the FCL (Fuzzy Control Language) language. Finally, the proposed tool was validated through the analysis of the results of a heuristic evaluation carried out to the Sevenet Database Management System of the Licorera del Cauca Industry, in such a way that it allowed to identify the criticality levels of output of each one of the problems of such inspection.

How to Cite
1.
Chanchí-Golondrino GE, Ospina-Alarcón MA, Campo-Muñoz WY. Proposal of a Tool for the Analysis of Usability Heuristic Evaluations Using Fuzzy Logic. inycomp [Internet]. 2022 Jan. 15 [cited 2024 Nov. 21];24(1). Available from: https://revistaingenieria.univalle.edu.co/index.php/ingenieria_y_competitividad/article/view/11095
References

(1) Sánchez-Álvarez JF, Zapata-Jaramillo CM, Jimenez-Builes JA. Evaluación heurística de la usabilidad de software para facilitar el uso del computador a personas en situación de discapacidad motriz. Rev EIA. 2017;14(27):63–72. https://doi.org/10.24050/reia.v14i27.785.

(2) Dzulfiqar MD, Khairani D, Wardhani LK. The Development of University Website using User Centered Design Method with ISO 9126 Standard. In: 2018 6th International Conference on Cyber and IT Service Management, CITSM 2018. Parapat: IEEE; 2018. p. 1–4. https://doi.org/10.1109/CITSM.2018.8674325.

(3) Prahasiwi TG, Kurniawan S, Satriaji W, Suhartono, Endah SN, Kusumaningrum R. Usability Testing for Batik 4.0: A Web Application for Generating 3D Batik Semarang. In: 2018 2nd International Conference on Informatics and Computational Sciences, ICICoS 2018. Semarang: IEEE; 2018. p. 1–6. https://doi.org/10.1109/ICICOS.2018.8621843.

(4) Adhy S, Noranita B, Kusumaningrum R, Wirawan PW, Prasetya DD, Zaki F. Usability testing of weather monitoring on a web application. In: Proceedings - 2017 1st International Conference on Informatics and Computational Sciences, ICICoS 2017. Semarang: IEEE; 2017. p. 131–136. https://doi.org/10.1109/ICICOS.2017.8276350.

(5) Naqvi HF, Chandio FH, Soomro AF, Abbasi MS. Software as a Service Acceptance Model: A User-Centric Perspective in Cloud Computing Context. In: 2018 IEEE 5th International Conference on Engineering Technologies and Applied Sciences, ICETAS 2018. Bangkok: IEEE; 2018. p. 1-4. https://doi.org/10.1109/ICETAS.2018.8629200.

(6) Axinte SD, Bacivarov IC. Improving the Quality of Web Applications Through Targeted Usability Enhancements. In: 2018 10th International Conference on Electronics, Computers and Artificial Intelligence (ECAI). Iasi: IEEE; 2018. p. 1-4. https://doi.org/10.1109/ECAI.2018.8679098.

(7) Surma-aho A, Hölttä-Otto K, Nelskylä K, Lindfors NC. Usability issues in the operating room – Towards contextual design guidelines for medical device design. Appl Ergon. 2021;90:103221. https://doi.org/10.1016/j.apergo.2020.103221.

(8) Gozález-Sánchez JL, Montero-Simarro F, Gutiérrez-Vela FL. Evolución del concepto de usabilidad como indicador de calidad del software. Prof. De la Inf. 2012;21(5):529–536. https://doi.org/10.3145/epi.2012.sep.13.

(9) Feroz I, Ahmad N, Iqbal MW. Usability based rating scale for mobile health applications. In: 2019 International Conference on Engineering and Emerging Technologies, ICEET 2019. Lahore: IEEE; 2019. p. 1-7. https://doi.org/10.1109/CEET1.2019.8711845.

(10) Apaza-Yllachura Y, Paz-Valderrama A, Corrales-Delgado C. SimpleAR: Augmented Reality high-level content design framework using visual programming. In: 2019 38th International Conference of the Chilean Computer Science Society, SCCC. Concepción: IEEE; 2019. p. 1-7. https://doi.org/10.1109/SCCC49216.2019.8966427.

(11) Blanco-Gonzalo R, Sanchez-Reillo R, Goicoechea-Telleria I, Strobl B. The mobile pass project: A user interaction evaluation. IEEE Trans Human-Machine Syst. 2018;48(3):311–315. https://doi.org/10.1109/THMS.2018.2791571.

(12) Solano A, Ceron JC, Collazos CA, Fardoun HM. ECUSI: Herramienta software para la evaluación colaborativa de la usabilidad de sistemas interactivos. In: 2015 10th Colombian Computing Conference, 10CCC 2015. Bogotá: IEEE; 2015. p. 157–163. https://doi.org/10.1109/ColumbianCC.2015.7333418.

(13) Rozali NBN, Said MYB. Usability testing on government agencies web portal: A study on Ministry of Education Malaysia (MOE) web portal. In: 2015 9th Malaysian Software Engineering Conference, MySEC 2015. Kuala Lumpur: IEEE; 2015. p. 37–42. https://doi.org/10.1109/MySEC.2015.7475192.

(14) Weichbroth P. Usability of mobile applications: A systematic literature study. IEEE Access. 2020;8:55563–55577. https://doi.org/10.1109/ACCESS.2020.2981892.

(15) Fu J. Usability evaluation of software store based on eye-tracking technology. In: Proceedings of 2016 IEEE Information Technology, Networking, Electronic and Automation Control Conference, ITNEC 2016. Chongqing: IEEE. 2016. p. 1116–1119. https://doi.org/10.1109/ITNEC.2016.7560538.

(16) Mascheroni M, Greiner C, Petris R, Dapozo G, Estayno M. Calidad de software e ingeniería de usabilidad. In: XIV Workshop de Investigadores en Ciencias de la Computación. Posadas. La Plata: Universidad Nacional de la Plata; 2012. p. 656–659. Available from: http://sedici.unlp.edu.ar/handle/10915/19202.

(17) Sanchez W. La usabilidad en ingeniería de software: definición y características. Ing-novación [Internet]. 2011 [cited 2020 Nov 5];(2):7–21. Available from: http://hdl.handle.net/10972/1937.

(18) Madhavan R, Alagarsamy K. Usability Issues in Software Development Lifecycle. Int J Adv Res Comput Sci Softw Eng. 2013;3(8):1131–5.

(19) Hurtado N, Ruiz M, Torres J. Modelado y simulación de la evaluación heurística de usabilidad. In: XV Jornadas de Ingeniería del Software y Bases de Datos - JISBD. Barcelona: CIMNE; 2006. p. 1–10.

(20) Hering D, Schwartz T, Boden A, Wulf V. Integrating usability-engineering into the software developing processes of SME: A case study of software developing SME in Germany. In: Proceedings - 8th International Workshop on Cooperative and Human Aspects of Software Engineering, CHASE 2015. Florence: IEEE; 2015. p. 121–122. https://doi.org/10.1109/CHASE.2015.22.

(21) Rengifo Y, Chanchí GE, Pérez D, Campo W. Aplicativo web para la ejecución de evaluaciones heurísticas de accesibilidad en portales web según la norma NTC 5854. Rev Ibérica Sist e Tecnol Informação. 2020;(E26):501–13.

(22) Ssemugabi S, de Villiers MR. Effectiveness of heuristic evaluation in usability evaluation of elearning applications in higher education. South African Comput J. 2010;45:26–39. https://doi.org/10.18489/sacj.v45i0.37.

(23) Allen M, Currie LM, Bakken S, Patel VL, Cimino JJ. Heuristic evaluation of paper-based Web pages: A simplified inspection usability methodology. J Biomed Inform. 2006;39(4):412–23. https://doi.org/10.1016/j.jbi.2005.10.004.

(24) Saavedra-Calderon MJ. Heurísticas para la experiencia del usuario en redes sociales [Pregrado]. Pontificia Universidad Católica de Valparaíso; 2018. Disponible en: https://catalogo.pucv.cl/cgi-bin/koha/opac-detail.pl?biblionumber=431225.

(25) Hilletofth P, Sequeira M, Adlemo A. Three novel fuzzy logic concepts applied to reshoring decision-making. Expert Syst Appl. 2019;126:133–143. https://doi.org/10.1016/j.eswa.2019.02.018.

(26) Zadeh L. Fuzzy Logic, Neural Networks, and Soft Computing. Commun ACM. 1994;37(3):77–84. https://doi.org/10.1142/9789814261302_0040.

(27) Mittal K, Jain A, Vaisla KS, Castillo O, Kacprzyk J. A comprehensive review on type 2 fuzzy logic applications: Past, present and future. Eng Appl Artif Intell. 2020;95:103916. https://doi.org/10.1016/j.engappai.2020.103916.

(28) Aznar E, Royo J. Conceptos y aplicaciones de la lógica borrosa. Técnica Ind [Internet]. 2007 [cited 2021 Mar 8];(269):58–63. Available from: https://www.tecnicaindustrial.es/wp-content/uploads/Numeros/29/38/a38.pdf.

(29) Ramírez N, Laguna M. La lógica borrosa: conjuntos borrosos, razonamiento aproximado y control borroso. Pist Educ. 2012 [cited 2021 Mar 8];(100):55–65. Available from: http://pistaseducativas.itc.mx/wp-content/uploads/2013/01/6-RAMIREZ-PE-100-55-65.pdf.

(30) Buckley JJ, Eslami E. An Introduction to Fuzzy Logic and Fuzzy Sets [Internet]. 1st ed. Verlag Berlin Heidelberg: Springer; 2002. p. 275. https://doi.org/10.1007/978-3-7908-1799-7

(31) Chanchi GE, Ospina MA, Monroy ME. Aplicación de la lógica difusa en el análisis de inspecciones heurísticas de usabilidad. Rev Espac. 2020;41(27):159–73. Available from: https://www.revistaespacios.com/a20v41n27/20412715.html.

(32) Roa Amaya M, Caldera Serrano J. Evaluación Heurística de las sedes web de los medios digitales: El País y El Mundo. Cuad Doc Multimed. 2012;22(0):128–50. http://dx.doi.org/10.5209/rev_CDMU.2011.v22.38340.

(33) Inga M, Zemanate L, Chanchí G. Evaluación Heurística De Usabilidad Sobre El Sistema Gestor De Base De Datos (SGBD) De Sevenet De La Industria Licorera Del Cauca (ILC). In: Avances y Experiencias Innovadoras en Computación e Informática [Internet]. Pasto, Colombia: Universidad CESMAG; 2020. p. 231–47. Available from: http://repositorio.unicesmag.edu.co:8080/xmlui/handle/123456789/118.

(34) Raza A, Capretz LF. Usability as a Dominant Quality Attribute. In: International Conference on Software Engineering Research and Practice [Internet]. Las Vegas: 2015 [cited 2020 Oct 20]. p. 571–5. Available from: http://arxiv.org/abs/1508.06195.

(35) Lew P, Olsina L, Zhang L. Integrating Quality, quality in use, actual usability and user experience. In: 6th Central and Eastern European Software Engineering Conference (CEE-SECR2010), Moscow: IEEE. 2010. p. 117-123, https://doi.org/10.1109/CEE-SECR.2010.5783161.

(36) Anjum N, Sarker M, Ishteaque Ahmed S. Evaluation of Web Usability Requirement Model and Web Application Interface Components. International Journal of Advanced Research in Computer Science and Software Engineering. 2019;9(6):1-8. https://doi.org/10.23956/ijarcsse.v9i6.919.

(37) Sánchez-Macías A, Veytia-Bucheli M, Azuara-Pugliese V. La usabilidad de las TIC y las competencias de docentes de posgrado. Rev Espac. 2020;41(06):13. Available from: https://www.revistaespacios.com/a20v41n06/20410613.html.

(38) Lodhi A. Usability heuristics as an assessment parameter: For performing usability testing. In: 2nd International Conference on Software Technology and Engineering, Proceedings (ICSTE 2010). San Juan (Puerto Rico): IEEE; 2010. p. V2-256–V2-259. https://doi.org/10.1109/ICSTE.2010.5608809.

(39) Yoshiaki Nakagawa F, Felinto A, Omori M. Inclusion of teaching slides in games: Analysis of the efficiency, effectiveness and satisfaction. IEEE Lat Am Trans. 2013;11(6):1372–1377. https://doi.org/10.1109/TLA.2013.6710386.

(40) Turbo O. La usabilidad pedagógica en la formación del profesorado: un estudio de caso. Rev Espac. 2018;39(15):6. Available from: https://www.revistaespacios.com/a18v39n15/18391506.html.

(41) Arthana IKR, Pradnyana IMA, Dantes GR. Usability testing on website wadaya based on ISO 9241-11. Journal of Physics: Conference Series. 2019;1165:012012. https://doi.org/10.1088/1742-6596/1165/1/012012.

(42) Dietlein CS, Bock OL. Development of a usability scale based on the three ISO 9241-11 categories “effectiveness,” “efficacy” and “satisfaction”: a technical note. Accredit Qual Assur . 2019;24:181–189. https://doi.org/10.1007/s00769-018-01368-2.

(43) Hoorn JF. Stakeholder logistics of an interactive system. J Syst Softw. 2014;95:52–69. https://doi.org/10.1016/j.jss.2013.11.1095.

(44) Paz F, Paz FA, Villanueva D, Pow-Sang JA. Heuristic Evaluation as a Complement to Usability Testing: A Case Study in Web Domain. In: 12th International Conference on Information Technology: New Generations, ITNG 2015. Las Vegas: IEEE; 2015. p. 546–551. https://doi.org/10.1109/ITNG.2015.92.

(45) Lam D, Sajjanhar A. Heuristic Evaluations of Cultural Heritage Websites. In: 2018 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2018. Canberra: IEEE; 2018. p. 1-6. https://doi.org/10.1109/DICTA.2018.8615847.

(46) Enriquez G, Casas S. Usabilidad en aplicaciones móviles. Inf Científico Técnico UNPA [Internet]. 2013;5(2):25–47. https://doi.org/10.22305/ict-unpa.v5i2.71.

(47) Nikookar A, Jahanshah S, Tavakkol S. Heuristic Evaluation Method: A Proposed Workflow. Int J Innov Manag Technol [Internet]. 2013;4(1):80–2. Available from: http://www.ijimt.org/papers/362-Z099.pdf.

(48) Liu K, Chan F yee, Or CK, Sun DT fung, Lai W see, So H yu. Heuristic evaluation and simulated use testing of infusion pumps to inform pump selection. Int J Med Inform. 2019;131:103932. https://doi.org/10.1016/j.ijmedinf.2019.07.011.

(49) Georde JK, Bo Y. Fuzz set and fuzz logic Theory and Applications. Prentice Hall; 1995. p. 588.

(50) Chanchí G, Sierra-Martínez L, Campo W. Aplicación de la lógica difusa en la implementación de rúbricas de evaluación en el contexto universitario. Rev Ibérica Sist e Tecnol Informação. 2021;(E42):174–87.

(51) Cordovez P, Jiménez C, Lata V. Patrones de usabilidad para sitios de gobierno electrónico. Novasinergia. 2018;1(1):41–50.

(52) Ponce Cruz P. Inteligencia Artificial con aplicaciones a la ingeniería. 1st. Alfaomega, editor. Alfaomega. México D.F.; 2010. 376 p.

(53) Gúzmán G, Castaño V. La lógica difusa en ingeniería: Principios, aplicaciones y futuro. Cienc y Tecnol. 2006;24(2):87–107. Available from: http://revistas.ucr.ac.cr/index.php/cienciaytecnologia/article/view/2640.

Received 2021-03-23
Accepted 2021-07-13
Published 2022-01-15
Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.

Authors grant the journal and Universidad del Valle the economic rights over accepted manuscripts, but may make any reuse they deem appropriate for professional, educational, academic or scientific reasons, in accordance with the terms of the license granted by the journal to all its articles.

Articles will be published under the Creative Commons 4.0 BY-NC-SA licence (Attribution-NonCommercial-ShareAlike).