Study of monitoring platforms to select the technology stack as a basis for a software testing specialized analytics system
Article Sidebar
Main Article Content
To rapidly improve the quality of web applications, it is necessary to implement automated testing strategies that allow you to comprehensively evaluate functionality and performance attributes, which are directly affected by the behavior of the hardware of the servers where they are hosted. Just as IT teams monitor the infrastructure that supports the applications, automations should be supported by monitoring platforms with specialized software testing analytics. This article presents the evaluation of four technology stacks, which will make it possible to select the most appropriate one to be included in the development of a platform specialized in software quality analytics. The four stacks in this study are: PALG, TICK, ELK, AM. This article will explain the characteristics and differences of stacks compared to various components such as: database, information filtering, collection of operating system metrics, alert system, data ingestion and visualization. Then simulations and tests carried out on each of them are described to evaluate their capabilities. Finally, conclusions are issued that will allow to select the technology stack that will be used in the development of the system specialized analytics for software testing.
Carlos E. Gordillo Agudelo, Universidad del Valle, Facultad de Ingeniería, Escuela de Ingeniería de Sistemas y Computación, Cali, Colombia
https://orcid.org/0000-0002-5268-7436
Beatriz Florian-Gaviria, Universidad del Valle, Facultad de Ingeniería, Escuela de Ingeniería de Sistemas y Computación, Cali, Colombia
https://orcid.org/0000-0002-2138-9508
Eider M. Aristizábal, Green SQA, Tecnología e Investigación Aplicada, Cali, Colombia
https://orcid.org/0000-0001-7384-7171
(1) Finstad K. The usability metric for user experience. Interact Comput. 2010;22(5):323–7. https://doi.org/10.1016/j.intcom.2010.04.004.
(2) ¿Por qué necesitas realizar pruebas de rendimiento a tu aplicación? Software testing bureau [Internet]. 2019 [cited 2021 Aug 1]. Available from: https://www.softwaretestingbureau.com/cuanta-carga-puede-soportar-tu-aplicacion/.
(3) Prometheus Authors. Data model. Prometheus.io [Internet]. 2016 [cited 2021 Jan 14]. Available from: https://prometheus.io/docs/concepts/data_model/.
(4) Compare InfluxDB con bases de datos SQL. influxdata.com [Internet]. 2015 [cited 2021 Mar 2]. Available from: https://docs.influxdata.com/influxdb/v1.8/concepts/crosswalk/.
(5) John AT, Chika Amadi B, Chima Umeokpala F. Detection of Anomalies in a Time Series Data using InfluxDB and Python. arXiv:2012.08439 [Preprint]. 2020 [cited 2021 Mar 2]. Available from: https://arxiv.org/abs/2012.08439.
(6) Cuervo V. ¿Qué es Elasticsearch?. arquitectoit.com [Internet]. 2019 [cited 2021 Mar 2]. Available from: http://www.arquitectoit.com/elasticsearch/que-es-elasticsearch/.
(7) Martinviita M. Time series database in Industrial IoT and its testing tool [Master’s thesis]. University of Oulu, Degree Programme in Computer Science and Engineering; 2018. Available from: http://urn.fi/URN:NBN:fi:oulu-201811093007.
(8) Azure Monitor. Microsoft [Internet]. 2014 [cited 2021 Mar 2]. Available from: https://azure.microsoft.com/es-es/services/monitor/.
(9) Martín Olías P. Prueba de concepto Azure Monitor [Tesis de pregrado]. Universitat oberta de Catalunya; 2020. Available from: http://openaccess.uoc.edu/webapps/o2/bitstream/10609/108786/6/mmendozafTFG0120memoria.pdf.
(10) Prometheus Authors. Management API. Prometheus.io [Internet]. 2019 [cited 2021 Mar 2]. Available from: https://prometheus.io/docs/prometheus/latest/management_api/
(11) Documentación de Chronograf 1.8. influxdata.com [Internet]. 2017 [cited 2021 Mar 2]. Available from: https://docs.influxdata.com/chronograf/v1.8/.
(12) Kibana: Explora, visualiza y descubre datos. elastic.co [Internet]. 2020 [cited 2021 Mar 2]. Available from: https://www.elastic.co/es/kibana.
(13) Roles, permisos y seguridad en Azure Monitor. Documentos de Microsoft [Internet]. 2021 [cited 2021 Mar 2]. Available from: https://docs.microsoft.com/es-es/azure/azure-monitor/roles-permissions-security.
(14) Perera N, Otarán F. Propuesta de una solución de monitoreo para sistemas del CeSPI [Tesis de pregrado]. Universidad Nacional de La Plata; 2017. Available from: http://sedici.unlp.edu.ar/handle/10915/61525
(15) Documentación de Telegraf 1.17. influxdata.com [Internet]. 2016 [cited 2021 Mar 2]. Available from: https://docs.influxdata.com/telegraf/v1.17/.
(16) Elastic Stack and Product Documentation. elastic.co [Internet]. 2015 [cited 2021 Jan 14]. Available from: https://www.elastic.co/guide/index.html.
(17) ¿Qué es Azure Application Insights? - Monitor de Azure. Documentos de Microsoft [Internet]. 2021 [cited 2021 Mar 2]. Available from: https://docs.microsoft.com/en-us/azure/azure-monitor/app/app-insights-overview.
(18) Prometheus Authors. Alertmanager. Prometheus.io [Internet]. 2016 [cited 2021 Mar 2]. Available from: https://prometheus.io/docs/alerting/latest/alertmanager/.
(19) Kapacitor 1.5 Documentation. influxdata.com [Internet]. 2016 [cited 2021 Mar 2]. Available from: https://docs.influxdata.com/kapacitor/v1.5/.
(20) Azure Monitor documentation - Azure Monitor. Microsoft Docs [Internet]. 2021 [cited 2021 Jan 14]. Available from: https://docs.microsoft.com/en-us/azure/azure-monitor/.
(21) Grafana documentation. Grafana.com [Internet]. 2019 [cited 2021 Jan 14]. Available from: https://grafana.com/docs/grafana/latest/.
Accepted 2021-08-26
Published 2022-01-15
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Authors grant the journal and Universidad del Valle the economic rights over accepted manuscripts, but may make any reuse they deem appropriate for professional, educational, academic or scientific reasons, in accordance with the terms of the license granted by the journal to all its articles.
Articles will be published under the Creative Commons 4.0 BY-NC-SA licence (Attribution-NonCommercial-ShareAlike).