Framework Based on Simulation of Real-World Message Streams to Evaluate Classification Solutions
Please use this identifier to cite or link to this item:
http://hdl.handle.net/10045/140059
Full metadata record
DC Field | Value | Language |
---|---|---|
dc.contributor | GrupoM. Redes y Middleware | es_ES |
dc.contributor.author | Hojas-Mazo, Wenny | - |
dc.contributor.author | Maciá Pérez, Francisco | - |
dc.contributor.author | Berna-Martinez, Jose Vicente | - |
dc.contributor.author | Moreno-Espino, Mailyn | - |
dc.contributor.author | Lorenzo Fonseca, Iren | - |
dc.contributor.author | Pavón Mestras, Juan | - |
dc.contributor.other | Universidad de Alicante. Departamento de Tecnología Informática y Computación | es_ES |
dc.date.accessioned | 2024-01-26T12:21:46Z | - |
dc.date.available | 2024-01-26T12:21:46Z | - |
dc.date.issued | 2024-01-21 | - |
dc.identifier.citation | Hojas-Mazo W, Maciá-Pérez F, Berná Martínez JV, Moreno-Espino M, Lorenzo Fonseca I, Pavón J. Framework Based on Simulation of Real-World Message Streams to Evaluate Classification Solutions. Algorithms. 2024; 17(1):47. https://doi.org/10.3390/a17010047 | es_ES |
dc.identifier.issn | 1999-4893 | - |
dc.identifier.uri | http://hdl.handle.net/10045/140059 | - |
dc.description.abstract | Analysing message streams in a dynamic environment is challenging. Various methods and metrics are used to evaluate message classification solutions, but often fail to realistically simulate the actual environment. As a result, the evaluation can produce overly optimistic results, rendering current solution evaluations inadequate for real-world environments. This paper proposes a framework based on the simulation of real-world message streams to evaluate classification solutions. The framework consists of four modules: message stream simulation, processing, classification and evaluation. The simulation module uses techniques and queueing theory to replicate a real-world message stream. The processing module refines the input messages for optimal classification. The classification module categorises the generated message stream using existing solutions. The evaluation module evaluates the performance of the classification solutions by measuring accuracy, precision and recall. The framework can model different behaviours from different sources, such as different spammers with different attack strategies, press media or social network sources. Each profile generates a message stream that is combined into the main stream for greater realism. A spam detection case study is developed that demonstrates the implementation of the proposed framework and identifies latency and message body obfuscation as critical classification quality parameters. | es_ES |
dc.language | eng | es_ES |
dc.publisher | MDPI | es_ES |
dc.rights | © 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). | es_ES |
dc.subject | Classification | es_ES |
dc.subject | Evaluation | es_ES |
dc.subject | Non-stationary message streams | es_ES |
dc.subject | Simulation | es_ES |
dc.title | Framework Based on Simulation of Real-World Message Streams to Evaluate Classification Solutions | es_ES |
dc.type | info:eu-repo/semantics/article | es_ES |
dc.peerreviewed | si | es_ES |
dc.identifier.doi | 10.3390/a17010047 | - |
dc.relation.publisherversion | https://doi.org/10.3390/a17010047 | es_ES |
dc.rights.accessRights | info:eu-repo/semantics/openAccess | es_ES |
Appears in Collections: | INV - GrupoM - Artículos de Revistas |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
Hojas-Mazo_etal_2024_Algorithms.pdf | 437,69 kB | Adobe PDF | Open Preview | |
Items in RUA are protected by copyright, with all rights reserved, unless otherwise indicated.