Analyzing the capabilities of crowdsourcing services for text summarization
Por favor, use este identificador para citar o enlazar este ítem:
http://hdl.handle.net/10045/40117
Título: | Analyzing the capabilities of crowdsourcing services for text summarization |
---|---|
Autor/es: | Lloret, Elena | Plaza Morales, Laura | Aker, Ahmet |
Grupo/s de investigación o GITE: | Procesamiento del Lenguaje y Sistemas de Información (GPLSI) |
Centro, Departamento o Servicio: | Universidad de Alicante. Departamento de Lenguajes y Sistemas Informáticos |
Palabras clave: | Information retrieval | Text summarization | Crowdsourcing services | Crowdflower | Mechanical Turk |
Área/s de conocimiento: | Lenguajes y Sistemas Informáticos |
Fecha de publicación: | jun-2013 |
Editor: | Springer Science+Business Media B.V. |
Cita bibliográfica: | Language Resources & Evaluation. 2013, 47(2): 337-369. doi:10.1007/s10579-012-9198-8 |
Resumen: | This paper presents a detailed analysis of the use of crowdsourcing services for the Text Summarization task in the context of the tourist domain. In particular, our aim is to retrieve relevant information about a place or an object pictured in an image in order to provide a short summary which will be of great help for a tourist. For tackling this task, we proposed a broad set of experiments using crowdsourcing services that could be useful as a reference for others who want to rely also on crowdsourcing. From the analysis carried out through our experimental setup and the results obtained, we can conclude that although crowdsourcing services were not good to simply gather gold-standard summaries (i.e., from the results obtained for experiments 1, 2 and 4), the encouraging results obtained in the third and sixth experiments motivate us to strongly believe that they can be successfully employed for finding some patterns of behaviour humans have when generating summaries, and for validating and checking other tasks. Furthermore, this analysis serves as a guideline for the types of experiments that might or might not work when using crowdsourcing in the context of text summarization. |
Patrocinador/es: | This work was supported by the EU-funded TRIPOD project (IST-FP6-045335) and by the Spanish Government through the FPU program and the projects TIN2009-14659-C03-01, TSI 020312-2009-44, and TIN2009-13391-C04-01; and by Conselleria d’Educació–Generalitat Valenciana (grant no. PROMETEO/2009/119 and grant no. ACOMP/2010/286). |
URI: | http://hdl.handle.net/10045/40117 |
ISSN: | 1574-020X (Print) | 1574-0218 (Online) |
DOI: | 10.1007/s10579-012-9198-8 |
Idioma: | eng |
Tipo: | info:eu-repo/semantics/article |
Derechos: | The final publication is available at Springer via http://dx.doi.org/10.1007/s10579-012-9198-8 |
Revisión científica: | si |
Versión del editor: | http://dx.doi.org/10.1007/s10579-012-9198-8 |
Aparece en las colecciones: | INV - GPLSI - Artículos de Revistas |
Archivos en este ítem:
Archivo | Descripción | Tamaño | Formato | |
---|---|---|---|---|
2013_Lloret_etal_LR&E_final.pdf | Versión final (acceso restringido) | 440,22 kB | Adobe PDF | Abrir Solicitar una copia |
2013_Lloret_etal_LR&E.pdf | Versión revisada (acceso abierto) | 922,17 kB | Adobe PDF | Abrir Vista previa |
Todos los documentos en RUA están protegidos por derechos de autor. Algunos derechos reservados.