Automated illustration of multimedia stories

Detalhes bibliográficos
Autor(a) principal: Delgado, Diogo Miguel Melo
Data de Publicação: 2010
Tipo de documento: Dissertação
Idioma: eng
Título da fonte: Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
Texto Completo: http://hdl.handle.net/10362/4478
Resumo: Submitted in part fulfillment of the requirements for the degree of Master in Computer Science
id RCAP_b3f6d2dc50e33e6e2b771d8920ec80b1
oai_identifier_str oai:run.unl.pt:10362/4478
network_acronym_str RCAP
network_name_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository_id_str 7160
spelling Automated illustration of multimedia storiesStory illustrationText analysisInformational retrievalImage-text associationVector space modelUser feedbackSubmitted in part fulfillment of the requirements for the degree of Master in Computer ScienceWe all had the problem of forgetting about what we just read a few sentences before. This comes from the problem of attention and is more common with children and the elderly. People feel either bored or distracted by something more interesting. The challenge is how can multimedia systems assist users in reading and remembering stories? One solution is to use pictures to illustrate stories as a mean to captivate ones interest as it either tells a story or makes the viewer imagine one. This thesis researches the problem of automated story illustration as a method to increase the readers’ interest and attention. We formulate the hypothesis that an automated multimedia system can help users in reading a story by stimulating their reading memory with adequate visual illustrations. We propose a framework that tells a story and attempts to capture the readers’ attention by providing illustrations that spark the readers’ imagination. The framework automatically creates a multimedia presentation of the news story by (1) rendering news text in a sentence by-sentence fashion, (2) providing mechanisms to select the best illustration for each sentence and (3) select the set of illustrations that guarantees the best sequence. These mechanisms are rooted in image and text retrieval techniques. To further improve users’ attention, users may also activate a text-to-speech functionality according to their preference or reading difficulties. First experiments show how Flickr images can illustrate BBC news articles and provide a better experience to news readers. On top of the illustration methods, a user feedback feature was implemented to perfect the illustrations selection. With this feature users can aid the framework in selecting more accurate results. Finally, empirical evaluations were performed in order to test the user interface,image/sentence association algorithms and users’ feedback functionalities. The respective results are discussed.Faculdade de Ciências e TecnologiaMagalhães, JoãoCorreia, NunoRUNDelgado, Diogo Miguel Melo2010-12-13T19:22:50Z20102010-01-01T00:00:00Zinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/masterThesisapplication/pdfhttp://hdl.handle.net/10362/4478enginfo:eu-repo/semantics/openAccessreponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãoinstacron:RCAAP2024-03-11T03:34:24Zoai:run.unl.pt:10362/4478Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireopendoar:71602024-03-20T03:15:46.397023Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãofalse
dc.title.none.fl_str_mv Automated illustration of multimedia stories
title Automated illustration of multimedia stories
spellingShingle Automated illustration of multimedia stories
Delgado, Diogo Miguel Melo
Story illustration
Text analysis
Informational retrieval
Image-text association
Vector space model
User feedback
title_short Automated illustration of multimedia stories
title_full Automated illustration of multimedia stories
title_fullStr Automated illustration of multimedia stories
title_full_unstemmed Automated illustration of multimedia stories
title_sort Automated illustration of multimedia stories
author Delgado, Diogo Miguel Melo
author_facet Delgado, Diogo Miguel Melo
author_role author
dc.contributor.none.fl_str_mv Magalhães, João
Correia, Nuno
RUN
dc.contributor.author.fl_str_mv Delgado, Diogo Miguel Melo
dc.subject.por.fl_str_mv Story illustration
Text analysis
Informational retrieval
Image-text association
Vector space model
User feedback
topic Story illustration
Text analysis
Informational retrieval
Image-text association
Vector space model
User feedback
description Submitted in part fulfillment of the requirements for the degree of Master in Computer Science
publishDate 2010
dc.date.none.fl_str_mv 2010-12-13T19:22:50Z
2010
2010-01-01T00:00:00Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/masterThesis
format masterThesis
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://hdl.handle.net/10362/4478
url http://hdl.handle.net/10362/4478
dc.language.iso.fl_str_mv eng
language eng
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv Faculdade de Ciências e Tecnologia
publisher.none.fl_str_mv Faculdade de Ciências e Tecnologia
dc.source.none.fl_str_mv reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron:RCAAP
instname_str Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron_str RCAAP
institution RCAAP
reponame_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
collection Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository.name.fl_str_mv Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
repository.mail.fl_str_mv
_version_ 1799137808430923776

Registros relacionados