Nowadays, large amounts of unstructured data are available online. Such data often contain users’ emotions and feelings about a variety of topics but their retrieval and selection on the basis of an emotional perspective are usually unfeasible through traditional search engines, which only rank web content according to its relevance with respect to a given search keyword. For this reason, in the present work we introduce the architecture of a novel emotion-aware search engine that can return search results ranked on the basis of seven human emotions. Using this system, users can benefit from a more advanced semantic search that also takes into account emotions. The system uses emotion recognition algorithms based on deep learning to extract emotion vectors from texts, images and videos and then populates an emotional index to allow users to visualise results related to given emotions. We also discuss and evaluate different deep learning models for building emotional indexes from texts, images and videos.
An emotion-aware search engine for multimedia content based on deep learning algorithms / Chiorrini, Andrea; Diamantini, Claudia; Mircoli, Alex; Potena, Domenico; Storti, Emanuele. - In: INTERNATIONAL JOURNAL OF COMPUTER APPLICATIONS IN TECHNOLOGY. - ISSN 0952-8091. - 73:2(2023), pp. 130-139. [10.1504/IJCAT.2023.134757]
An emotion-aware search engine for multimedia content based on deep learning algorithms
Chiorrini, Andrea;Diamantini, Claudia;Mircoli, Alex
;Potena, Domenico;Storti, Emanuele
2023-01-01
Abstract
Nowadays, large amounts of unstructured data are available online. Such data often contain users’ emotions and feelings about a variety of topics but their retrieval and selection on the basis of an emotional perspective are usually unfeasible through traditional search engines, which only rank web content according to its relevance with respect to a given search keyword. For this reason, in the present work we introduce the architecture of a novel emotion-aware search engine that can return search results ranked on the basis of seven human emotions. Using this system, users can benefit from a more advanced semantic search that also takes into account emotions. The system uses emotion recognition algorithms based on deep learning to extract emotion vectors from texts, images and videos and then populates an emotional index to allow users to visualise results related to given emotions. We also discuss and evaluate different deep learning models for building emotional indexes from texts, images and videos.File | Dimensione | Formato | |
---|---|---|---|
IJCAT-4-Chiorrini et al.pdf
Solo gestori archivio
Tipologia:
Versione editoriale (versione pubblicata con il layout dell'editore)
Licenza d'uso:
Tutti i diritti riservati
Dimensione
519.52 kB
Formato
Adobe PDF
|
519.52 kB | Adobe PDF | Visualizza/Apri Richiedi una copia |
Emotion_aware_Multimedial_Query_Answering__Journal__Computer_Applications_in_Technology__.pdf
Open Access dal 10/11/2024
Descrizione: Copyright © 2023 Inderscience Enterprises Ltd
Tipologia:
Documento in post-print (versione successiva alla peer review e accettata per la pubblicazione)
Licenza d'uso:
Tutti i diritti riservati
Dimensione
1.59 MB
Formato
Adobe PDF
|
1.59 MB | Adobe PDF | Visualizza/Apri |
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.