Nowadays, large amounts of unstructured data are available online. Such data often contain users’ emotions and feelings about a variety of topics but their retrieval and selection on the basis of an emotional perspective are usually unfeasible through traditional search engines, which only rank web content according to its relevance with respect to a given search keyword. For this reason, in the present work we introduce the architecture of a novel emotion-aware search engine that can return search results ranked on the basis of seven human emotions. Using this system, users can benefit from a more advanced semantic search that also takes into account emotions. The system uses emotion recognition algorithms based on deep learning to extract emotion vectors from texts, images and videos and then populates an emotional index to allow users to visualise results related to given emotions. We also discuss and evaluate different deep learning models for building emotional indexes from texts, images and videos.

An emotion-aware search engine for multimedia content based on deep learning algorithms / Chiorrini, Andrea; Diamantini, Claudia; Mircoli, Alex; Potena, Domenico; Storti, Emanuele. - In: INTERNATIONAL JOURNAL OF COMPUTER APPLICATIONS IN TECHNOLOGY. - ISSN 0952-8091. - 73:2(2023), pp. 130-139. [10.1504/IJCAT.2023.134757]

An emotion-aware search engine for multimedia content based on deep learning algorithms

Chiorrini, Andrea;Diamantini, Claudia;Mircoli, Alex
;
Potena, Domenico;Storti, Emanuele
2023-01-01

Abstract

Nowadays, large amounts of unstructured data are available online. Such data often contain users’ emotions and feelings about a variety of topics but their retrieval and selection on the basis of an emotional perspective are usually unfeasible through traditional search engines, which only rank web content according to its relevance with respect to a given search keyword. For this reason, in the present work we introduce the architecture of a novel emotion-aware search engine that can return search results ranked on the basis of seven human emotions. Using this system, users can benefit from a more advanced semantic search that also takes into account emotions. The system uses emotion recognition algorithms based on deep learning to extract emotion vectors from texts, images and videos and then populates an emotional index to allow users to visualise results related to given emotions. We also discuss and evaluate different deep learning models for building emotional indexes from texts, images and videos.
File in questo prodotto:
File Dimensione Formato  
IJCAT-4-Chiorrini et al.pdf

Solo gestori archivio

Tipologia: Versione editoriale (versione pubblicata con il layout dell'editore)
Licenza d'uso: Tutti i diritti riservati
Dimensione 519.52 kB
Formato Adobe PDF
519.52 kB Adobe PDF   Visualizza/Apri   Richiedi una copia
Emotion_aware_Multimedial_Query_Answering__Journal__Computer_Applications_in_Technology__.pdf

Open Access dal 10/11/2024

Descrizione: Copyright © 2023 Inderscience Enterprises Ltd
Tipologia: Documento in post-print (versione successiva alla peer review e accettata per la pubblicazione)
Licenza d'uso: Tutti i diritti riservati
Dimensione 1.59 MB
Formato Adobe PDF
1.59 MB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11566/324932
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? 0
social impact