Movie Emotion Estimation with Multimodal Fusion and Synthetic Data Generation
dc.authorid | 0000-0001-6342-428X | |
dc.authorscopusid | 57197808186 | |
dc.authorscopusid | 36241785000 | |
dc.authorscopusid | 7006556254 | |
dc.authorwosid | Salah, Albert Ali/ABH-5561-2020 | |
dc.contributor.author | Karslıoğlu, Nihan | |
dc.contributor.author | Kaya, Heysem | |
dc.contributor.author | Salah, Albert Ali | |
dc.date.accessioned | 2022-05-11T14:15:55Z | |
dc.date.available | 2022-05-11T14:15:55Z | |
dc.date.issued | 2019 | |
dc.department | Fakülteler, Çorlu Mühendislik Fakültesi, Bilgisayar Mühendisliği Bölümü | |
dc.description | 27th Signal Processing and Communications Applications Conference (SIU) -- APR 24-26, 2019 -- Sivas Cumhuriyet Univ, Sivas, TURKEY | |
dc.description.abstract | In this work, we propose a method for automatic emotion recognition from movie clips. This problem has applications in indexing and retrieval of large movie and video collections, summarization of visual content, selection of emotion-invoking materials, and such. Our approach aims to estimate valence and arousal values automatically. We extract audio and visual features, summarize them via functionals, PCA, and Fisher vector encoding approaches. We used feature selection based on canonical correlation analysis. For classification, we used extreme learning machine and support vector machine. We tested our approach on the LIRIS-ACCEDE database with ground truth annotations. The class imbalance problem was solved by generating synthetic data. By fusing the best features at score and feature level, we obtain good results on this problem, especially for the valence prediction. | |
dc.description.sponsorship | IEEE Turkey Sect, Turkcell, Turkhavacilik Uzaysanayii, Turitak Bilgem, Gebze Teknik Univ, SAP, Detaysoft, NETAS, Havelsan | |
dc.identifier.isbn | 978-1-7281-1904-5 | |
dc.identifier.issn | 2165-0608 | |
dc.identifier.scopus | 2-s2.0-85071983371 | |
dc.identifier.scopusquality | N/A | |
dc.identifier.uri | https://hdl.handle.net/20.500.11776/6121 | |
dc.identifier.wos | WOS:000518994300126 | |
dc.identifier.wosquality | N/A | |
dc.indekslendigikaynak | Web of Science | |
dc.indekslendigikaynak | Scopus | |
dc.institutionauthor | Kaya, Heysem | |
dc.language.iso | tr | |
dc.publisher | IEEE | |
dc.relation.ispartof | 2019 27th Signal Processing and Communications Applications Conference (Siu) | |
dc.relation.publicationcategory | Konferans Öğesi - Uluslararası - Kurum Öğretim Elemanı | en_US |
dc.rights | info:eu-repo/semantics/closedAccess | |
dc.subject | Movie analysis | |
dc.subject | affective computing | |
dc.subject | multimodal fusion | |
dc.subject | Representation | |
dc.title | Movie Emotion Estimation with Multimodal Fusion and Synthetic Data Generation | |
dc.title.alternative | Filmlerde Otomatik Duygu Analizi için Sentetik Veri Üretimi ve Çokkipli Birleştirme] | |
dc.type | Conference Object |
Dosyalar
Orijinal paket
1 - 1 / 1
Küçük Resim Yok
- İsim:
- 6121.pdf
- Boyut:
- 181.35 KB
- Biçim:
- Adobe Portable Document Format
- Açıklama:
- Tam Metin / Full Text