Fusing Acoustic Feature Representations for Computational Paralinguistics Tasks

Loading...
Thumbnail Image

Date

2016

Journal Title

Journal ISSN

Volume Title

Publisher

Isca-Int Speech Communication Assoc

Access Rights

info:eu-repo/semantics/closedAccess

Abstract

The field of Computational Paralinguistics is rapidly growing and is of interest in various application domains ranging from biomedical engineering to forensics. The INTERSPEECH ComParE challenge series has a field-leading role, introducing novel problems with a common benchmark protocol for comparability. In this work, we tackle all three ComParE 2016 Challenge corpora (Native Language, Sincerity and Deception) benefiting from multi-level normalization on features followed by fast and robust kernel learning methods. Moreover, we employ computer vision inspired low level descriptor representation methods such as the Fisher vector encoding. After nonlinear preprocessing, obtained Fisher vectors are kernelized and mapped to target variables by classifiers based on Kernel Extreme Learning Machines and Partial Least Squares regression. We finally combine predictions of models trained on popularly used functional based descriptor encoding (openSMILE features) with those obtained from the Fisher vector encoding. In the preliminary experiments, our approach has significantly outperformed the baseline systems for Native Language and Sincerity sub-challenges both in the development and test sets.

Description

17th Annual Conference of the International-Speech-Communication-Association (INTERSPEECH 2016) -- SEP 08-12, 2016 -- San Francisco, CA

Keywords

ComParE, computational paralinguistics, Native Language, Sincerity, Fisher vector, PLS, ELM, Extreme Learning-Machine, Emotion

Journal or Series

17th Annual Conference of the International Speech Communication Association (Interspeech 2016), Vols 1-5: Understanding Speech Processing in Humans and Machines

WoS Q Value

N/A

Scopus Q Value

N/A

Volume

Issue

Citation