­
­
­
­

Inventi Impact - Audio, Speech & Music Processing

Articles

  • Inventi:easm/57/14
    IMPROVEMENT OF MULTIMODAL GESTURE AND SPEECH RECOGNITION PERFORMANCE USING TIME INTERVALS BETWEEN GESTURES AND ACCOMPANYING SPEECH
    Madoka Miki, Norihide Kitaoka, Chiyomi Miyajima, Takanori Nishino, Kazuya Takeda

    We propose an integrative method of recognizing gestures such as pointing, accompanying speech. Speech generated simultaneously with gestures can assist in the recognition of gestures, and since this occurs in a complementary manner, gestures can also assist in the recognition of speech. Our integrative recognition method uses a probability distribution which expresses the distribution of the time interval between the starting times of gestures and of the corresponding utterances. We evaluate the rate of improvement of the proposed integrative recognition method with a task involving the solution of a geometry problem.

    How to Cite this Article
    CC Compliant Citation: Miki et al.: Improvement of multimodal gesture and speech recognition performance using time intervals between gestures and accompanying speech. EURASIP Journal on Audio, Speech, and Music Processing 2014 2014:2, doi:10.1186/1687-4722-2014-2. © 2014 Miki et al.; licensee Springer. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
    Download Full Text