This paper demonstrates the use of crowdsourcing to accumulate ratings from nave listeners as a means to provide labels for a naturalistic emotional speech dataset. In order to do so, listening tasks are performed with a rating tool, which is delivered via the web. The rating requirements are based on the classical dimensions, activation and evaluation, presented to the participant as two discretised 5-point scales. Great emphasis is placed on the participant's overall understanding of the task, and on the ease-of-use of the tool so that labelling accuracy is reinforced. The accumulation process is ongoing with a goal to supply the research community with a publicly available speech corpus.
|Publication status||Published - 1 May 2012|
|Event||(ES³ 2012) 4th International Workshop on Corpora for Research on Emotion Sentiment & Social Signals - Istanbul, Turkey|
Duration: 26 May 2012 → 26 May 2012
|Workshop||(ES³ 2012) 4th International Workshop on Corpora for Research on Emotion Sentiment & Social Signals|
|Period||26/05/12 → 26/05/12|
Snel, J., Tarasov, A., Cullen, C., & Delany, S-J. (2012). A crowdsourcing approach to labelling a mood induced speech corpora: 4th International Workshop on Corpora for Research on Emotion Sentiment & Social Signals (ES³ 2012). Paper presented at (ES³ 2012) 4th International Workshop on Corpora for Research on Emotion Sentiment & Social Signals , Istanbul, Turkey. https://www.google.co.uk/url?sa=t&rct=j&q=&esrc=s&source=web&cd=1&cad=rja&uact=8&ved=0ahUKEwi-vvL1rtLXAhUM6KQKHQAOAScQFggmMAA&url=http%3A%2F%2Farrow.dit.ie%2Fcgi%2Fviewcontent.cgi%3Farticle%3D1098%26context%3Ddmccon&usg=AOvVaw1MQKD-Gvoj-ufKaPoQbiEf