A crowdsourcing approach to labelling a mood induced speech corpora: 4th International Workshop on Corpora for Research on Emotion Sentiment & Social Signals (ES³ 2012)

John Snel, Alexey Tarasov, Charlie Cullen, Sarah-Jane Delany

Research output: Contribution to conferencePaper

Abstract

This paper demonstrates the use of crowdsourcing to accumulate ratings from nave listeners as a means to provide labels for a naturalistic emotional speech dataset. In order to do so, listening tasks are performed with a rating tool, which is delivered via the web. The rating requirements are based on the classical dimensions, activation and evaluation, presented to the participant as two discretised 5-point scales. Great emphasis is placed on the participant's overall understanding of the task, and on the ease-of-use of the tool so that labelling accuracy is reinforced. The accumulation process is ongoing with a goal to supply the research community with a publicly available speech corpus.
Original languageEnglish
Publication statusPublished - 1 May 2012
Externally publishedYes
Event(ES³ 2012) 4th International Workshop on Corpora for Research on Emotion Sentiment & Social Signals - Istanbul, Turkey
Duration: 26 May 201226 May 2012

Workshop

Workshop(ES³ 2012) 4th International Workshop on Corpora for Research on Emotion Sentiment & Social Signals
CountryTurkey
CityIstanbul
Period26/05/1226/05/12

Fingerprint

Labeling
Labels
Chemical activation

Cite this

Snel, J., Tarasov, A., Cullen, C., & Delany, S-J. (2012). A crowdsourcing approach to labelling a mood induced speech corpora: 4th International Workshop on Corpora for Research on Emotion Sentiment & Social Signals (ES³ 2012). Paper presented at (ES³ 2012) 4th International Workshop on Corpora for Research on Emotion Sentiment & Social Signals , Istanbul, Turkey.
Snel, John ; Tarasov, Alexey ; Cullen, Charlie ; Delany, Sarah-Jane. / A crowdsourcing approach to labelling a mood induced speech corpora : 4th International Workshop on Corpora for Research on Emotion Sentiment & Social Signals (ES³ 2012). Paper presented at (ES³ 2012) 4th International Workshop on Corpora for Research on Emotion Sentiment & Social Signals , Istanbul, Turkey.
@conference{a7de2871f88a40089d8ae3edc594c4c7,
title = "A crowdsourcing approach to labelling a mood induced speech corpora: 4th International Workshop on Corpora for Research on Emotion Sentiment & Social Signals (ES³ 2012)",
abstract = "This paper demonstrates the use of crowdsourcing to accumulate ratings from nave listeners as a means to provide labels for a naturalistic emotional speech dataset. In order to do so, listening tasks are performed with a rating tool, which is delivered via the web. The rating requirements are based on the classical dimensions, activation and evaluation, presented to the participant as two discretised 5-point scales. Great emphasis is placed on the participant's overall understanding of the task, and on the ease-of-use of the tool so that labelling accuracy is reinforced. The accumulation process is ongoing with a goal to supply the research community with a publicly available speech corpus.",
author = "John Snel and Alexey Tarasov and Charlie Cullen and Sarah-Jane Delany",
year = "2012",
month = "5",
day = "1",
language = "English",
note = "(ES³ 2012) 4th International Workshop on Corpora for Research on Emotion Sentiment & Social Signals ; Conference date: 26-05-2012 Through 26-05-2012",

}

Snel, J, Tarasov, A, Cullen, C & Delany, S-J 2012, 'A crowdsourcing approach to labelling a mood induced speech corpora: 4th International Workshop on Corpora for Research on Emotion Sentiment & Social Signals (ES³ 2012)' Paper presented at (ES³ 2012) 4th International Workshop on Corpora for Research on Emotion Sentiment & Social Signals , Istanbul, Turkey, 26/05/12 - 26/05/12, .

A crowdsourcing approach to labelling a mood induced speech corpora : 4th International Workshop on Corpora for Research on Emotion Sentiment & Social Signals (ES³ 2012). / Snel, John; Tarasov, Alexey; Cullen, Charlie; Delany, Sarah-Jane.

2012. Paper presented at (ES³ 2012) 4th International Workshop on Corpora for Research on Emotion Sentiment & Social Signals , Istanbul, Turkey.

Research output: Contribution to conferencePaper

TY - CONF

T1 - A crowdsourcing approach to labelling a mood induced speech corpora

T2 - 4th International Workshop on Corpora for Research on Emotion Sentiment & Social Signals (ES³ 2012)

AU - Snel, John

AU - Tarasov, Alexey

AU - Cullen, Charlie

AU - Delany, Sarah-Jane

PY - 2012/5/1

Y1 - 2012/5/1

N2 - This paper demonstrates the use of crowdsourcing to accumulate ratings from nave listeners as a means to provide labels for a naturalistic emotional speech dataset. In order to do so, listening tasks are performed with a rating tool, which is delivered via the web. The rating requirements are based on the classical dimensions, activation and evaluation, presented to the participant as two discretised 5-point scales. Great emphasis is placed on the participant's overall understanding of the task, and on the ease-of-use of the tool so that labelling accuracy is reinforced. The accumulation process is ongoing with a goal to supply the research community with a publicly available speech corpus.

AB - This paper demonstrates the use of crowdsourcing to accumulate ratings from nave listeners as a means to provide labels for a naturalistic emotional speech dataset. In order to do so, listening tasks are performed with a rating tool, which is delivered via the web. The rating requirements are based on the classical dimensions, activation and evaluation, presented to the participant as two discretised 5-point scales. Great emphasis is placed on the participant's overall understanding of the task, and on the ease-of-use of the tool so that labelling accuracy is reinforced. The accumulation process is ongoing with a goal to supply the research community with a publicly available speech corpus.

UR - http://emotion-research.net/sigs/speech-sig/es12

M3 - Paper

ER -

Snel J, Tarasov A, Cullen C, Delany S-J. A crowdsourcing approach to labelling a mood induced speech corpora: 4th International Workshop on Corpora for Research on Emotion Sentiment & Social Signals (ES³ 2012). 2012. Paper presented at (ES³ 2012) 4th International Workshop on Corpora for Research on Emotion Sentiment & Social Signals , Istanbul, Turkey.