Tasks

The following tasks have been featured in the Interspeech Computational Paralinguistics Challenge (ComParE) up to 2018 (including the editions prior to 2013 which have been run under individual names).

For the tasks of 2019, please see under http://www.compare.openaudio.eu/compare2019/.

The tasks are listed in temporal order of appearance in the series since 2009 (bottom) to the latest ones (top).

# Classes: Either the number of classes for classification is given (“x” indicates that there have been multiple classification tasks), or an interval range in case of continuous tasks for regression.

In the right-most column, the final result by choosing the optimal number of participant-contributions at the end of each year’s Challenge is given. Note that in the meanwhile, higher results have often occurred in the literature. However, as after the end of each Challenge the test labels are often available to participants, we do not follow up on these.

%UA: Percentage of Unweighted Accuracy (also named Unweighted Average Recall). As most paralinguistic real-world problems are marked by high class-imbalance, this competition measure divides the sum of recall (class-wise accuracy) and divides by the number of classes. Hence, for a two-class problem, chance level resembles 50% UA, for a three-class problem 33% UA, etc.

AUC: (Unweighted Average) Area under (Receiver Operating Characteristic) Curve. This measure is chosen for detection tasks.

CC: Correlation Coefficient. This measure is used in case of continuous modelling.

Task# Classes%UA/*AUC/+CC
Affect: Atypical445.0
Affect: Self-Assessed368.4
Crying378.6
Heart Beats356.2
Addressee270.2
Cold271.0
Snoring458.5
Deception272.1
Sincerity[0,1]65.4+
Native Language1182.2
Nativeness[0,1]43.3+
Parkinson’s[0,100]54.0+
Eating Condition762.7
Cognitive Load361.6
Physical Load271.9
Social Signals2×292.7*
Conflict285.9
Emotion1246.1
Autism469.4
Personality5×270.4 
Likability268.7
Intelligibility of H&N Cancer Patients276.8
Intoxication272.2
Sleepiness 272.5
Age453.6
Gender 385.7
Interest[-1,1]42.8+
Emotion544.0
Negativity271.2