From individual to group-level emotion recognition: EmotiW 5.0

Abhinav Dhall; Roland Goecke; Shreya Ghosh; Jyoti Joshi; Jesse Hoey; Tom Gedeon

doi:10.1145/3136755.3143004

From individual to group-level emotion recognition: EmotiW 5.0

Abhinav Dhall, Roland Goecke, Shreya Ghosh, Jyoti Joshi, Jesse Hoey, Tom Gedeon

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

175 Citations (Scopus)

Abstract

Research in automatic affect recognition has come a long way. This paper describes the fifth Emotion Recognition in the Wild (EmotiW) challenge 2017. EmotiW aims at providing a common benchmarking platform for researchers working on different aspects of affective computing. This year there are two sub-challenges: A) Audio-video emotion recognition and b) group-level emotion recognition. These challenges are based on the acted facial expressions in the wild and group affect databases, respectively. The particular focus of the challenge is to evaluate method in 'in the wild' settings. 'In the wild' here is used to describe the various environments represented in the images and videos, which represent real-world (not lab like) scenarios. The baseline, data, protocol of the two challenges and the challenge participation are discussed in detail in this paper.

Original language	English
Title of host publication	ICMI '17 - Proceedings of the 19th ACM International Conference on Multimodal Interaction
Editors	Edward Lank, Eve Hoggan, Sriram Subramanian, Alessandro Vinciarelli, Stephen A. Brewster
Place of Publication	New York, NY
Publisher	Association for Computing Machinery, Inc
Pages	524-528
Number of pages	5
ISBN (Electronic)	9781450355438
DOIs	https://doi.org/10.1145/3136755.3143004
Publication status	Published - 3 Nov 2017
Externally published	Yes
Event	19th ACM International Conference on Multimodal Interaction - Glasgow, United Kingdom Duration: 13 Nov 2017 → 17 Nov 2017 Conference number: 19th https://icmi.acm.org/2017/

Publication series

Name	Proceedings of the ACM International Conference on Multimodal Interaction
Number	19th
Volume	2017

Conference

Conference	19th ACM International Conference on Multimodal Interaction
Abbreviated title	ICMI '17
Country/Territory	United Kingdom
City	Glasgow
Period	13/11/17 → 17/11/17
Other	The 2017 International Conference on Multimodal Interaction, ICMI 2017, will be held in Glasgow, Scotland at the Hilton Grosvenor hotel. ICMI is the premier international forum for multidisciplinary research on multimodal human-human and human-computer interaction, interfaces, and system development. The conference focuses on theoretical and empirical foundations, component technologies, and combined multimodal processing techniques that define the field of multimodal interaction analysis, interface design, and system development. ICMI 2017 will feature a single-track main conference which includes: keynote speakers, technical full and short papers (including oral and poster presentations), special sessions, demonstrations, exhibits and doctoral spotlight papers. The conference will also feature workshops and grand challenges.
Internet address	https://icmi.acm.org/2017/

Keywords

Affect analysis in the wild
Audio-video data corpus
Emotion recognition
Facial expression challenge
Group-level emotion recognition

Access to Document

10.1145/3136755.3143004Licence: In Copyright

Cite this

Dhall, A., Goecke, R., Ghosh, S., Joshi, J., Hoey, J., & Gedeon, T. (2017). From individual to group-level emotion recognition: EmotiW 5.0. In E. Lank, E. Hoggan, S. Subramanian, A. Vinciarelli, & S. A. Brewster (Eds.), ICMI '17 - Proceedings of the 19th ACM International Conference on Multimodal Interaction (pp. 524-528). (Proceedings of the ACM International Conference on Multimodal Interaction; Vol. 2017, No. 19th). Association for Computing Machinery, Inc. https://doi.org/10.1145/3136755.3143004

Dhall, Abhinav ; Goecke, Roland ; Ghosh, Shreya et al. / From individual to group-level emotion recognition : EmotiW 5.0. ICMI '17 - Proceedings of the 19th ACM International Conference on Multimodal Interaction. editor / Edward Lank ; Eve Hoggan ; Sriram Subramanian ; Alessandro Vinciarelli ; Stephen A. Brewster. New York, NY : Association for Computing Machinery, Inc, 2017. pp. 524-528 (Proceedings of the ACM International Conference on Multimodal Interaction; 19th).

@inproceedings{f1720a96fcd24a4ab0d15f9d3d1c03c6,

title = "From individual to group-level emotion recognition: EmotiW 5.0",

abstract = "Research in automatic affect recognition has come a long way. This paper describes the fifth Emotion Recognition in the Wild (EmotiW) challenge 2017. EmotiW aims at providing a common benchmarking platform for researchers working on different aspects of affective computing. This year there are two sub-challenges: A) Audio-video emotion recognition and b) group-level emotion recognition. These challenges are based on the acted facial expressions in the wild and group affect databases, respectively. The particular focus of the challenge is to evaluate method in 'in the wild' settings. 'In the wild' here is used to describe the various environments represented in the images and videos, which represent real-world (not lab like) scenarios. The baseline, data, protocol of the two challenges and the challenge participation are discussed in detail in this paper.",

keywords = "Affect analysis in the wild, Audio-video data corpus, Emotion recognition, Facial expression challenge, Group-level emotion recognition",

author = "Abhinav Dhall and Roland Goecke and Shreya Ghosh and Jyoti Joshi and Jesse Hoey and Tom Gedeon",

year = "2017",

month = nov,

day = "3",

doi = "10.1145/3136755.3143004",

language = "English",

series = "Proceedings of the ACM International Conference on Multimodal Interaction",

publisher = "Association for Computing Machinery, Inc",

number = "19th",

pages = "524--528",

editor = "Edward Lank and Eve Hoggan and Sriram Subramanian and Alessandro Vinciarelli and Brewster, {Stephen A.}",

booktitle = "ICMI '17 - Proceedings of the 19th ACM International Conference on Multimodal Interaction",

note = "19th ACM International Conference on Multimodal Interaction, ICMI '17 ; Conference date: 13-11-2017 Through 17-11-2017",

url = "https://icmi.acm.org/2017/",

}

Dhall, A, Goecke, R, Ghosh, S, Joshi, J, Hoey, J & Gedeon, T 2017, From individual to group-level emotion recognition: EmotiW 5.0. in E Lank, E Hoggan, S Subramanian, A Vinciarelli & SA Brewster (eds), ICMI '17 - Proceedings of the 19th ACM International Conference on Multimodal Interaction. Proceedings of the ACM International Conference on Multimodal Interaction, no. 19th, vol. 2017, Association for Computing Machinery, Inc, New York, NY, pp. 524-528, 19th ACM International Conference on Multimodal Interaction, Glasgow, United Kingdom, 13/11/17. https://doi.org/10.1145/3136755.3143004

From individual to group-level emotion recognition: EmotiW 5.0. / Dhall, Abhinav; Goecke, Roland; Ghosh, Shreya et al.
ICMI '17 - Proceedings of the 19th ACM International Conference on Multimodal Interaction. ed. / Edward Lank; Eve Hoggan; Sriram Subramanian; Alessandro Vinciarelli; Stephen A. Brewster. New York, NY: Association for Computing Machinery, Inc, 2017. p. 524-528 (Proceedings of the ACM International Conference on Multimodal Interaction; Vol. 2017, No. 19th).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - From individual to group-level emotion recognition

T2 - 19th ACM International Conference on Multimodal Interaction

AU - Dhall, Abhinav

AU - Goecke, Roland

AU - Ghosh, Shreya

AU - Joshi, Jyoti

AU - Hoey, Jesse

AU - Gedeon, Tom

N1 - Conference code: 19th

PY - 2017/11/3

Y1 - 2017/11/3

N2 - Research in automatic affect recognition has come a long way. This paper describes the fifth Emotion Recognition in the Wild (EmotiW) challenge 2017. EmotiW aims at providing a common benchmarking platform for researchers working on different aspects of affective computing. This year there are two sub-challenges: A) Audio-video emotion recognition and b) group-level emotion recognition. These challenges are based on the acted facial expressions in the wild and group affect databases, respectively. The particular focus of the challenge is to evaluate method in 'in the wild' settings. 'In the wild' here is used to describe the various environments represented in the images and videos, which represent real-world (not lab like) scenarios. The baseline, data, protocol of the two challenges and the challenge participation are discussed in detail in this paper.

AB - Research in automatic affect recognition has come a long way. This paper describes the fifth Emotion Recognition in the Wild (EmotiW) challenge 2017. EmotiW aims at providing a common benchmarking platform for researchers working on different aspects of affective computing. This year there are two sub-challenges: A) Audio-video emotion recognition and b) group-level emotion recognition. These challenges are based on the acted facial expressions in the wild and group affect databases, respectively. The particular focus of the challenge is to evaluate method in 'in the wild' settings. 'In the wild' here is used to describe the various environments represented in the images and videos, which represent real-world (not lab like) scenarios. The baseline, data, protocol of the two challenges and the challenge participation are discussed in detail in this paper.

KW - Affect analysis in the wild

KW - Audio-video data corpus

KW - Emotion recognition

KW - Facial expression challenge

KW - Group-level emotion recognition

UR - https://dl.acm.org/action/showFmPdf?doi=10.1145%2F3136755

UR - https://icmi.acm.org/2017/index.php?id=proceedings

UR - https://dl.acm.org/doi/proceedings/10.1145/3136755

UR - http://www.scopus.com/inward/record.url?scp=85046536088&partnerID=8YFLogxK

U2 - 10.1145/3136755.3143004

DO - 10.1145/3136755.3143004

M3 - Conference contribution

AN - SCOPUS:85046536088

T3 - Proceedings of the ACM International Conference on Multimodal Interaction

SP - 524

EP - 528

BT - ICMI '17 - Proceedings of the 19th ACM International Conference on Multimodal Interaction

A2 - Lank, Edward

A2 - Hoggan, Eve

A2 - Subramanian, Sriram

A2 - Vinciarelli, Alessandro

A2 - Brewster, Stephen A.

PB - Association for Computing Machinery, Inc

CY - New York, NY

Y2 - 13 November 2017 through 17 November 2017

ER -

Dhall A, Goecke R, Ghosh S, Joshi J, Hoey J, Gedeon T. From individual to group-level emotion recognition: EmotiW 5.0. In Lank E, Hoggan E, Subramanian S, Vinciarelli A, Brewster SA, editors, ICMI '17 - Proceedings of the 19th ACM International Conference on Multimodal Interaction. New York, NY: Association for Computing Machinery, Inc. 2017. p. 524-528. (Proceedings of the ACM International Conference on Multimodal Interaction; 19th). doi: 10.1145/3136755.3143004

From individual to group-level emotion recognition: EmotiW 5.0

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this