Graph-based Group Modelling for Backchannel Detection

Garima Sharma, Kalin Stefanov, Abhinav Dhall, Jianfei Cai

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

5 Citations (Scopus)

Abstract

The brief responses given by listeners in group conversations are known as backchannels rendering the task of backchannel detection an essential facet of group interaction analysis. Most of the current backchannel detection studies explore various audio-visual cues for individuals. However, analysing all group members is of utmost importance for backchannel detection, like any group interaction. This study uses a graph neural network to model group interaction through all members' implicit and explicit behaviours. The proposed method achieves the best and second best performance on agreement estimation and backchannel detection tasks, respectively, of the 2022 MultiMediate: Multi-modal Group Behaviour Analysis for Artificial Mediation challenge.

Original languageEnglish
Title of host publicationMM 2022 - Proceedings of the 30th ACM International Conference on Multimedia
Place of PublicationNew York, NY
PublisherAssociation for Computing Machinery, Inc
Pages7190-7194
Number of pages5
ISBN (Electronic)9781450392037
DOIs
Publication statusPublished - 10 Oct 2022
Externally publishedYes
Event30th ACM International Conference on Multimedia, MM 2022 - Lisboa, Portugal
Duration: 10 Oct 202214 Oct 2022
Conference number: MM '22
https://dl.acm.org/doi/proceedings/10.1145/3503161

Publication series

NameProceedings of the ACM International Conference on Multimedia
PublisherAssociation for Computing Machinery
Volume2022

Conference

Conference30th ACM International Conference on Multimedia, MM 2022
Country/TerritoryPortugal
CityLisboa
Period10/10/2214/10/22
OtherWe are delighted to welcome you to Lisbon, Portugal for ACM Multimedia 2022, the 30th ACM International Conference on Multimedia. ACM Multimedia is the premier international conference series in the area of multimedia within the field of computer science. Since 1993, ACM Multimedia has been bringing together worldwide researchers and practitioners from academia and industry to present their innovative research and to discuss recent advancements in multimedia.

This year's conference, for the first time since the start of COVID 19 pandemic, will return to the usual format in a time when travel restrictions no longer prevent researchers from attending the conference. We are excited to return to the warm face-to-face gatherings where we will all have the opportunity to meet our colleagues and friends. While priority will be given to physical attendees, remote attendees will also have the opportunity to enjoy live question-answering sessions, and presentations from the authors via pre-recorded videos. Videos of all papers can be accessed online before the start of main conference events, and will be later available through ACM Digital Library.
Internet address

Keywords

  • agreement estimation
  • backchannel detection
  • graph neural networks

Fingerprint

Dive into the research topics of 'Graph-based Group Modelling for Backchannel Detection'. Together they form a unique fingerprint.

Cite this