Expression empowered residen network for facial action unit detection

Shreyank Jyoti; Garima Sharma; Abhinav Dhall

doi:10.1109/FG.2019.8756580

Expression empowered residen network for facial action unit detection

Shreyank Jyoti, Garima Sharma, Abhinav Dhall

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

22 Citations (Scopus)

Abstract

The paper explores the topic of Facial Action Unit (FAU) detection in the wild. In particular, we are interested in answering the following questions: (1) How useful are residual connections across dense blocks for face analysis? (2) How useful is the information from a network trained for categorical Facial Expression Recognition (FER) for the task of FAU detection? The proposed network (ResiDen) exploits dense blocks along with residual connections and uses auxiliary information from a FER network. The experiments are performed on the EmotionNet and DISFA datasets. The experiments show the usefulness of facial expression information for AU detection. The proposed network achieves state-of-the-art results on the two datasets. Analysis of the results for cross dataset protocol shows the effectiveness of the network.

Original language	English
Title of host publication	Proceedings - 14th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2019
Publisher	Institute of Electrical and Electronics Engineers
Pages	262-269
Number of pages	8
ISBN (Electronic)	9781728100890
DOIs	https://doi.org/10.1109/FG.2019.8756580
Publication status	Published - May 2019
Externally published	Yes
Event	14th IEEE International Conference on Automatic Face and Gesture Recognition - Lille, France Duration: 14 May 2019 → 18 May 2019 Conference number: 14th

Publication series

Name	Proceedings - IEEE International Conference on Automatic Face and Gesture Recognition
Publisher	Institute of Electrical and Electronics Engineers
Number	14th
Volume	2019

Conference

Conference	14th IEEE International Conference on Automatic Face and Gesture Recognition
Abbreviated title	FG 2019
Country/Territory	France
City	Lille
Period	14/05/19 → 18/05/19

Access to Document

10.1109/FG.2019.8756580Licence: In Copyright

Cite this

Jyoti, S., Sharma, G., & Dhall, A. (2019). Expression empowered residen network for facial action unit detection. In Proceedings - 14th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2019 (pp. 262-269). Article 8756580 (Proceedings - IEEE International Conference on Automatic Face and Gesture Recognition; Vol. 2019, No. 14th). Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/FG.2019.8756580

Jyoti, Shreyank ; Sharma, Garima ; Dhall, Abhinav. / Expression empowered residen network for facial action unit detection. Proceedings - 14th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2019. Institute of Electrical and Electronics Engineers, 2019. pp. 262-269 (Proceedings - IEEE International Conference on Automatic Face and Gesture Recognition; 14th).

@inproceedings{c7ffa4b754ae4f86aa74b22130e13817,

title = "Expression empowered residen network for facial action unit detection",

abstract = "The paper explores the topic of Facial Action Unit (FAU) detection in the wild. In particular, we are interested in answering the following questions: (1) How useful are residual connections across dense blocks for face analysis? (2) How useful is the information from a network trained for categorical Facial Expression Recognition (FER) for the task of FAU detection? The proposed network (ResiDen) exploits dense blocks along with residual connections and uses auxiliary information from a FER network. The experiments are performed on the EmotionNet and DISFA datasets. The experiments show the usefulness of facial expression information for AU detection. The proposed network achieves state-of-the-art results on the two datasets. Analysis of the results for cross dataset protocol shows the effectiveness of the network.",

author = "Shreyank Jyoti and Garima Sharma and Abhinav Dhall",

year = "2019",

month = may,

doi = "10.1109/FG.2019.8756580",

language = "English",

series = "Proceedings - IEEE International Conference on Automatic Face and Gesture Recognition",

publisher = "Institute of Electrical and Electronics Engineers",

number = "14th",

pages = "262--269",

booktitle = "Proceedings - 14th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2019",

address = "United States",

note = "14th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2019 ; Conference date: 14-05-2019 Through 18-05-2019",

}

Jyoti, S, Sharma, G & Dhall, A 2019, Expression empowered residen network for facial action unit detection. in Proceedings - 14th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2019., 8756580, Proceedings - IEEE International Conference on Automatic Face and Gesture Recognition, no. 14th, vol. 2019, Institute of Electrical and Electronics Engineers, pp. 262-269, 14th IEEE International Conference on Automatic Face and Gesture Recognition, Lille, France, 14/05/19. https://doi.org/10.1109/FG.2019.8756580

Expression empowered residen network for facial action unit detection. / Jyoti, Shreyank; Sharma, Garima; Dhall, Abhinav.
Proceedings - 14th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2019. Institute of Electrical and Electronics Engineers, 2019. p. 262-269 8756580 (Proceedings - IEEE International Conference on Automatic Face and Gesture Recognition; Vol. 2019, No. 14th).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Expression empowered residen network for facial action unit detection

AU - Jyoti, Shreyank

AU - Sharma, Garima

AU - Dhall, Abhinav

N1 - Conference code: 14th

PY - 2019/5

Y1 - 2019/5

N2 - The paper explores the topic of Facial Action Unit (FAU) detection in the wild. In particular, we are interested in answering the following questions: (1) How useful are residual connections across dense blocks for face analysis? (2) How useful is the information from a network trained for categorical Facial Expression Recognition (FER) for the task of FAU detection? The proposed network (ResiDen) exploits dense blocks along with residual connections and uses auxiliary information from a FER network. The experiments are performed on the EmotionNet and DISFA datasets. The experiments show the usefulness of facial expression information for AU detection. The proposed network achieves state-of-the-art results on the two datasets. Analysis of the results for cross dataset protocol shows the effectiveness of the network.

AB - The paper explores the topic of Facial Action Unit (FAU) detection in the wild. In particular, we are interested in answering the following questions: (1) How useful are residual connections across dense blocks for face analysis? (2) How useful is the information from a network trained for categorical Facial Expression Recognition (FER) for the task of FAU detection? The proposed network (ResiDen) exploits dense blocks along with residual connections and uses auxiliary information from a FER network. The experiments are performed on the EmotionNet and DISFA datasets. The experiments show the usefulness of facial expression information for AU detection. The proposed network achieves state-of-the-art results on the two datasets. Analysis of the results for cross dataset protocol shows the effectiveness of the network.

UR - http://www.scopus.com/inward/record.url?scp=85070465136&partnerID=8YFLogxK

U2 - 10.1109/FG.2019.8756580

DO - 10.1109/FG.2019.8756580

M3 - Conference contribution

AN - SCOPUS:85070465136

T3 - Proceedings - IEEE International Conference on Automatic Face and Gesture Recognition

SP - 262

EP - 269

BT - Proceedings - 14th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2019

PB - Institute of Electrical and Electronics Engineers

T2 - 14th IEEE International Conference on Automatic Face and Gesture Recognition

Y2 - 14 May 2019 through 18 May 2019

ER -

Jyoti S, Sharma G, Dhall A. Expression empowered residen network for facial action unit detection. In Proceedings - 14th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2019. Institute of Electrical and Electronics Engineers. 2019. p. 262-269. 8756580. (Proceedings - IEEE International Conference on Automatic Face and Gesture Recognition; 14th). doi: 10.1109/FG.2019.8756580

Expression empowered residen network for facial action unit detection

Abstract

Publication series

Conference

Access to Document

Other files and links

Fingerprint

Cite this