"Multitask bottom-up framework for person and emotion detection" by Tristan Cladière
The Thursday, November 9, 2023
at 11:00 AM
Room L2019
Bâtiment Les Forges
11 rue du Docteur Rémy Annino
42000 Saint-Etienne
Seminar by Tristan Cladière
Abstract
Emotion recognition from images is a challenging task. The latest and most common approach to solve this problem is to fuse information from different contexts, such as person-centric features, scene features, object features, interactions features and so on. This requires specialized pre-trained models, and multiple pre-processing steps, resulting in long and complex frameworks, not always practicable in real time scenario with limited resources. Moreover, these methods do not deal with person detection, and treat each subject sequentially, which is even slower for scenes with many people. Therefore, we propose a new approach, based on a single end-to-end trainable architecture that can both detect and process all subjects simultaneously by creating emotion maps. We also introduce a new multitask training protocol which enhances the model predictions. Finally, we present a new baseline for emotion recognition on EMOTIC dataset, which considers the detection of the agents.
This seminar will be held in English.
Lien Cisco Webex : https://ujmstetienne.webex.com/meet/ImageSCV