RT Journal Article
SR Electronic
T1 Automatic recognition of macaque facial expressions for detection of affective states
JF eneuro
JO eNeuro
FD Society for Neuroscience
SP ENEURO.0117-21.2021
DO 10.1523/ENEURO.0117-21.2021
A1 Anna Morozov
A1 Lisa Parr
A1 Katalin Gothard
A1 Rony Paz
A1 Raviv Pryluk
YR 2021
UL http://www.eneuro.org/content/early/2021/11/17/ENEURO.0117-21.2021.abstract
AB Internal affective states produce external manifestations such as facial expressions. In humans, the Facial Action Coding System (FACS) is widely used to objectively quantify the elemental facial action-units (AUs) that build complex facial expressions. A similar system has been developed for macaque monkeys - the Macaque Facial Action Coding System (MaqFACS); yet unlike the human counterpart, which is already partially replaced by automatic algorithms, this system still requires labor-intensive coding. Here, we developed and implemented the first prototype for automatic MaqFACS coding. We applied the approach to the analysis of behavioral and neural data recorded from freely interacting macaque monkeys. The method achieved high performance in recognition of six dominant AUs, generalizing between conspecific individuals (Macaca mulatta) and even between species (Macaca fascicularis). The study lays the foundation for fully automated detection of facial expressions in animals, which is crucial for investigating the neural substrates of social and affective states.Significance StatementMaqFACS is a comprehensive coding system designed to objectively classify facial expressions based on elemental facial movements designated as Actions Units (AUs). It allows the comparison of facial expressions across individuals of same or different species based on manual scoring of videos, a labor- and time-consuming process. We implemented the first automatic prototype for AUs coding in macaques. Using machine learning, we trained the algorithm on video-frames with AU labels, and showed that after parameter tuning, it classified six AUs in new individuals. Our method demonstrates concurrent validity with manual MaqFACS coding and supports the usage of automated MaqFACS. Such automatic coding is useful not only for social- and affective- neuroscience research but also for monitoring animal health and welfare.