A facial action unit detection algorithm combining expert prior knowledge and motion correlation
Journal Title: Journal of Air Force Medical University - Year 2023, Vol 44, Issue 10
Abstract
Objective Facial action unit (AU) provides support for tasks such as expression recognition, micro-expression analysis, stress detection, fatigue detection, and lie detection. The purpose of this paper is to develop a stable and accurate facial AU detection algorithm based on integrating expert prior knowledge of face regions and AU relationships. Methods First, the key points of faces were used to divide each region of face images according to the expert prior knowledge of face regions, and the high-dimensional features of face images in each region were extracted with convolutional neural network. Then, the encoder in Transformer model was used to model the AU relationships and encode the high-dimensional features of faces in each region. Finally, an AU classifier was constructed using the fully connected layer. To tackle the problems of category imbalance and positive-negative sample imbalance in the dataset, a weighted differentiable F1 loss was incorporated into the loss function to constrain the AU detection model. Results In this paper, 3-fold cross-validation experiments were conducted on BP4D and DISFA datasets, and their average F1 scores for AU detection reached 63. 8% and 61. 8% , respectively. Conclusion The experimental results show that compared with the existing mainstream AU detection algorithms, the proposed algorithm has higher stability and detection accuracy on different datasets. The algorithm can accurately detect the facial AU, thus providing effective support for other tasks such as facial expression analysis.
Authors and Affiliations
LI Kui, MO Jianhua, WANG Jiajun
Keywords
Related Articles
- EP ID EP723840
- DOI -
- Views 24
- Downloads 0
Correlation between refractive status and ocular biological parameters among students of grade three in teenagers aviation schools of Air Force
Objective To analyze the correlation between refractive status and ocular biological parameters among students of grade three in teenagers aviation schools of Air Force, and to explore the key monitoring indicators for...
Correlation between ApoE gene polymorphism, Hcy and coronary heart disease in T2DM patients
Objective To analyze the correlation between apolipoprotein E (ApoE) gene polymorphism, homocysteine (Hcy) level and coronary heart disease ( CHD) in type 2 diabetes mellitus ( T2DM) patients. Methods A total of 134 T2...
Study on the relationship between ribosome-binding protein 1 and prognosis of epithelial ovarian cancer
Objective To study the expression of ribosome-binding protein 1 (RRBP1) in epithelial ovarian cancer (EOC) and its relationship with clinical features and prognosis. Methods Tumor tissue specimens of 106 EOC patients w...
Distribution of presynaptic neurons of noradrenergic neurons projecting to the spinal dorsal horn in the locus coeruleus of mice
Objective To explore the distribution of presynaptic neurons of noradrenergic neurons in the locus coeruleus (LC) projecting to the spinal dorsal horn (SDH) in the whole brain by using the retrograde transsynaptic rabie...
Reexamination, analysis and correction of 1 288 cases with decreased platelet count
Objective To classify and identify the false-positive cases of decreased platelet (PLT) count in laboratory by means of blood smear review, and to explore relevant technical adjustment and correction, so as to provide m...