Fourier Series Model for Facial Feature Point Land-Marking

Type of content
Conference Contributions - Published
Thesis discipline
Degree name
Publisher
Elsevier BV
Journal Title
Journal ISSN
Volume Title
Language
Date
2023
Authors
Arabian H
Ding N
Chase, Geoff
Moeller K
Abstract

The field of digital health apps, combined with intelligent learning systems, is new and expanding to incorporate a wide range of possibilities in different domains. An application in the field of digital therapy is for the incorporation of emotion recognition systems as a tool for therapeutic interventions. Adopting an individually tailored virtual world combined with a novel reward system in a gaming scenario, complemented with the technical affinity of most autism spectrum disorder (ASD) children makes a suitable atmosphere for therapeutic intervention. In this paper the use of image processing techniques coupled with Fourier models is used to generate point land-mark annotations on facial features in an image. The OULU-CASIA database was used for the analysis process. The images were first pre-processed based on previous work to reduce background noise and focus on the face. Afterwards a de-correlation stretch was executed to separate different features. A series of morphological, region detections and boundary traces followed. Fourier series models were used to transition the rough segmented pixel data into a smooth geometric representation. Twenty evenly distributed land-mark points are then selected from a fine mesh. Results showed that the geometric representation adhered to the segmented pixel data with a mean of 81.88% Dice similarity. The positive outlook highlighted the effectiveness of such a technique in automating the land-mark annotation process, which is tedious and time consuming. This method leads to explainable machine learning feature representations, which lead to more robust emotion recognition models.

Description
Citation
Arabian H, Ding N, Chase JG, Moeller K (2023). Fourier Series Model for Facial Feature Point Land-Marking. IFAC-PapersOnLine. 56. 2. 7354-7358.
Keywords
Autism Spectrum Disorder, Digital health, Emotion recognition, Fourier series, Geometric feature representation, Image land-marking, Therapeutic application
Ngā upoko tukutuku/Māori subject headings
ANZSRC fields of research
46 - Information and computing sciences::4608 - Human-centred computing::460802 - Affective computing
46 - Information and computing sciences::4608 - Human-centred computing::460806 - Human-computer interaction
46 - Information and computing sciences::4607 - Graphics, augmented reality and games::460706 - Serious games
46 - Information and computing sciences::4601 - Applied computing::460102 - Applications in health
Rights
Copyright © 2023 The Authors. This is an open access article under the CC BY-NC-ND license.