The MIIS Eprints Archive

Gabor Filter Selection and Computational Processing for Emotion Recognition

Coskun, E. and Elson, T. and Lim, S. and Matthews, J. and Morris, G. and Nowaczyk, N. and Raanes, P. N. and Wind, D. K. (2014) Gabor Filter Selection and Computational Processing for Emotion Recognition. [Study Group Report]



CrowdEmotion produce software to measure a person’s emotions based on analysis of microfacial expressions detected using a webcam. The technology relies on a machine learning algorithm to recognize which features correspond with which emotions; it is trained on a labelled dataset. The features are derived by applying a bank of Gabor filters to a set of frames, determining the Local Binary Pattern (LBP) of each resulting pixel, and then averaging the results over three orthogonal planes (TOP), as outlined in [1]. CrowdEmotion challenged the study group to improve the accuracy, processing speed and cost-efficiency of the tool. In particular they wanted to know if a subset of the bank of Gabor filters was sufficient, and whether the image filtering stage could be implemented on a GPU. A framework for choosing the optimum set of Gabor filters was established, and preliminary testing performed. Different ways of implementing Gabor filters were explored. Some ele- ments of the feature set give little information, thus ways of reducing the dimensionality of this were interrogated. Some steps in the procedure outlined in [1] seemed ad-hoc, in particular when taking a subset of LBPs and choosing a gridding pattern to perform the TOP step. Taking a subset of LBPs was found to be fully justified. Meanwhile choosing a gridding pattern is open to interpretation; we make some suggestions on how this choice might be improved. A short review of alternatives to using a SVM as a classifier is presented.

Item Type:Study Group Report
Problem Sectors:Technology/Devices
Data processing
Study Groups:European Study Group with Industry > ESGI 100 (Oxford, UK, Apr 7-11, 2014)
UK Study Groups > ESGI 100 (Oxford, UK, Apr 7-11, 2014)
Company Name:CrowdEmotion
ID Code:670
Deposited By: Stuart Thomson2
Deposited On:05 Dec 2014 14:00
Last Modified:29 May 2015 20:18

Repository Staff Only: item control page