Skip to content

Computing and Informatics Research Seminar Series

Adaptive facial point detection and emotion recognition for a humanoid robot

open book on table
Seminars

As part of the School of Science and Technology's Computing and Informatics Research Seminar Series, Dr Kamlesh Mistry, Northumbria University presents: Adaptive facial point detection and emotion recognition for a humanoid robot.

  • From: Wednesday 13 November 2019, 1 pm
  • To: Wednesday 13 November 2019, 2 pm
  • Location: ERD 161, Erasmus Darwin, Nottingham Trent University, Clifton Campus, Clifton Lane, Nottingham, NG11 8NS
  • Download this event to your calendar

Past event

Event details

As part of the School of Science and Technology's Computing and Informatics Research Seminar Series, Dr Kamlesh Mistry, Northumbria University presents: Adaptive facial point detection and emotion recognition for a humanoid robot.

Abstract:

Automatic perception of facial expressions with scaling differences, pose variations and occlusions would greatly enhance natural human robot interaction. This research proposes unsupervised automatic facial point detection integrated with regression-based intensity estimation for facial action units (AUs) and emotion clustering to deal with such challenges. The proposed facial point detector is able to detect 54 facial points in images of faces with occlusions, pose variations and scaling differences using Gabor filtering, BRISK (Binary Robust Invariant Scalable Keypoints), an Iterative Closest Point (ICP) algorithm and fuzzy c-means (FCM) clustering. Especially, in order to effectively deal with images with occlusions, ICP is first applied to generate neutral landmarks for the occluded facial elements. Then FCM is used to further reason the shape of the occluded facial region by taking the prior knowledge of the non-occluded facial elements into account. Post landmark correlation processing is subsequently applied to derive the best fitting geometry for the occluded facial element to further adjust the neutral landmarks generated by ICP and reconstruct the occluded facial region. We then conduct AU intensity estimation respectively using support vector regression and neural networks for 18 selected AUs. FCM is also subsequently employed to recognize seven basic emotions as well as neutral expressions. It also shows great potential to deal with compound and newly arrived novel emotion class detection. The overall system is integrated with a humanoid robot and enables it to deal with challenging real-life facial emotion recognition tasks.

Bio:

Dr Kamlesh Mistry completed his PhD in facial expression recognition for humanoid robots from Northumbria University in 2016. Currently, he is working as a Lecturer in computer science at Northumbria University. His main research area is facial expression recognition using computer vision and machine learning techniques. He is also looking for industry collaborations in order to apply his research on real-world applications. All of his research work is published in top-ranking journals and conference (https://scholar.google.co.uk/citations?user=42pN-FIAAAAJ&hl=en). Dr Mistry will talk about facial Expression recognition, which plays an important role in pattern recognition, computer vision, and human-computer interaction, and is widely used in personalised healthcare, video games, surveillance systems, humanoid service robots, and multimedia. Facial expression is one of the effective channels to convey emotions and feelings. Research shows that facial expression contributed to about 55% effect of overall emotion expression during social interactions.

This seminar is hosted by Mufti Mahmud

All Welcome

For any enquires please contact Mufti Mahmud

Location details

Room/Building:

ERD 161, Erasmus Darwin

Address:

Nottingham Trent University
Clifton Campus
Clifton Lane
Nottingham
NG11 8NS

Past event

Still need help?

+44 (0)115 941 8418