Multi-modal Person Localization And Emergency Detection Using The Kinect

Abstract

Person localization is of paramount importance in an ambient intelligence environment since it is the first step towards context-awareness. In this work, we present the development of a novel system for multi-modal person localization and emergency detection in an assistive ambient intelligence environment for the elderly. Our system is based on the depth sensor and microphone array of 2 Kinect devices. We use skeletal tracking conducted on the depth images and sound source localization conducted on the captured audio signal to estimate the location of a person. In conjunction with the location information, automatic speech recognition is used as a natural and intuitive means of communication in order to detect emergencies and accidents, such as falls. Our system attained high accuracy for both the localization and speech recognition tasks, verifying its effectiveness

Authors and Affiliations

Georgios Galatas , Shahina Ferdous , Fillia Makedon

Keywords

Related Articles

 Gesture Controlled Robot using Image Processing

 Service robots directly interact with people, so finding a more natural and easy user interface is of fundamental importance. While earlier works have focused primarily on issues such as manipulation and navigation...

 Military Robotics: Latest Trends and Spatial Grasp Solutions

 A review of some latest achievements in the area of military robotics is given, with main demands to management of advanced unmanned systems formulated. The developed Spatial Grasp Technology, SGT, capable of satis...

 Improved Text Reading System for Digital Open Universities

 The New Generation of Digital Open Universities (DOUNG) is a recently proposed model using m-learning and cloud computing option and based on an integrated architecture built with open networks as GSM and Internet....

 Decision Making and Emergency Communication System in Rescue Simulation for People with Disabilities

 Decision making and emergency communication system play important roles in rescue process when emergency situations happen. The rescue process will be more effective if we have appropriate decision making method an...

 Regressive Analysis on Leaf Nitrogen Content and Near Infrared Reflectance and Its Application for Agricultural Farm Monitoring with Helicopter Mounted Near Infrared Camera

 Method for evaluation of nitrogen richness of tealeaves with near infrared reflectance is proposed. Also tea farm monitoring with helicopter mounted near infrared camera is proposed. Through experiments and regress...

Download PDF file
  • EP ID EP161558
  • DOI -
  • Views 151
  • Downloads 0

How To Cite

Georgios Galatas, Shahina Ferdous, Fillia Makedon (2013). Multi-modal Person Localization And Emergency Detection Using The Kinect. International Journal of Advanced Research in Artificial Intelligence(IJARAI), 2(1), 41-46. https://europub.co.uk/articles/-A-161558