Efficient Human-Robot Interaction using Deep Learning with Mask R-CNN: Detection, Recognition, Tracking and Segmentation

Journal Title: Progress in Human Computer Interaction - Year 2018, Vol 1, Issue 2

Abstract

We address social human-robot interaction problem by proposing an integration of deep neural network with mechanical robotic system to make it robust for human-robot interactive activities. Mask R-CNN, a neural network for object detection, can effectively help localize human faces which can be manipulated to instruct movement of the robot head. Our approach is not only suitable for detection and segmentation tasks but able to integrate as well with the mechanism of parallel mini-manipulator representing the 3D dimensions, in position and orientation of workspace. It can also solve the object segmentation problem which appears to be one of the most challenging issues in computer vision nowadays.

Authors and Affiliations

Than Le, Dang Huynh

Keywords

Related Articles

Efficient Human-Robot Interaction using Deep Learning with Mask R-CNN: Detection, Recognition, Tracking and Segmentation

We address social human-robot interaction problem by proposing an integration of deep neural network with mechanical robotic system to make it robust for human-robot interactive activities. Mask R-CNN, a neural network f...

Research and Development of CAD/CAM System for Cavity Mold

With the rapid development of science and technology, the demand for product diversifi cation is becoming stronger and the product is getting faster and faster. Especially as plastic products and other light industrial c...

Using Grounded Theory to Explore the Words of Mouth in Live Broadcast Platform

The purpose of this study is to explore in depth the special context and unique experience of the live video streaming and to provide insights regarding an interpretation of the contextualization experiences model. This...

Human-computer Interaction System Based on Visual Gesture Recognition

Human-computer interaction system is the medium for communicating and transmitting information between people and computers. With the rapid development of computer technology, traditional human computer interaction techn...

Effect of Noise Pollution Among Milling Machine Operators in North-West Nigeria

Commercial activities are mostly centralized to main markets in many towns and cities of the Northern part of Nigeria. Such central markets constitute the noisiest part of the towns. Yet, there is no evidence that the wo...

Download PDF file
  • EP ID EP679116
  • DOI -
  • Views 255
  • Downloads 0

How To Cite

Than Le, Dang Huynh (2018). Efficient Human-Robot Interaction using Deep Learning with Mask R-CNN: Detection, Recognition, Tracking and Segmentation. Progress in Human Computer Interaction, 1(2), -. https://europub.co.uk/articles/-A-679116