Efficient Human-Robot Interaction using Deep Learning with Mask R-CNN: Detection, Recognition, Tracking and Segmentation

Journal Title: Progress in Human Computer Interaction - Year 2018, Vol 1, Issue 2

Abstract

We address social human-robot interaction problem by proposing an integration of deep neural network with mechanical robotic system to make it robust for human-robot interactive activities. Mask R-CNN, a neural network for object detection, can effectively help localize human faces which can be manipulated to instruct movement of the robot head. Our approach is not only suitable for detection and segmentation tasks but able to integrate as well with the mechanism of parallel mini-manipulator representing the 3D dimensions, in position and orientation of workspace. It can also solve the object segmentation problem which appears to be one of the most challenging issues in computer vision nowadays.

Authors and Affiliations

Than Le, Dang Huynh

Keywords

Related Articles

Interactive Design of Mobile Phone Interface

This topic is divided into two parts: (1) mobile phone interactive design of the status quo survey, including the mobile phone market, the use of the crowd, the use of functions, keyboard and interface analysis. (2) Mobi...

Human-computer Interaction System Based on Visual Gesture Recognition

Human-computer interaction system is the medium for communicating and transmitting information between people and computers. With the rapid development of computer technology, traditional human computer interaction techn...

Efficient Human-Robot Interaction using Deep Learning with Mask R-CNN: Detection, Recognition, Tracking and Segmentation

We address social human-robot interaction problem by proposing an integration of deep neural network with mechanical robotic system to make it robust for human-robot interactive activities. Mask R-CNN, a neural network f...

Research and Development of CAD/CAM System for Cavity Mold

With the rapid development of science and technology, the demand for product diversifi cation is becoming stronger and the product is getting faster and faster. Especially as plastic products and other light industrial c...

Design of Human-computer Interface for Laser Cutting Machine

A design method based on information fusion is proposed regarding the problem of poor integration and intelligence of human-computer interface for current laser cutting machine. The designed human-computer interaction in...

Download PDF file
  • EP ID EP679116
  • DOI -
  • Views 212
  • Downloads 0

How To Cite

Than Le, Dang Huynh (2018). Efficient Human-Robot Interaction using Deep Learning with Mask R-CNN: Detection, Recognition, Tracking and Segmentation. Progress in Human Computer Interaction, 1(2), -. https://europub.co.uk/articles/-A-679116