Student Projects
Contact Information
Country: Korea
Year Submitted: 2017
University: Kyungsung Univ.
List of Team Members (with year of graduation): Su-Ji Jang, Bo-Seong Kim, Ji-Hye Kim,
Jin-Young Kim, Jung-Yeob Lee, Jun-Yeob Sung․
Faculty Advisers: Jang-Sik Park
Main Contact Email Address: qhtjd7440@naver.com
Project Information
Title: Implementation of Remote Control Patrol Robot System Based on Natural User Interface
Description: The system was implemented using Natural User Interface(NUI) based remote control
patrol robot system using Kinect and myRIO controller. The host recognizes the user's motion
using Kinect and plays the video transmitted from the patrol robot. The patrol robot drives the
motor according to the control signal transmitted from the host using myRIO, and transmits
video signal of USB camera to the host through the WiFi network. As for the results of the
experiment, it is shown that the implemented patrol robot system can effectively monitor on the
blind spot of fixed CCTV camera.
Products: Desktop PC, Notebook, myRIO, LabVIEW 2016, Kinect 1.6, WebCam, Windows7
The Challenge:
Crime and accidents are happening not only in Republic of Korea, but also in many other
countries. Therefore, a CCTV camera system is needed for citizen safety and security facility
surveillance. Nowadays, CCTV camera image security through system is developing into
intelligent by recognizing people automatically or detecting fire by applying techniques such as
image analysis and pattern recognition. However, with fixed CCTV cameras, there is a limit to
monitor surveillance facilities because there are blind spots. To overcome this issue, we have
implemented a reconnaissance robot system with video transmission function for video
surveillance with a blind spot in the security facility.
The Solution:
We encountered a delay in sending and receiving tcp ip while implementing this system. myRIO
exceeded the amount that can be transmitted at a time, and by driving the LED of myRIO, the
problem was solved.
The administrator uses the NUI technology (natural user interface technology) to recognize the
user's natural behavior and control various devices using the Kinesthesia Toolkit for Microsoft
Kinect instead of a control device such as a computer keyboard or joystick.
The team was able to fully complete the project in under 3 months.
In the future, intelligent image analysis functions such as face recognition will be added to the
reconnaissance robot and it will be possible to control the reconnaissance robot more smoothly
by linking it with a Virtual Reality(VR) device. For example, it can act an eye and a foot for
the elderly or the handicapped who have a mobility problem. In addition, when an accident
occurs, it would be difficult to enter a dangerous place, so an unmanned robot can be used for
the rescue operation without any additional harm to rescuers.
VI code:
Link to Video
https://www.youtube.com/watch?v=YfRe1JQlTXk&feature=share
Attach Poster
