Gesture Keyboard Emulator for Student Design Competition 2013

[lmhtq]

Contact Information

University:Beijing University of Posts and Telecommunications

Team Members (with year of graduation):Xiaohui Luo(2014), Ziang Li(2014), Min Wang(2014), Daoshi Kuang(2014), Yuchen Li(2012)

Faculty Advisers:Jianwei Wu

Email Address:lmhtq1991@gmail.com

Submission Language: English

Project Information

Title:Gesture Keyboard Emulator

Description:

Use this software, you can use normal camera to capture image that contains gestures. And after processing, converted to the corresponding keyboard. It can allow people operating without keys but through gestures.

Products used:

Softwares:LabVIEW 2010, Vision

Hardwares:None

The Challenge

1 using almost any computer configuration ordinary camera, rather than similar kinect as expensive professional infrared camera, so it's wide audience at low cost. This is the virtual instrument can be classified as software engineering group, rather than a PC-based data acquisition platform (like the software keyboard alone would not be called PC-based data acquisition).

2 Use gestures analog keyboard, making gestures can theoretically all keyboard.

3 using gestures analog keyboard, rather than gestures direct control, so you do not need some of the relevant drive, just to have a working ordinary camera can.

4 Take a template matching method, making efficiency is relatively high.

5 increase with environmental parameters, so that the software can be adapted to different conditions of illumination environment, increases the usefulness of the software.

6 user can freely set the environment parameters, increasing the scope of the adaptation of the software, the software also increases the interactivity and usability.

7 software interface style is simple, increase the software's ease of use; and reduce the chance of user errors, increasing the robustness of the software.

8 cameras capture images and image processing is asynchronous with the matching process, increasing the parallelism. Simultaneous acquisition of images exceeds automatically discarded, so that the feeling of the user level process is synchronized.

9 We will be generated as the software executable files submitted along with the source code, and solve the run-time mode and development mode relative path inconsistencies, further simplifying the user's actions, so that it can be copied to any place without confusion, increased robustness.

The Solution

0 Start

1 Set

(1) Add a new environment.

          In the new environment, set the HSV, thresholds and erosion value of the image, and then enter the name of the environment. Finally, save and return.

(2) Select the environment in which you are to add gestures.

(3) Add new gestures in the selected environment

          When adding a new gesture, first click the Setting button, then the screen will pause, press and hold (do not release) button. Finally, then save and return.

2 Return to the main interface

3 Start

          Demo the software's features, as long as the keyboard can be manipulated, your gestures can also be, the premise is that you have the ability to remember so many gestures. Presentation demonstrates only four gestures.

(1) Enter the demo Notepad

(2) Contra operation(in the emulator VirtuaNES 0.97) and demonstration

          Set the corresponding hotkeys.

(3) The player control

          Set the corresponding hotkeys.

(4) Press Stop to return.

4 Exit

Image(s) of project with captions.

1.Main interface.

2.Settings

3.Add the environment.

4.Add the gesture.

5.Demo

<Insert video here.>

<Attach VI code (optional).>

It is already in the attachment.

<Level of completion (beta, alpha, or fully functional)>

This is a alpha edtion

<Time to build>

10 March 2013

<Additional revisions that could be made>

Attach Poster (30 in. x 38 in.) and LabVIEW Code

<Include captions for all graphics material. Type your photo or graphic caption underneath each graphic using this 10 pt Times New Roman font. Embed all graphics. Remember—you must provide individual electronic files for each graphic you include in your paper. Place photos in text after first reference—you must include a reference to all graphics in the text. Include screen captures if you use National Instruments software products. Screen captures must have a minimum resolution of 72 dpi at 100 percent. All other graphics must have a minimum resolution of 300 dpi.>

It is already in the attachment.

Nominate Your Professor (optional)

Professor Jianwei Wu.

Research direction: Communications Engineering Teaching and Research