From Friday, April 19th (11:00 PM CDT) through Saturday, April 20th (2:00 PM CDT), 2024, ni.com will undergo system upgrades that may result in temporary service interruption.
We appreciate your patience as we improve our online experience.
Student Projects
Contact Information
University:Huazhong University of Science and Technology
Team Members (with year of graduation):Li Ming,Liu Jun,Wang Hongyan,Huang Junyi,Lei Xinyu
Faculty Adviser:Zhan Yi
Email Address:158219842@qq.com
Submission Language:English and chinese
Project Information
Title:Virtual Cube Fantasy
Description:
<<<<<<
With the development of technologies and the needs to optimize the player’s experience, some game companies developed professional, specific input device and large arcade games. Different from large game workbench, our project does not capture player’s move by video recognition but by a 3D rotating system based on LabVIEW and Three-axis gyroscopes.
随着科技进步以及增强玩家游戏体验的需要，相关的游戏公司开发出了专业化，特异化的游戏输入设备以及大型街机游戏项目。区别于大型大型游戏平台，本项目并不是采用视频识别技术来捕捉三维空间中玩家的动作，而是一种基于LabVIEW和三轴陀螺仪\加速度传感器MPU6050的3D魔方旋转系统。
<<<<<<
Products
<<<<<<
VISA,LabVIEW 2012
<<<<<<
The Challenge
<<<<<<
Just like what they are called, somatosensory games are video games that can be directly controlled by human body moving, rather than former game operation by handle or keyboard. The original way of former video game input comes from keyboard of a computer, and there are various of professional video game players and operating workbenches. With the development of technologies and the needs to optimize the player’s experience, some game companies developed professional, specific input device and large arcade games. Different from large game workbench, our project does not capture player’s move by video recognition but by a 3D rotating system based on LabVIEW and Three-axis gyroscopes.
Somatosensory games are worldwide popular And the new somatosensory games can imitate 3D display. Players hold special handles, control the character in games by body moving and experience somatosensory interaction. Digital entertainment workbench can provide players with healthy somatosensory games, which are appropriate for people aged from 8 to 80. So there exists huge market.
体感游戏顾名思义：用身体去感受的电子游戏。突破以往单纯以手柄按键输入的操作方式，体感游戏是一种通过肢体动作变化来进行操作的新型电子游戏。电子游戏最开始的输入方式来自于计算机键盘，后来衍生出的专业电子游戏机以手柄或操作台的形式来进行电子游戏内容。后来，随着科技进步以及增强玩家游戏体验的需要，相关的游戏公司开发出了专业化，特异化的游戏输入设备以及大型街机游戏项目。区别于大型大型游戏平台，本项目并不是采用视频识别技术来捕捉三维空间中玩家的动作，而是一种基于LabVIEW和三轴陀螺仪\加速度传感器MPU6050的3D魔方旋转系统。
体感游戏流行与欧美国家，并传入亚欧国家。2011年后的新式体感游戏能够模拟出三维场景，玩家手握专用游戏手柄，通过自己身体的动作来控制游戏中人物的动作，能够让玩家“全身”投入到游戏当中，享受到体感互动的新体验。数字家庭娱乐平台能够为玩家提供体感绿色健康游戏，适合8岁到80岁之间各个年龄段，游戏项目还可在线升级更新，不同年龄的用户都可找到自己喜爱的游戏类型。因此有广阔的市场发展前景。
<<<<<<
The Solution
<<<<<<
According to principles of somatosensory sensor, we designed a 3D cube rotation system based on LabVIEW and acceleration sensor with three-axis gyroscopes. The structure diagram of general system is shown as Figure1
根据体感传感器的测量原理，我们设计了一种基于LabVIEW和三轴陀螺仪\加速度传感器MPU6050的3D魔方旋转系统。系统结构如图2-1所示。
Fig.1 Structure diagram of general system
The system mainly consists of main-control devices, wireless delivery module, upper machine of virtual 3D Rubik's cube, and data acquisition devices of finger moving.
Data acquisition devices of finger moving is in fact a self-made finger sheath, on which fixed acceleration sensor with three-axis gyroscope, it is able to measure the angular velocity of finger moving. We choose STM8L152C6 chip as main-control device, and acquire data through I2C bus. Then data can be delivered to upper machine through wireless delivery module nRF24L01. Finally, signal is received by wireless receiver device USB-24L01 and delivered to PC upper machine through USB Serial ports, In there the signal controls the rotation of cube via specific program.
系统主要由手部运动姿态数据采集装置、主控设备、无线传输模块以及上位机3D魔方组成。
手部运动姿态数据采集装置为一自制的指套，指套上面固定住了陀螺仪\加速度传感器MPU6050，可以测量手指运动的角速度。主控设备采用STM8L152C6单片机作为主控芯片，通过I2C总线控制传感器采集数据，并将采集得到的数据通过无线传输模块nRF24L01发送至上位机。最后，无线接收设备USB-24L01将接收的数据通过USB转串口传输至PC上位机 ，进而通过一定的算法控制3D魔方的转动。
<<<<<<
Function of system
(1) Process of lower machine with software and hardware
We completed the design of hardware of main-control device, power circuit, sensor PCB, communication module, as well as software of lower machine. Data can be successfully acquired by sensor stably processed to upper machine, and input into computer to control the rotation of 3D cube.
(2) Process of upper machine with software
Interface software is composed by the graphic program language LabVIEW. It can receive, process, analyze and respond to data from USB-24L01, and complete operations of rotation, scramble, and auto-solving of a virtual 3D Rubik’s cube. It has a friendly interface and provides players with direct somatosensory game experience.
(1)下位机软硬件的实现
完成对主控设备，电源电路，传感器PCB，通信等模块的硬件设计，以及下位机的软件设计。能够从传感器取得数据，并能与上位机进行稳定的无线通信，以及控制电脑上3D魔方的转动。
(2)上位机软件的实现
采用图形化编程语言LabVIEW进行软件界面的编写，能够实现对USB-24L01中数据的接收、处理、分析以及响应，实现旋转，随机打乱及求解三维魔方。界面友好、人性化，为使用者提供直观的游戏体验。
The main function of upper machine is to process and analyze signal after data acquisition from finger moving , and respond to controlling signal.
We take LabVIEW as develop environment to detect the finger moving signal, LabVIEW is an advanced design platform of measurement and control. It has various utility packages, which ensure the quality of system development and decrease the difficulties. The program takes producer and consumer frame based on event-structure, which is flexible, efficient and scalable.
手指动作信号检测系统的计算机软件设计采用先进的开发测量控制类虚拟仪器的设计平台LabVIEW2011作为开发环境。它具有丰富的实用工具软件包，这不仅保证了系统开发的质量，同时简化了开发难度。软件设计采用基于事件结构的生产者消费者框架，具有灵活高效的处理机制及优良的结构拓展性。
We designed the interface of program consists of command window and display window, in the command window we can send “randomize” and “solve” command without lower machine, while the display window displays the responding in 3D cube way, shown as Fig.2 and Fig.3.
可以看到程序界面由指令窗口及显示窗口两个窗口。其中指令窗口可以发送“Randomize”及“Solve”等不需要下位机信号的指令，而显示窗口将对下位机信号及指令窗口两处产生的响应结果以3D魔方方式显示出来。如图4-5，图4-6为软件界面截图。
Fig.2 command window on PC
Level of completion :beta
Time to build:2013.5.31
This project completed previously expected function, but it can be improved to be more delicate, multiple-functioned and lower-powered. The playing experience can be more comfortable and lifelike.
For hardware, the rotation is not perfect because the sensors are not enough. We will further complete the sensor design and add an angular sensor to fully control the cube rotation, thus it will be more lifelike.
For software designing, there are still some bugs in signal processing, which can be optimized to allow the cube respond faster and more fluently.
The data collection device of finger moving can be made of more stable material, and it can be further designed to fit fingers better.
Meanwhile, we will choose more equipment from NI, such as data acquisition module and wireless receiver module. Also, we are considering to utilize the naked eye 3D technology in our future project development to ensure better game experience and approaches to more enormous application field.
本项目基本完成了预期的功能，在项目的后期发展上，可以使本游戏向更小巧、功能更多、功耗更低、游戏体验更舒适更逼真等方向发展。
对于硬件部分，本次使用的传感器较少，无法完整实现魔方的旋转，后期会完善传感器的制作，同时考虑在手背处加入角度传感器，达到控制魔方视角的功能，这样玩家体验的感觉更真实。
对于软件设计，在动作信号的处理上还有不小的缺陷，可继续完善，使魔方能更快速地响应玩家的动作，魔方的旋转更流畅。
同时，后期的发展方案中我们会更多的考虑使用NI的仪器设备，例如用到数据采集模块，无线收发模块。
指套脉搏信号采集装置可用稳定性更好的材料来制作，并加入更人性化的设计，使指套更贴合人的手指，让使用者用起来更舒适和方便
Attach Poster (30 in. x 38 in.) and LabVIEW Code
