Rutgers Wireless Orchestra

[WirelessOrchest]

Contact Infomarmation:

Rutgers University
Team Members:

Eric DeJesus (2013)
Miroslav Tomaska (2013)
Westley Propati (2013)

Faculty Advisors:

Predrag Spasejovic

Submission Language: LabView

Project Information

Title: Wireless Orchestra

Description:  The Wireless Orchestra is a senior design project that was envisioned by advisor Professor Spasojevic, and constructed by his students: Eric DeJesus, Westley Propati, Miroslav Tomaska, and Songfei Zhang. It revolved around a simple idea to create an electronic orchestra, where computers become the musicians and one human synchronizes their actions. Even though the idea was simple, the implementation was an involved and systems engineering job.

Products: NI USRPS Radio, LabView 2012 and Kinethesia Toolkit for Kinect

The Challenges:
-  Integration of hardware and software using USRP Radios, Kinect and Computers with Speakers to create an complete system.
-  Distributive system involving wireless network which requires real time system response
Kinect:

- Protocol Suite Design for groups of controlling individual and groups of computers

- Designing commands that are clearly distinguishable via Kinect

- Designing a command state machine to enhance the command space

- Designing a Kinect to USRP protocol to ensure continuous and reliable command transmission

USRP:

- USRP communication broadcast (one to many) link design
- Design of Command initiatedby single shot USRP packet transmission & reception
- Resolving RF channel/ anthenna incompatibilities
- Debugging Synchronizaton at the receiver

Protocol:

- Efficient packet protocol design for multicommand multicast from one computer to many

- Creating music segments
- Creating a user friendly enviroment to control & select different types of distributed music

Instructions how to use this system:

Following Instruction need to be executed only one time on new machines that
do not have drivers and music loaded.
----------------------------------------------------------------------------

1. Instruction How to Setup and Install Kinect Drivers
Follow instructions from LabVIEW hacker website to install kinect drivers

Download and install Kinethesia toolkit from NI website

BEFORE RUNNING THE RX-Musicians VI:

-Select the Computer Number.

-In the RX-Musician VI open the Library Folder where the
  Music files are located. (It will be labeled: Library Folder)

-For demonstration purposes, we've put together a four piece band that
  will play The Beatles "Come Together."
  You can find that in the Wireless Orchestra folder, labeled as
  "Demonstraiton - come Together"

NOW RUN RX-MUsicians VI:

-After selecting the folder, the files in the folder will be shown in
  the multilist "All Files."

-Select which file should be played on the specific computer by clicking
  the file name in the multilist "All Files."

-Now, wait until the conductor sends a command at the TX to hear the music!

Following Instruction need to be exacutated on every setup of system:

-In Wireless Orchestra Project folder open Wireless Orchestra.lvproj
-Under Main system Open TX-Conductor (on main computer)
     Open RX-Main Computer (on each subcomputer)

In TX-Conductor -> make sure IP address corresponds
      to correct IP address of
                           USRP radio used at that computer.

In RX-Musician  -> make sure IP address corresponds
      to correct IP address of
                    USRP radio used at that computer.
             Select Library Folder with music located....
                    Select computer number for which computer you want to transmit to.

2. Instructions How to Load Music On Sub-computers (RX)

[Orkzombie]

As I think it is very entertaining research but, It has so may limits and unacurrate data processing resulted in many computers are participate in this orchestra uneffectively and does not react well. so I recommend that in one computer, using image process such as diffrentiation of the 2d array pixcell black&white data and wavelet noise cancelling, Computer can recognise the position of the and in real-time. and follow to the location of the hands give the high-middle-low tones of the music and volume of the total music.