Azure Kinect Sensor & Body Tracking

张斌 · ‎05-01-2022

The Azure Kinect Sensor For LabVIEW is a LabVIEW plug-in for controlling Microsoft hardware Azure Kinect DK.

With this plugin, you can use LabVIEW to access the underlying sensors (depth camera, infrared camera, RGB camera, accelerometer, gyroscope) that control the Azure Kinect DK hardware, and access the sensor's calibration parameters. In addition, the plugin also provides functions such as depth camera and color camera alignment, direct access to color point clouds, point cloud mesh reconstruction, 3D mesh smoothing, color mesh data storage and reading, and provides rich examples for these functions!

The Azure Kinect Body Trackingr For LabVIEW ，On the basis of the above, the human body tracking function is added.[Install the latest NVIDIA drivers(Official Drivers | NVIDIA)]

Hardwsre Required
Azure Kinect DK (https://www.microsoftstore.com.cn/vr-and-mr/azure-kinect-dk)

Features
01) Depth camera access and mode control (a passive IR mode, plus wide and narrow field-of-view depth modes)
02) RGB camera access and control (for example, exposure and white balance)
03) Directly access point cloud data
04) Motion sensor (gyroscope and accelerometer) access
05) Synchronized Depth-RGB camera streaming with configurable delay between cameras
06) External device synchronization control with configurable delay offset between devices
07) Camera frame meta-data access for image resolution, timestamp, etc.
08) Device calibration data access
09) Point cloud to triangle mesh reconstruction function
10) Bilateral filtering and smoothing of triangular mesh data
11) Triangular mesh data storage and reading
12) Real-time human body 32 joint point tracking and rendering

Example

1) Simultaneous acquisition of depth image, RGB image, infrared image, accelerometer and gyroscope data

屏幕截图 2022-03-31 142046.png