Data merging and logging from for loops

[shivik89]

I have data that's being logged into 2 loops in separate xlsx files. I want to combined the data of these 2 files into one file with the colums next to each other. One file has the data from an GPS receiver with (longitude, latitude and altitude) and the other has the average power of an power sensor ? is there anyway to do this?

[shivik89]

I have data that's being logged into 2 loops in separate xlsx files. I want to combined the data of these 2 files into one file with the colums next to each other. One file has the data from an GPS receiver with (longitude, latitude and altitude) and the other has the average power of an power sensor ? is there anyway to do this?

[Fred19ni]

Hi,

Firstly, Your Diagram is very overloaded. You should learn more about dataflow paradigm in LabVIEW.

However to solve your problem you should use elements of Array palette (built array for example)  and low level VIs of palette File I/O to resolve your problem.

let me know if you have others questions.

Kudos are welcome!   

[crossrulz]

Why so many loops?  Can you combine into a single loop and then you only have to write to the file in 1 place?

[shivik89]

Hello the data is coming from 2 separate sensors, that why i need two separate loops

[GerdW]

Hi shivik,

Hello the data is coming from 2 separate sensors, that why i need two separate loops

And what's the reason for this statement?

There might be reason, but surely not "there are 2 separate sensors"…

Hint: Ever heard of producer-consumer scheme?

[NatanBiesmans]

Hi Shivik,

It would be best to use a produce consumer pattern to save all the data within 1 while loop.

http://www.ni.com/white-paper/3023/en/

Here you can format your data in 1 go.

NI also does not recommend the usage of the write to measurement file express vi in a loop as this will affect performance.

What you can do is look at TDMS files as they will give you a more scaleble approach. Use these with a normal file I/O chain to greatly reduce computer resource usage.

http://www.ni.com/white-paper/3727/en/

Kind regards,

Natan Biesmans

[shivik89]

Hello thanks for your suggestions. But i think the producer/consumer scheme will not work. I have 2 sensors with prodcue data at differernt rates. one is a power sensors with (8Msamples/second) the other is a gps sensor with 1 sample per second.

I want to write the data of both sensors simultaneously to one file. with 3 coulms the GPS sensor data(longitude, latitude and altitude) and 1 column with the power sensor data(average power). 

Since I won't use this data during ""storage process" , the producer/consumer look will be useful in this case

[GerdW]

Hi shivik,

But i think the producer/consumer scheme will not work.

Why not?

I have 2 sensors with prodcue data at differernt rates. one is a power sensors with (8Msamples/second) the other is a gps sensor with 1 sample per second.

So you could read both sensor data in one loop, one with 8MS/s and the other with just 1S/s. What's the problem?

 (I might still use two loops for those two sensors, writing the "fast" data in a queue and the "slow" one into a notifier…)

I want to write the data of both sensors simultaneously to one file. with 3 coulms the GPS sensor data(longitude, latitude and altitude) and 1 column with the power sensor data(average power). 

So you want to average this power data down to 1S/s? Or do you want to resample the power data to something in the order of 10kS/s?

Anyway: keep the GPS data in a notifier to always read the latest sample. Combine it with your power data…

[NatanBiesmans]

Hi Shivik,

I created a quick example that shows you how to use the producer consumer loops.

This is not the most optimal solution but will be enough to get you started.

Kind regards,

Natan Biesmans