CPU memory

[PhaniChillara]

Hi,

I am using labview application for testing purpose, where I am doing many file operations. My problem is even after closing all the vi's my CPU memory is almost the same, CPU memory is coming down only when I exit the labivew.

Is there any logic/palette to kill all the memory used by labview

please suggest

[RTSLVU]

There are things you can do to reduce the memory usage of a Labvew program but without seeing your code nobodty can give you any detailed soutions.

[PhaniChillara]

Attached the screen shot of the code.

Here I am trying to ready *.csv files and decimating it (since those are large files) and taking it to a 2D array. Which I will be using data for the plotting

thanks in advance

[RTSLVU]

Well I can;t tell much from your jpg because it's not actulal code. I see you are bulding a huge array, arrays are stored entirely in memory. What is going on in your decimate sub vi?

[PhaniChillara]

Hi RTSLVU,

it is the actual code. Yes I am building a 2D array (Max 100000 x 61).

I have ~25979923 x 61 number of rows and columns of data in the all the files (refer screen shot)

since I can't plot the huge data. I am decimating them.

Decimate Sub VI:

receives the 1D array of line (coma separate)

decimates the 1D array to the specified scaling factor

I am using "spreadsheet string to array " to make the coma separated lines to 2D array

[RTSLVU]

You have a data file that has over 1,584,775,303 data points?

I do not think Labview is the proper language to be manipulating this large of data set.

What exactly are you trying to do?

[PhaniChillara]

🙂

I am running a test for 72 hrs which acquires 15 temp channel, 12 current channel values with 10ms data log duration.

I am able to do this operation with some memory issues. I am trying to minimize the memory issue also.

[RTSLVU]

You might want to consider using TDMS

File I/O palette  -->TDM streaming

and the Excel TDMS plugin to manage this large of a dataset.

[BowenM]

Start by looking at two places:

https://forums.ni.com/t5/Example-Code/Managing-Large-Data-Sets-in-LabVIEW/ta-p/4100668

http://www.ni.com/white-paper/6211/en/ 

One or both of those may solve what you need. I have worked with the GigaLabVIEW stuff before and found it to be... not fantastic. I use it as a last resort. Your best bet is to combine the in place element node and data value reference to prevent LV from duplicating your array in memory.