LabVIEW
Dealing with Large csv data
Hello all,
I have large csv File. I want to convert to array (by Spreadsheet String to Array.vi).
Could you please tell me which one is more faster & Better. Sometimes if my file size is very big then Spreadsheet String to Array is not working (as per approach 2 & 3) because of Out of memory.
Hi Munna,
you already gave answers to your questions:
- you measure execution time to answer "which is faster"
- method 2&3 will fail due to "out of memory" errors, so method 1 is better…
It really depends on what you are doing with the data. Sometimes it is just best to read part of the file, process it, and then overwrite with the next section of the data. But you definately need to read the file in parts.
I have files looks like left side (old Type). I need to replace it by right side Image (New Type).
Here, I need to check,
where values getting started --- > before this value I need to replace empty cells by NaN.
Where values got ended -- > after that value I need to replace empty cells by NaN.
In between I need to take previous values.
Are you just saving this data to another file or are you doing something else with it?
But definately read the file in parts and use shift registers to keep your "previous" values. A simple check for a blank and Replace Array Subset is all you really need.
