LabVIEW
What is the maxium size of data file that read spread sheet.vi can read?
How big is ">70MB"?
What do you intend to do with the data in your program once the file is read? Is your code optimized to operate in-place as much as possible? Are you avoiding all uneceessary datacopies in memory?
Arrays need to be contiguous in memory, so it is poissible that your memory is too fragmented and you don't have enough contiguous memory to complete the operation.
What datatype are you trying to read? String, DBL, 1D, 2D, etc.
Have you tried reading using low-level functions?
Can you attach your program so we get a better idea what you are trying to do?
here is my situation
>70 MB means any size large than 70MB ,e.g., 77MB,
my data type is 2D array, DBL,
part of my code is attached, it is just simple reading array by "read spreadsheet vi".
do you have any way to deal with fragmented menmory? what kind of low-level functions can be used to solve this problem?
thanks
Jack
Well, that does not really show much. Why are you using "array subset" followed by "index array"? A simple index array on the 2D array would do the same.
You can open "read from spreadsheet file" and inspect the code. You might be able to avoid a data copy by eliminating the subVI and placing a simplified version of the code flat on the diagram.
What is the structure of the file? How big is the resulting 2D array?
Have you tried low-level functions as suggested?
IgG_Kylin wrote:the structure of the file is 2D array, 8 columns, and many many rows.
Why can't you give an actual number?? How many characters are typically in a row? I am just trying to figure out how to translate file size into array size. Since the file is formatted, that ratio depends on the format.
It is typically not recommended to use formatted files for such large datasets. A binary file would be much more efficient for both reading and writing. Where does the file come from? Did you write it yourself with another LabVIEW program, for example?
Also, what is your OS (version, 32 vs 64 bit, etc.). How much RAM do you have? How many other programs are open?
Hi, altenbach,
Thank you so much for you reply.
I haven't tried low level functions yet.
Regarding the actual number, since each file size varies, I guess it has at least 2x10^6 rows. Each row has DBL 8 elements.
and my OS system is win7 32bit, 4GB RAM.
I also traced into the read spred sheet.vi, and the error is in the VI pointed by the red arrow.
IgG_Kylin wrote:I also traced into the read spred sheet.vi, and the error is in the VI pointed by the red arrow.
That does not look right. I assume you read the entire file, so the case shown does not even execute. You would execute case "0", which has basically no code. Please check once more.
