LabVIEW

cancel
Showing results for 
Search instead for 
Did you mean: 

Problems with opening file with while loop

Solved!
Go to solution

Hey Greg,

 

  Much clearer now. I really appreciate the response!

 

  Thanks!

   TheLT

0 Kudos
Message 21 of 23
(379 Views)

@johnsold wrote:

Greg,

 

There definitely is a point where it becomes necessary to read in chunks.  I recently was processing text-based spreadsheet files of >100MB and having both string and numeric arrays in memory at the same time created memory problems.  By reading in chunks I was able to get the memory footprint to a few percent above the final numeric array size.

 

Lynn


Lynn,

 

We should chat! I recently did the same thing, hundreds of rows by hundreds of columns in CSV files. Luckily the computer was able to handle it all in memory at once, but I was really pushing the boundaries. If they expand the data to include additional columns, we may need to refactor. Unfortunately I was under a time crunch, and because there was enough memory and generally the files shouldn't change much, I had to take the quick way out.

0 Kudos
Message 22 of 23
(360 Views)

Greg,

 

PM sent.

 

Lynn

0 Kudos
Message 23 of 23
(350 Views)