excel with large data read

[IO HUI]

Hi all.

I have a question about the data read of the excel.

I have 15238 rows* of data 22 column of data in an excel file and LabVIEW need a very long time to read the excel.I don't know if my program is not good enough to manage the large data or it is normal for that.

Besides, I have tried to convert the excel data to csv data and use text file read method to read but it seems that it also need a very long time to read.

Actually, is there any better methods to read large amount of data? Does Access a good slution for that?

Thanks in advance,

Io

[ramses64]

Hi,
I have exactly the same problem (with the difference that it is in writing but not in reading) but I think it comes from the activeX speed.
I don't know where your xls comes from : in fact, I solved my problem by writing a tabulated file : it is quick, and I can open it with Excel.
So you can try to open you file with the attached file.
Hope it helps you.
best regards,
Vincent
P.S. : if your datas are cutted (4.3456345 => 4), it comes from a problem of standard : in your xls table, there are "." and labview seeks "," ...

[IO HUI]

Thanks for your reply.

Would  you mind to save the version as 8.0 because I just have the LabVIEW.Thanks a lot for your help.

Beides, I have tried again for the csv text file open method and it works well then.

So, I do think that import data from text file e.g. csv is better than using excel as it always have some problems occurs in the ActiveX part.

Thanks.

Io

[ramses64]

Hi,
Cf attached file, for labview 8.0.
In fact, an ActivX Method seems to be always slower than an internal Labview method.
So write/read in a text file is faster than using an ActivX method, and if you write well, the file can be opened by excel.
best regards,

[IO HUI]

Hi!

Thanks for your help.

I have tried the program but the data still cannot be extracted in a smooth way.

Maybe the data is too large and using ActiveX is not the best way to extract large amount of data.

But....

Actually using text file method to extract data is also the ActiveX application, it runs better than the excel import.

Thanks

Io

[ramses64]

Hi,
I 'm using this methos with an array of 60 000 * 9, and the datas are for exemple 9,82136328, and it works verry well.
If you want that I check your program, send me your vi, and the file that you would like to read.
best regards,
Vincent

[IO HUI]

Hi.

I have attached the data file for trying.

By the way, would you mind o tell me the size of the data file that you have used for the testing?

Thanks,

Io

[ramses64]

Hi,
Cf attached file : the picture shows what I read from your file. For the date column, it reads only the day, and for the booleans, it doesn't read text.
So if you want to read all datas, write the date on 3 columns, and write the booleans with numbers (0 or 1) !
The reason why the vi I sent you doesn't works is that it reads a tabulated file.
If you have excel 2007, select :
save as excel 97-2003
in the type of datas, change excel 97-2003 to text (separator : tabulation) (*.txt)
and save your file with this type of datas.
If you close and reopen the file, you will have a warning message, but excel will continue to read the file.
I join the file that you will have if you follow this method.
I use this method to read arrays of 60 000 rows *30 columns.
best regards,

[IO HUI]

Hi!

I see...

After changing the file type and save, I manage to import th data in LabVIEW.

Thanks a lot.

Cheers,

Io

[ramses64]

Hi,
happy to see that it works !!
Best regards,