TDM Reader Import Line Limit at 65K

[csk]

Is there a version of the Excel addin TDM reader that can

import more than 65K lines at a time into Excel 2007?

[Otmar]

Hello,

I am using version 2.0.13 of the TDM Excel Add-In for Microsoft Excel and I can import up to 1,000,000 values per channel in Excel 2007

Please make sure you have the latest version of the FREE Plugin (currently 2.0.14), you can find it here:

http://zone.ni.com/devzone/cda/epd/p/id/2944#0requirements

Please let me know if the latest plugin does not solve your issue.

[csk]

Thankyou, I was unaware of the newer rev

What is keeping it at the 1M limit?

Why isn't it tied to the version of Excel's row limit

than some arbitrary limit?

-Chet

[Brad_Turpin]

Hi csk,

The TDM Excel Add-in should in all Excel versions be row-limited by the maximum number of rows that Excel version can have.  If you find this is not the case, please report your exact Excel and Add-in versions so we can investigate.

Thanks,

Brad Turpin
DIAdem Product Support Engineer
National Instruments

[Otmar]

Hello Chet,

This limitation is due to Excel, it has nothing to do with the TDM Excel importer. I copied the following information from the Microsoft Excel Website: 

http://office.microsoft.com/en-us/excel/HA101656321033.aspx

Enjoy increased spreadsheet row and column capacity of 1 million rows by 16,000 columns that enables you to import and work with massive amounts of data and achieve faster calculation performance with support for dual or multicore processors.

In my experience, Excel gets pretty slow when working with large columns (try adding four columns of 1 million values in a fifth column). Excel is also limited to plotting 32,000 values from a column in a graph.

If you need to work with larger data files, I recommend you have a look at NI's DIAdem software here: http://www.ni.com/diadem/

DIAdem can process 65,535 columns with >2 billion values per column and is also very fast when processing and plotting this data.

I would be happy to show you more about DIAdem if you are interested. Feel free to contact me and we can set something up:

(512) 683-5452 or: otmar DOT foehner AT ni DOT com

[MGV]

I am using a Windows 7 64 bit laptop with excel 2007.  I have installed tdm_excel_add-in_2011.exe.  I get the message when I open a TDMS file that I am limited to 65,386 rows of data rather than 1,048,575 rows of data on my old laptop using Windows XP/64 and Excel 2007.  The data file has about 1.4E6 rows of data, but I only want to look at part of it in Excel.   Both appear to be running the same 3.3 version of the add-in (going to remove program and finding the version number).  The data file has about 1.4E6 rows of data, but I only want to look at part of it in Excel. 

Any idea why?

[JD_war_eagle]

Hi MGV,

As mentioned above, the row limit is a limitation of Excel itself, and not the TDMS add-in.  Excel 2007 should have a row limit of roughly a million rows.  Is it possible the worksheet you have open is in compatibility mode as discussed here?

[MGV]

I am using the add-in from Excel file saved as .XSLB (files are large 200 ,000+ KB) that has at least 170,000 rows data in one of the tab sheets. It is not saved as a 2003/2007 compatible file. I have also tried using the add-in from by just opening Excel with the same 65K limit.  I am trying to extract  about 75 seconds of 2000 Hz data from about 30 minutes of data.

[JD_war_eagle]

Hi MGV,

Try an import by right clicking the TDMS file in Windows Exporer and selecting Open With»Excel Importer while Excel is closed.  If the TDMS file contains more than the 1 million row limit of Excel then it should prompt you for a starting index for the import which should allow you to specify just the chunk of data you are interested in.  You are having no issues with other files XLS files which contain more than the 65k limit?  There is also this document which contains some information on other ways to manager TDMS data.