read data without loading the file in diadem?

[aparab]

hii guys,

the above mentioned  Q is a paradox,  but  if one has 100 files to be analyzed and  considering the time it takes to do that,  anyone will  try the same..

how do I read the .tdms file without  physically loading it. I have about 100 data files and have to work on each of them.

but diadem  takes a lot of time loading one  file  (about 20MB) . Work on its contents and then load another.

P.S. I am new to diadem scripting .

regards,

Akshay

[Otmar]

Hello Akshay,

DIAdem offers two features to deal with this situation directly.

1. "Selective Opening" of files - this feature will only load a subset of your data channels from a file, based on your selection. This can reduce load times because only the data required for the operations you wish to execute in DIAdem will be loaded. This feature is especially useful when your file contains hundreds of signals, or if you have very long channels. This feature can be found in the "File Open ..." dialog in the NAVIGATOR and can be scripted.
2. DIAdem also offers the ability to use files straight from disk. Go to "Settings: DIAdem Settings" and select the "Loading Behavior" setting. Make sure the setting there says "Load bulk data when changing channel data". The help system has a section on "Loading Bulk Data" in the NAVIGATOR help section that gives a lot more background.

In general, it helps to have data local (vs. a network drive) when processing large numbers of files or large files (or both). Network access adds considerable time to the loading process, so it might make sense to temporarily copy data to a local drive (or USB 3.0/eSATA attached external drive) to improve performance.

Also, if your files are large, you should use the 64-bit version of DIAdem and have sufficient memory (I recommend 8GB or more) to make sure DIAdem works as efficiently as possible.

For use cases such as yours, we will introduce a server based tool next year to have multiple processes run in parallel on a server - no more sequential running of dozens or hundreds of files on a client - you will be able to start a process on a server and it will automatically parallel process all your files with no need to have to wait on your client. Keep a look out for the "TDM server suite" over the next few months.

I hope this helps,

      Otmar

[aparab]

thankls otmar,

thts a helpful info.

I will try to use the selective Load  option.

regards

Akshay

[Brad_Turpin]

Hi Akshay,

A 20MB data file should load normally into DIAdem in less than a second.  What file format are you using?

Brad Turpin

DIAdem Product Support Engineer

National Instruments

[aparab]

Hi Brad,

that file-20MB is just a Starter.

well anothe issue is how do I Unload a loaded file, dont seem to find the right command

[tlahoz]

DataDelAll (or Data.Root.Clear) clears your data area. Is that what you need?