ni.com is currently undergoing scheduled maintenance.

Some services may be unavailable at this time. Please contact us for help or try again later.

LabVIEW

cancel
Showing results for 
Search instead for 
Did you mean: 

TDMS digits of precision

Solved!
Go to solution

I am developing an instrument to record voltages in the microVolt range from a Keithley 2420, and using TDMS to record them 'real-time'.  I just discovered that the TDMS file only has 6 digits of precision, which is not enough, I need at least 7.  I looked but did not see a way to increase this, so here is my lateset quandary.

 

I am using LV2012 on a Mac as well, so I know TDMS just got implimented this version, but do not recall any setting of this type when I used the Windows LV TDMS.

 

Thoughts?

 

Thank you,

 

  Vince

0 Kudos
Message 1 of 2
(2,488 Views)
Solution
Accepted by topic author _vbolling

Cancel this, I found that the display is only 6 digits of precision using the 'TDMS File Viewer', but when opened using the 'TDMS Read' it contains all the original precision.

 

Whew.

 

  Vince

0 Kudos
Message 2 of 2
(2,483 Views)