LabVIEW

cancel
Showing results for 
Search instead for 
Did you mean: 

TDMS digits of precision

Solved!
Go to solution

I am developing an instrument to record voltages in the microVolt range from a Keithley 2420, and using TDMS to record them 'real-time'.  I just discovered that the TDMS file only has 6 digits of precision, which is not enough, I need at least 7.  I looked but did not see a way to increase this, so here is my lateset quandary.

 

I am using LV2012 on a Mac as well, so I know TDMS just got implimented this version, but do not recall any setting of this type when I used the Windows LV TDMS.

 

Thoughts?

 

Thank you,

 

  Vince

0 Kudos
Message 1 of 2
(2,355 Views)
Solution
Accepted by topic author _vbolling

Cancel this, I found that the display is only 6 digits of precision using the 'TDMS File Viewer', but when opened using the 'TDMS Read' it contains all the original precision.

 

Whew.

 

  Vince

0 Kudos
Message 2 of 2
(2,350 Views)