From Friday, April 19th (11:00 PM CDT) through Saturday, April 20th (2:00 PM CDT), 2024, ni.com will undergo system upgrades that may result in temporary service interruption.

We appreciate your patience as we improve our online experience.

Home Community Discussion Forums Most Active Software Boards NI TestStand Topic

NI TestStand

cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

Transfering the results from labview to teststand. How it works?

Solved!
Go to solution

Transfering the results from labview to teststand. How it works?

‎06-23-2014 11:34 AM

Hi,

 

Sometimes, despite the tact that my LV code module returns the data with -exactly - two significant digits of precision, in TS report I see a number with sixteen digits of precision.

 

For example the data returned (not  only displayed) by the code module is -0.09 (DBL), but TS reports displays it to me as -0.0899999999999999.

 

Why it is like that?

View All (6)
0 Kudos
Message 1 of 2
(4,148 Views)
Reply
Solution
Accepted by topic author MimiKLM

Re: Transfering the results from labview to teststand. How it works?

‎06-23-2014 11:37 AM

Because you are transferring a double precision floating point number.  The display has nothing to do with the actual data.

GCentral
There are only two ways to tell somebody thanks: Kudos and Marked Solutions
Unofficial Forum Rules and Guidelines
"Not that we are sufficient in ourselves to claim anything as coming from us, but our sufficiency is from God" - 2 Corinthians 3:5
Message 2 of 2
(4,147 Views)
Reply