06-02-2016 01:50 PM
Hi all,
I stuck with something which is look like weired for me. When I was trying to divide two numbers together I got different values in term of remainder as mentioned in theattached example .. please can any body help me to know the reason. thanks in advance
Best regards
Solved! Go to Solution.
06-02-2016 01:53 PM - edited 06-02-2016 01:53 PM
All I did was change the format of the X to show 6 digits of precision. It should be obvious from here.
06-02-2016 01:57 PM
Hi Crossrulz,
thank you so much for your quick reply
06-02-2016 02:01 PM - edited 06-02-2016 02:02 PM
Just what I thought, I fiddled a little with your VI and found the suspected root cause: precision. the default setting is "significant digits" which means how many overall digits are important to you, it can be changed to "digits of precision" which means how many digits past the decimal point you want displayed. LabView still keeps all of the information in the wire, regardless of how many digits you ask to be shown, and thus uses that in the subsequent calculation. You saw a number that rounded up, but in reality lacked a few decimals.
EDIT: Cross beat me to it, that's some fast coding!
06-02-2016 02:05 PM
yeah, you are right. I have know idea about it before.
Is there any way that make the labview follow the siginificant digits because it is really important for me to have an acuurate result? Thanks in advance
06-02-2016 02:05 PM
sorry, no idea**
06-02-2016 03:05 PM
Like I said, LabView ALWAYS follows the significant digits and the full precision of the result, regardless of what it shows you. The representation options are just for user readability, but LabView will always use the most accurate representation available unless you specify the opposite.