From Friday, April 19th (11:00 PM CDT) through Saturday, April 20th (2:00 PM CDT), 2024, ni.com will undergo system upgrades that may result in temporary service interruption.

We appreciate your patience as we improve our online experience.

Home Community Discussion Forums Most Active Software Boards LabVIEW Topic

LabVIEW

cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

did inverse tangent not support FXP

Re: did inverse tangent not support FXP

‎09-25-2014 11:45 AM

@SASA1 wrote:

here is the vi there is a difference and pictures, there are differences

Yeah.  I would expect some differences.  The Double (DBL) has twice as many bits to represent an number than a Single (SGL).

GCentral
There are only two ways to tell somebody thanks: Kudos and Marked Solutions
Unofficial Forum Rules and Guidelines
"Not that we are sufficient in ourselves to claim anything as coming from us, but our sufficiency is from God" - 2 Corinthians 3:5
0 Kudos
Message 11 of 12
(452 Views)
Reply

Re: did inverse tangent not support FXP

‎09-25-2014 12:25 PM

SGL only gives you about 7 decimal digits of precision and you are doing quite a few operations, accumulating more rounding errors. The DBL result is significantly more accurate. SGL has the advantage of smaller data structures. You need to decide if it is precise enough. For example if the result drives a 16bit analog output, the difference is irrelevant.

LabVIEW Champion.
0 Kudos
Message 12 of 12
(438 Views)
Reply