ni.com is currently undergoing scheduled maintenance.

Some services may be unavailable at this time. Please contact us for help or try again later.

LabVIEW

cancel
Showing results for 
Search instead for 
Did you mean: 

Data Entry Resolution

Solved!
Go to solution

I am working with a Numeric Control Properties (Data entry Tab) on the Front Panel Control (LabView 2010)

 

When I try to change the Increment, the field does not let me enter 0.00496324, it rounds it to 0.0050.

 

I tried to make changes to the Display Format Tab and tried different combinations of Ignore vs Coerce.

 

Any suggestions as to what I am doing wrong?

 

 

0 Kudos
Message 1 of 13
(4,748 Views)

I'm not sure exactly what all you have tried yet, but here's what immediately comes to mind.

 

Data Entry tab:  Have the check "Use Default Limits" checked.  This is unless you actually need to limit the range.  Otherwise, make the increment VERY small (as in less than 10^-10).

 

Display Format:  Change the precision type to Digits of Precision and make the number of digits at least 8.



There are only two ways to tell somebody thanks: Kudos and Marked Solutions
Unofficial Forum Rules and Guidelines
"Not that we are sufficient in ourselves to claim anything as coming from us, but our sufficiency is from God" - 2 Corinthians 3:5
0 Kudos
Message 2 of 13
(4,740 Views)

Does not work.

 

It rounds off to 4 digits, Also rounds off the Min and Max to 4 digits 

 

Want: 0.005993

 

Get:   0.0060

0 Kudos
Message 3 of 13
(4,730 Views)

Did you change the significant digits or digits of precision? You will need to change the number of precision.

Tim
GHSP
0 Kudos
Message 4 of 13
(4,724 Views)

Here is a screen shot of the Format

Download All
0 Kudos
Message 5 of 13
(4,720 Views)

The properties display has limited resolution. You can probably set the increment more accurately via a property node.

 

(This has been discussed before, let me try to find it...)

0 Kudos
Message 6 of 13
(4,715 Views)

@altenbach wrote:

The properties display has limited resolution. You can probably set the increment more accurately via a property node.

 

(This has been discussed before, let me try to find it...)


There's an idea to fix it. Were you thinking of that?

0 Kudos
Message 7 of 13
(4,710 Views)

I can try it and see if it works. But it would seem to be an issue with NI. And if memory serves me, I was able to do this in the past. However, I do not believe that I went to this small of a resolution.

 

What is the mechanism for getting NI to look into it?

 

Thanks for everybodies help.

 

0 Kudos
Message 8 of 13
(4,704 Views)

@CarmineS wrote:

Here is a screen shot of the Format


Ahhh, I totally misunderstood your problem.  Once again, a picture says 1000 words.



There are only two ways to tell somebody thanks: Kudos and Marked Solutions
Unofficial Forum Rules and Guidelines
"Not that we are sufficient in ourselves to claim anything as coming from us, but our sufficiency is from God" - 2 Corinthians 3:5
0 Kudos
Message 9 of 13
(4,660 Views)

Now that we are on the same page.

 

Is there any solution or am I just asking LabView to do something that it can not do?

 

thanks

0 Kudos
Message 10 of 13
(4,639 Views)