LabVIEW

cancel
Showing results for 
Search instead for 
Did you mean: 

LabView 8.5 ring control value precision

Hello everyone-

I'm trying to set up a ring control to select from a list of constants based on a descriptor- in this case, photodiode efficiency constants based on source wavelength.  My constants are on the order of 0.001 to 0.01; each has seven significant digits.

When I enter them into the "Value" field in the ring properties box, LabVIEW truncates down to 6 decimal places.  For example, 0.00998598 becomes 0.009986 whether I enter is as 0.00998598 or as 9.98598e-3.

I COULD put in a number in the range it will accept and multiply by an external factor, but that seems a stupid and unnecessary workaround.  Is this numerical truncation a "feature" or a bug?

Mike
0 Kudos
Message 1 of 7
(4,421 Views)
I see what you are saying in LV 8.5.  I would vote bug.  It seems that the dialog box should allow any value to be entered that is within the limits of the data representation selected for that control.  So if the control is set for DBL representation, it should allow a value beyond the 6th decimal point.
 
I think a possible work around would be to use the property node of the ring to set the strings and values[] to what you want.


Message Edited by Ravens Fan on 11-14-2007 05:28 PM
0 Kudos
Message 2 of 7
(4,414 Views)
Have you tried converting your table of constants into an array of strings and then feed the array to the "strings[]" (not value ) field in the ring properties box ?
0 Kudos
Message 3 of 7
(4,413 Views)
Try populating your values using the "strings and Values" property. I think it is only an input bug in the properties dialog box.
 
 
Use use this code once, then delete it from your main program.


Message Edited by altenbach on 11-14-2007 02:41 PM
Message 4 of 7
(4,403 Views)
Is there a CAR for this?
0 Kudos
Message 5 of 7
(4,355 Views)


altenbach wrote:
Is there a CAR for this?



This was reported to R&D (CAR #4FK5F2R0) for further investigation.

Roy

0 Kudos
Message 6 of 7
(4,329 Views)
For searchability:
 
This was reported to R&D (# 4FK5F2R0) for further investigation.
 
 
Brian Coalson

Software Engineer
National Instruments
0 Kudos
Message 7 of 7
(4,223 Views)