LabVIEW

cancel
Showing results for 
Search instead for 
Did you mean: 

format string

I have a file with ASCII data (631000 rows)
I want to format the data to analyse and calcul.
My data have 5 numbers before the decimal separator and 6 after.
When I try to format, the result is fault after the separator.
If I try with data which have only 2 numbers before the decimal separator
(and six after) , the result is good.
Why and could you help me.

Thank you
0 Kudos
Message 1 of 3
(2,648 Views)
My guess is that you are using the read spreadsheet function. That function has a single precision float output format, a data type that is unable to hold numbers of the size and precision you have. You need to use a double precision version of the function, or read the data, and convert it to a DBL array using the spreadsheet string to array function.
0 Kudos
Message 2 of 3
(2,648 Views)
thank you
I will try thursday
0 Kudos
Message 3 of 3
(2,648 Views)