Does the ISO-MME standard specify the format of the numeric values in the test channel files?
In particular, does it specify the number of decimal digits, or significant digits?
Is scientific format (with E, e.g. 1.003E-2) allowed, or required, or even disallowed?
Phil
Format and precision of numeric values
-
- Posts: 3
- Joined: Thu Oct 25, 2007 12:44 pm
- Location: MESSRING Systembau MSG GmbH, Krailling, Germany
Re: Format and precision of numeric values
The ISO MME standard only differs in "Integer" and "Float".
For the values of sample "Float" is specified.
"Float" has no restrictions for the number of decimal digits or the number of significant digits.
The scientific format is not dissallowed, therefore it is allowed.
Peter
For the values of sample "Float" is specified.
"Float" has no restrictions for the number of decimal digits or the number of significant digits.
The scientific format is not dissallowed, therefore it is allowed.
Peter