Changes between Initial Version and Version 1 of Ticket #5529


Ignore:
Timestamp:
2019-06-13T11:28:04Z (6 years ago)
Author:
massimo ceraolo
Comment:

Legend:

Unmodified
Added
Removed
Modified
  • Ticket #5529

    • Property Priority highnormal
    • Property Type defectdiscussion
  • Ticket #5529 – Description

    initial v1  
    44
    55This is because phases are stored in the model in radians as 6-digit strings corresponding to simple precision.
    6 I think that double precision should be used; in this case roundoff errors are much lower.
     6
     7I think that more should be used. I understand that it is not optimal to use the full double-precision for all model numbers, since .mo readability would reduce. I would not like to see 1.00000000000001 just to say 1.
     8Probably a good compromise is to convert internal binary representation in decimal form using, say, 10-12 digits, and truncating final zeros, whenever present.