Opened 5 years ago
Last modified 3 years ago
#5823 new defect
Verification of FMI models has interpolation issues
Reported by: | Francesco Casella | Owned by: | Lennart Ochel |
---|---|---|---|
Priority: | critical | Milestone: | |
Component: | FMI | Version: | |
Keywords: | Cc: | Andreas Heuermann |
Description
As Lennart pointed out in the Annual Workshop, the reported verification performance of FMI on MSL 3.2.3 is abysmal: the verification success ratio is currently 68/424.
I checked some of the results. In many cases they are just plain wrong, see, e.g., this one.
However, in some cases I understand this mismatch is just an artifact. Consider for example this report. The FMI output is piecewise linear; the corners are fitting exactly with the reference results, but of course errors in-between those points can be quite large. I guess the problem here is just that the FMI is not correctly interpolating the results on the same grid as the reference results, or maybe just some problem with how the CSV compare is working with the FMI simulation results.
Change History (5)
comment:1 by , 5 years ago
Summary: | Verification of fmi models has interpolation issues → Verification of FMI models has interpolation issues |
---|
comment:2 by , 4 years ago
Cc: | added |
---|
comment:3 by , 4 years ago
Milestone: | 1.16.0 → 1.17.0 |
---|
comment:4 by , 4 years ago
Milestone: | 1.17.0 → 1.18.0 |
---|
Retargeted to 1.18.0 because of 1.17.0 timed release.
Retargeted to 1.17.0 after 1.16.0 release