Opened 5 years ago

Last modified 3 years ago

#5823 new defect

Verification of FMI models has interpolation issues

Reported by: Francesco Casella Owned by: Lennart Ochel
Priority: critical Milestone:
Component: FMI Version:
Keywords: Cc: Andreas Heuermann

Description

As Lennart pointed out in the Annual Workshop, the reported verification performance of FMI on MSL 3.2.3 is abysmal: the verification success ratio is currently 68/424.

I checked some of the results. In many cases they are just plain wrong, see, e.g., this one.

However, in some cases I understand this mismatch is just an artifact. Consider for example this report. The FMI output is piecewise linear; the corners are fitting exactly with the reference results, but of course errors in-between those points can be quite large. I guess the problem here is just that the FMI is not correctly interpolating the results on the same grid as the reference results, or maybe just some problem with how the CSV compare is working with the FMI simulation results.

Change History (5)

comment:1 by Francesco Casella, 5 years ago

Summary: Verification of fmi models has interpolation issuesVerification of FMI models has interpolation issues

comment:2 by Andreas Heuermann, 4 years ago

Cc: Andreas Heuermann added

comment:3 by Francesco Casella, 4 years ago

Milestone: 1.16.01.17.0

Retargeted to 1.17.0 after 1.16.0 release

comment:4 by Francesco Casella, 4 years ago

Milestone: 1.17.01.18.0

Retargeted to 1.18.0 because of 1.17.0 timed release.

comment:5 by Francesco Casella, 3 years ago

Milestone: 1.18.0

Ticket retargeted after milestone closed

Note: See TracTickets for help on using tickets.