Opened 6 years ago
Closed 6 years ago
#4997 closed defect (fixed)
Unreported simulation results on Hudson server
Reported by: | Francesco Casella | Owned by: | Martin Sjölund |
---|---|---|---|
Priority: | high | Milestone: | 1.13.0 |
Component: | Testing Framework | Version: | |
Keywords: | Cc: |
Description
There are currently over 20 ScalableTestSuite library test cases that apparently run correctly on Hudson, but whose simulation time and results are not included in the report, see, e.g.
https://libraries.openmodelica.org/branches/newInst/ScalableTestSuite_noopt/files/ScalableTestSuite_noopt_ScalableTestSuite.Electrical.TransmissionLine.ScaledExperiments.TransmissionLineModelica_N_640.sim
https://libraries.openmodelica.org/branches/newInst/ScalableTestSuite_noopt/files/ScalableTestSuite_noopt_ScalableTestSuite.Power.ConceptualPowerSystem.ScaledExperiments.PowerSystemStepLoad_N_4_M_4.sim
https://libraries.openmodelica.org/branches/newInst/ScalableTestSuite_noopt/files/ScalableTestSuite_noopt_ScalableTestSuite.Thermal.Advection.ScaledExperiments.SteamPipe_N_160.sim
https://libraries.openmodelica.org/branches/newInst/ScalableTestSuite_noopt/files/ScalableTestSuite_noopt_ScalableTestSuite.Thermal.HeatExchanger.ScaledExperiments.CocurrentHeatExchangerEquations_N_80.sim
Please fix that ASAP, otherwise the coverage tests will be incorrectly worse than reality
Change History (3)
comment:1 by , 6 years ago
comment:2 by , 6 years ago
Ouch, wrong, returning false means the comparison has differences, not that it failed.
comment:3 by , 6 years ago
Resolution: | → fixed |
---|---|
Status: | new → closed |
After 97ad0bf47 this seems to be back to normal, see, e.g., ScalableTestSuite_noopt
Unfortunately #4980 is still unsolved.
I tried ScalableTestSuite.Electrical.TransmissionLine.ScaledExperiments.TransmissionLineModelica_N_640 on windows and we get this:
for
which means that the function fails, it returns false and the names of variables it cannot compare. Strangely enough the files *are* generated on windows.