Opened 4 years ago

Last modified 3 years ago

#6263 new defect

Fix spurious remaining issues in the master testsuite

Reported by: Francesco Casella Owned by: Adrian Pop
Priority: high Milestone:
Component: Testing Framework Version: 1.16.0
Keywords: Cc: Martin Sjölund

Description

After @AnHeuermann merged in PR 6978, one cause for random improvements and regressions in each run of the entire testsuite was fixed for good. Unfortunately, we still have some issues that are causing this behaviour in a few models involving Python and DeviceDrivers (see below). This is no big deal, but it would be nice to get rid of them, and at long last getting clean regression reports.

The UDP models are reported as regressions even though the simulation log seems to indicate success. I guess there is something fishy in the way the simulation process is terminated that triggers a non-zero exit code or something. The Python examples just segfault every now and then.

Could someone please try to look into these two issues and fix them for good?

Change History (8)

comment:1 by Francesco Casella, 4 years ago

Here is another issue with TCP sockets.

comment:2 by Francesco Casella, 4 years ago

@sjoelund.se reports

The UDP issues are because they all use the same port. We'd need to run each worker in a separate docker instance and it's not that easy to make it all work the way I want. It would also double the time it takes to run the entire thing unless I spent additional time to make attaching to running containers the default :)

Maybe we should just find a way to selectively disable the tests we cannot run. Or at least make them fail consistently...

comment:3 by Francesco Casella, 4 years ago

Cc: Martin Sjölund added

comment:4 by Francesco Casella, 4 years ago

Summary: Fix spurious remaining issues in the newInst testsuiteFix spurious remaining issues in the master testsuite

comment:5 by Christoph Buchner <buchner@…>, 4 years ago

From looking at the log: Are you still supporting applications using Python 2, which has been unsupported since Jan 2020?

in reply to:  5 comment:6 by Francesco Casella, 4 years ago

Replying to Christoph Buchner <buchner@…>:

From looking at the log: Are you still supporting applications using Python 2, which has been unsupported since Jan 2020?

Good question, we should discuss this next year, see #6305.

comment:7 by Francesco Casella, 4 years ago

Milestone: 1.17.01.18.0

Retargeted to 1.18.0 because of 1.17.0 timed release.

comment:8 by Francesco Casella, 3 years ago

Milestone: 1.18.0

Ticket retargeted after milestone closed

Note: See TracTickets for help on using tickets.