@stamourv Currently, the automated stepper tests fail, in the same way that they fail on DrDr

Looks like that error has been there for at least 3 weeks. That’s annoying.

How did you find out?

I found out they fail on the release by running them

I found out they fail on DrDr because I look at DrDr regularly

Ah, ok, just trying to understand which parts of our process work and which don’t.

So in this case, both “testing period” tests and regular CI find the bug. Good.

But CI was not enough to act on it, presumably because whoever’s responsible isn’t paying attention.

My guess is that the failure is somehow “ok” but the rest of us (and the automated tests) don’t know that

So either we need improve our CI SnR, or we need to tell John to pay more attention.

That’s also possible.

@samth: John got in touch, that test in an “xfail” in TR-speak, AFAIU.

So no problem there.

I’ll reply on that thread when I catch up with it.