Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

e2e tests should run periodically and generate failure emails #2058

Closed
audiodude opened this issue Jul 7, 2024 · 0 comments · Fixed by #2059
Closed

e2e tests should run periodically and generate failure emails #2058

audiodude opened this issue Jul 7, 2024 · 0 comments · Fixed by #2059
Assignees
Milestone

Comments

@audiodude
Copy link
Member

The mwoffliner project has many e2e tests that run in CI and test that the project can actually properly process various live wikis and their data. This is great!

In fact, many of the unit tests themselves are actually e2e tests (see #2057)

However, since the external data itself could cause the tests to fail, and we expect this to happen fairly frequently, it would be useful to have the e2e tests run periodically, perhaps once per day (configurable). This would allow us to catch regressions early and not be "surprised" when trying to submit code and having e2e tests inexplicably failing.

Not sure if GitHub actions has this capability but it seems likely.

For example, this was a problem when trying to submit #2055, since it was blocked by the unrelated failure in #2056.

@audiodude audiodude changed the title e2e tests shoudl run periodically and generate failure emails Jul 7, 2024
@kelson42 kelson42 added this to the 1.14.0 milestone Jul 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
2 participants