Add bot/test.sh
script and a generic test_compatibility_layer.sh
script
#213
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This adds a
bot/test.sh
script that lets the bot run the ReFrame tests on top of a compatibility layer that was just built, and also abot/check-test.sh
script that makes it report the test results back to the PR. The latter is just a copy of the one that we already use for the software layer.To make the testing a bit easier and also allow others to easily run the tests, I've also added a
test_compatibility_layer.sh
script: this script is similar to the existinginstall_compatibility_layer.sh
and runs the ReFrame tests with an existing or (temporary) pip-installed ReFrame on top of any compatibility layer that is available.Finally, it makes a small change to the
bot/build.sh
script as well to fix an issue with the version number being used, in the same way as I'm doing it for the test step: thejob_version
variable is currently always set to 2023.06 by the bot, even though the Ansible settings may contain another value. That doesn't really make sense to me, and this PR basically just ignores thejob_version
and uses the value set in the Ansible settings. That allows you to open a PR and easily test things for a new EESSI version by just adjusting Ansible'sdefault/main.yml
file, instead of having to change the bot configuration.All of this has been tested in #209, more specifically in #209 (comment).