Set up Java logging with level TRACE in testsuite

[agraul]

What does this PR change?

Add Java logging (TRACE) in the testsuite

GUI diff

No difference.

Before:

After:

• DONE

Documentation

• No documentation needed: just changing the testsuite settings

• DONE

Test coverage

No code changes

• DONE

Links

Needed for debugging https://github.com/SUSE/spacewalk/issues/14057

• DONE

Changelogs

If you don't need a changelog check, please mark this checkbox:

• No changelog needed

If you uncheck the checkbox after the PR is created, you will need to re-run changelog_test (see below)

Re-run a test

If you need to re-run a test, please mark the related checkbox, it will be unchecked automatically once it has re-run:

• Re-run test "changelog_test"
• Re-run test "backend_unittests_pgsql"
• Re-run test "java_pgsql_tests"
• Re-run test "schema_migration_test_oracle"
• Re-run test "schema_migration_test_pgsql"
• Re-run test "susemanager_unittests"
• Re-run test "javascript_lint"
• Re-run test "spacecmd_unittests"

[Bischoff]

see remarks - one of them whould have prevented the thing from working - please test

[Bischoff]

When

[agraul]

Tbh this is the most confusing part since I could find step implementations for both When and And, but I think they work the same. I'll change it to When, just wondered if you have a policy around that

[Bischoff]

Yes, it works the same. Yes there's a policvy. And is a shortcut for "same as previous line" in the feature test (in this case When), it has no reason to appear in the step definitions.

[srbarrios]

Personally, I would prefer a parameter in Sumaform that allows handling the log level.

We need to keep in mind that all additional Cucumber scenarios added in the core stage increase the time of testing results (in all kinds of test executions) also it will generate some extra entries in the HTML report.

Also, I think that can be useful for other kinds of users, to have this option in Sumaform.

[agraul]

Personally, I would prefer a parameter in Sumaform that allows handling the log level.

For me either way works. Generally non-qa sumaform users (read: devs) should be able to adjust logging as they go but having it inside sumaform is not something I'm against.

We need to keep in mind that all additional Cucumber scenarios added in the core stage increase the time of testing results (in all kinds of test executions) also it will generate some extra entries in the HTML report.

You're right that this increases the core stage run time. I don't know if a sumaform approach would be quicker and how often you run sumaform in relation to test suite executions (is there a sumaform execution before every core stage?).

The idea is not to leave this in for eternity, but rather to catch the heisenbug with additional logging and then decide if it makes sense to keep it or not. Again, if this should rather go into sumaform, we can move it there (now or after solving heisenbug)

[srbarrios]

Personally, I would prefer a parameter in Sumaform that allows handling the log level.

For me either way works. Generally non-qa sumaform users (read: devs) should be able to adjust logging as they go but having it inside sumaform is not something I'm against.

We need to keep in mind that all additional Cucumber scenarios added in the core stage increase the time of testing results (in all kinds of test executions) also it will generate some extra entries in the HTML report.

You're right that this increases the core stage run time. I don't know if a sumaform approach would be quicker and how often you run sumaform in relation to test suite executions (is there a sumaform execution before every core stage?).

The idea is not to leave this in for eternity, but rather to catch the heisenbug with additional logging and then decide if it makes sense to keep it or not. Again, if this should rather go into sumaform, we can move it there (now or after solving heisenbug)

Ah ok, I did not catch that this was temporary to find an issue.
Ok, so let's keep it here, for now, just to avoid re-doing it in sumaform, but it might be interesting to create a card in sumaform, as that could be a "nice to have" there some day.

[agraul]

@srbarrios uyuni-project/sumaform#871