Output files and checklists

[galcik]

The proposed contribution includes:

(1) Ability to define output files for each lab. Output files are supplementary files produced during the evaluation and later included to the evaluation result. Output files are available for students and graders. They are useful in the case when evaluated programs are non-interactive visual programs (e.g. turtle graphics). Corresponding modifications have been proposed for vpl-xmlrpc-jail.

(2) Support for checklist reporting based on tags in the execution output. Description:

• each checklist line starts with Checklist :=>> and has format: type > details
• possible types: group (named group of checklist items - test), test (a test), error (error message related to the last test), warning (warning message related to the last test), note (information message related to the last test), internal (information message related to the last test which is available only for graders), OK (indicates that the last test passed), FAILED (indicates that the last test failed)
• Example:

 Checklist :=>> group > Group of tests
 Checklist :=>> test > First test
 Checklist :=>> note > Some note related to test
 Checklist :=>> OK
 Checklist :=>> test > Second test
 Checklist :=>> error > Some info, why test failed.
 Checklist :=>> warning > Maybe some warning.
 Checklist :=>> FAILED

(3) Generalized parsing of execution output (vpl_submission.class.php->parse_execution)