From 300def07403d071236b1e2a615d1f075996b61c1 Mon Sep 17 00:00:00 2001 From: Philipp Wendler Date: Mon, 6 Feb 2023 13:22:47 +0100 Subject: [PATCH] Changelog for BenchExec 3.16 --- CHANGELOG.md | 24 ++++++++++++++++++++++++ 1 file changed, 24 insertions(+) diff --git a/CHANGELOG.md b/CHANGELOG.md index 30ea33ca0..0ca5b6393 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -9,6 +9,30 @@ SPDX-License-Identifier: Apache-2.0 # BenchExec Changelog +## BenchExec 3.16 + +This release works only on Python 3.7 and newer! + +- Improve performance of the "Merging results" step of `table-generator`. + In the common case of all run sets having the same set of tasks, + this step is now much faster. +- Avoid deadlock in `table-generator` for cases with many child processes + and heavy system load. +- On systems with many cores and if there are many input files or columns, + `table-generator` will now use more than 32 child processes. +- Support the scoring schema used in SV-COMP'23 for witness validators, + and show the witness category as part of the task identifier in tables. + Note that just like for the category `correct-unconfirmed` + external postprocessing of the results is necessary for this. +- If the pattern inside a `` tag in the benchmark definition + does not match a file, + BenchExec now terminates with an error instead of just logging a warning. +- Improved logging in `table-generator`. + The log messages about missing run results and missing properties, + which could occur many times in certain use cases, are now omitted. + Instead, some numbers about the size of the resulting tables + and the number of missing results will be logged. + ## BenchExec 3.15 - Updated installation instructions for Debian.