Skip to content

Commit

Permalink
Release/0.8.9 (#94)
Browse files Browse the repository at this point in the history
* Status info fix

* Sprk 252 (#40)

* Change documentation template

* added theme to requirements

* Fixed Index page of documentation

* Included github action file

* Test GitHub Actions

* test v2

* test 3

* test 4

* test 5 (?)

* test 6

* test7

* test 8

* test 9

* test 10 ?

* another one

* New approach

* check

* spelling?

* this is getting sad

* lesgo

* wild test

* Polishing

* Deleted build files to try something out

* Changed the workflow to run on push on main

* small fixes

* Sparkle wait now shows a table

* Added output-verbosity to settings

* sparkle wait now also shows partition

* Restructering. Removed Extensive, rename REDUCED to QUIET, removed partition

* Finished new wait command

* Flake is killing me

* Moved vreebosity from output to general (settings)

* Added check interval to settings

* Jobs are sorted based on status

* Fixed flake8

* Added TEXT class and implemented in sparkle wait

* Minor changes

---------

Co-authored-by: Noah Peil <[email protected]>

* Sprk 283 (#42)

* Print update

* Refactoring

* fixing comments

* Bug fixes dataframes

* first implementation design of selector OO

* refactoring file

* Refactoring sparkle to use selector OO solution

* flake8

* Removing multiple file creating from perfect selector computation

* refactoring copy operations out of marginal contribution

* performance dataframe fixes

* Changing references to Settings file

* Forgot a few

* Testing changing reference to gv.settings to settings

* Refactoring usage of marginal contribution

* flake8

* Updating test

* bugfix

* Fixing verbosity

* Flake8 + pytest fixes

* bugfix

* pytest mock fixes

* more usefull error printing selector

* test fix

* bugfixes

* bugfixes

* reordering tests

* flake8

* new test files

* Removing dead command

* Removing dead test

* New RunRunner version

* Test fixes for new runrunner version

* Showing new column based on runrunner update in sparkle wait

* fix for pytest

* Sprk 160 (#44)

* Prepping tests to use all a different scenario file

* Fixing tests to always use specific test set

* Removing dead variables from global variables

* Minor changes ablation

* reducing git ignore

* Removing logging from Platform (CLI functionality)

* Removing non-CLI references to global variables, moving sparkle log

* settings mistake

* Creating init for CLI packages

* Pre release test branch (#45)

* Trying to move global variables

* init fllake8

* flake8

* Moving tools to be part of Sparkle lib

* Updating setup to not include the tests

* renaming latex dir

* Creating manifest, updating setup.py

* flake8

* Moving Components into sparkle dir to prepare workable pip install

* Update pull-request.yml (#49)

* Update pull-request.yml

* Update pull-request.yml

* SPRK 151 (#46)

* Flake8 pre-commit

* Pre commit test

* Disable test for pre commit

* Updating change log and contributing

* Reducing test files bloating

* Settings mistake

* Removing unused test files

* Unused test files

* Sprk 320 (#50)

* Fixing bugs in Ablation

* First class design, bug fixes, flake8

* Refactoring ablation object usage

* fixing pytests

* Moving ablation

* Bug fixes for report generation

* Bugfixes ablation, refactoring, fixing timezone on smac target algorithm

* Adding example download capability to initialise command

* Simplifying + comment for init

* Updating changelog

* Simplifying wait command

* Minor variable name and comments fixes

* Removing dead variables from global var

* Fixes regarding portfolio selector methods

* Renaming symbols

* Minor refactoring

* Minor refactoring

* Refactoring method definitions

* Bugfixes for initialise

* Bugfix init

* Removing excess test files

* Moving CLI tests to tests folder

* Removing unnecessary methods

* Refactoring function definitions

* Simplifying sat_help methods

* sat verify bug fix

* Old code reversal

* Refactoring snapshit

* snapshot bugfix

* Logger typing fixes

* Minor fixes

* Refactoring file help

* Redundant string removal

* Fixes

* Sprk 295 (#51)

* Creating parser for solver wrapper output

* Change solver status from string to enum

* Completed docstring

* Merge dev into SPRK-295

---------

Co-authored-by: ngcp1 <[email protected]>

* Remove the exclusive flag when running the portfolio selector (#52)

* Moving CLI to a better place

* Bug fix seed being none for solver

* Bugfix run sparkle portfolio core

* Bugfixes portfolio selector

* Version 0.8.3 release (#53)

* Sprk 76 (#7)

* Added cpu_time & solver_calls to configuration budget (missing from run_ablation & get_smac_settings)

* Fixed some flake8 and pytest errors

* Refactor

* Updating Runsolver and placing compilation responsibility in platform initialisation (#3)

* Updating runsolver

* Fixed runsolver make

* Updating runsolver and gitignore structure for local compilation

* Removing runsolver as part of Sparkle, must now be compiled by user

* Fixing sparkle platform intialization with Runsolver compilation

* Refactoring, flake8

* Fixes for instant compilation of runsolver (Conda install of required c packages and necessary path modding)

---------

Co-authored-by: Thijs Snelleman <[email protected]>

* Run workflow on on pull request (#6)

* Update SWIG (#5)

* Small flake8 fix

* Small fixes

* Small fixes

* Sprk 270 (#8)

* temp design check in

* Flake8 fixes

* Refactoring validator as preparation

* Preparing configurator to use validator

* Attempting fix for Github

* pytest fix for gen rep

* Pytest fix for validation scenario

* Re-enabling pytest

* Prepping for testing

* Intermediate check in

* Moving configurator implementations in settings

* Bugfixes moving configurator

* Setting up general configurator CLI

* Fixing configurator writing output configurations from each run to a unified CSV

* Validator and solver running fix

* flake8 fix

* Fixing command calls

* Fixing settings

* Fixing variable name in test

* Continuing work on configurators, cleaning up Components directory

* Removing unused files

* Intermediate check in to check issue with runsolver

* Found bug in smac target algorithm, was using the wrong runsolver output file to detect runtime.

* Updating solver wrapper to be able to read configurations from file

* Bugfixes SMAC wrappers

* Reverting sparkle settings to original

* Reverting slurm settings to original

* Moving direcotries to unified output directory

* Correcting file structure

* Refactoring, flake8

* Wrapping up file organisation

* Refactoring code to work with new implementation

* Bug fixes

* Fixing code for report generation

* flake8

* Fixing solver input for validate after config to match amount of configurations

* Attempted bug fix

* Bugfix for ablation?

* Bugfix ablation

* Refactoring configure_solver_help content

* Renaming to make a closer match to current contents

* description rename

* Fixing rename for imports

* flake8

* pytest fixes

* Fixing variables

* pytest fix

* Pytest fix

* Pytest fix

* pytest fixes

* Fix

* Pytest fix

* removing dead code from test

* Final fixes

* bugfix

* pytest fix

* Removing smac references from global variables

* Removing hard coded smacv2 references from Sparkle all together

* PR changes

* Minor fixes

* flake8

* Minor fixes

* Forgot to check in settings file

* Bugfixes for ablation

* Changed Default CPU value

* Added alias to userguide & settings

* small fix

* corrected method name

* Set solver_calls and cpu_time default to None

* flake8 hates me

---------

Co-authored-by: Thijs Snelleman <[email protected]>
Co-authored-by: Thijs Snelleman <[email protected]>
Co-authored-by: Hadar Shavit <[email protected]>

* Fixing execute permission on example

* Release/0.8.2 (#30)

* Refactor

* Updating Runsolver and placing compilation responsibility in platform initialisation (#3)

* Updating runsolver

* Fixed runsolver make

* Updating runsolver and gitignore structure for local compilation

* Removing runsolver as part of Sparkle, must now be compiled by user

* Fixing sparkle platform intialization with Runsolver compilation

* Refactoring, flake8

* Fixes for instant compilation of runsolver (Conda install of required c packages and necessary path modding)

---------

Co-authored-by: Thijs Snelleman <[email protected]>

* Run workflow on on pull request (#6)

* Update SWIG (#5)

* Sprk 270 (#8)

* temp design check in

* Flake8 fixes

* Refactoring validator as preparation

* Preparing configurator to use validator

* Attempting fix for Github

* pytest fix for gen rep

* Pytest fix for validation scenario

* Re-enabling pytest

* Prepping for testing

* Intermediate check in

* Moving configurator implementations in settings

* Bugfixes moving configurator

* Setting up general configurator CLI

* Fixing configurator writing output configurations from each run to a unified CSV

* Validator and solver running fix

* flake8 fix

* Fixing command calls

* Fixing settings

* Fixing variable name in test

* Continuing work on configurators, cleaning up Components directory

* Removing unused files

* Intermediate check in to check issue with runsolver

* Found bug in smac target algorithm, was using the wrong runsolver output file to detect runtime.

* Updating solver wrapper to be able to read configurations from file

* Bugfixes SMAC wrappers

* Reverting sparkle settings to original

* Reverting slurm settings to original

* Moving direcotries to unified output directory

* Correcting file structure

* Refactoring, flake8

* Wrapping up file organisation

* Refactoring code to work with new implementation

* Bug fixes

* Fixing code for report generation

* flake8

* Fixing solver input for validate after config to match amount of configurations

* Attempted bug fix

* Bugfix for ablation?

* Bugfix ablation

* Refactoring configure_solver_help content

* Renaming to make a closer match to current contents

* description rename

* Fixing rename for imports

* flake8

* pytest fixes

* Fixing variables

* pytest fix

* Pytest fix

* Pytest fix

* pytest fixes

* Fix

* Pytest fix

* removing dead code from test

* Final fixes

* bugfix

* pytest fix

* Removing smac references from global variables

* Removing hard coded smacv2 references from Sparkle all together

* PR changes

* Minor fixes

* flake8

* Minor fixes

* Forgot to check in settings file

* Bugfixes for ablation

* SPRK-88 (#12)

* Creating unified file for CLI arguments

* Aggregate all CLI arguments into argparse_custom

* Made CLI programs use centralised ArgumentContainers

* Fixed SolverPathArgument

* Sprk 76 (#7)

* Added cpu_time & solver_calls to configuration budget (missing from run_ablation & get_smac_settings)

* Fixed some flake8 and pytest errors

* Refactor

* Updating Runsolver and placing compilation responsibility in platform initialisation (#3)

* Updating runsolver

* Fixed runsolver make

* Updating runsolver and gitignore structure for local compilation

* Removing runsolver as part of Sparkle, must now be compiled by user

* Fixing sparkle platform intialization with Runsolver compilation

* Refactoring, flake8

* Fixes for instant compilation of runsolver (Conda install of required c packages and necessary path modding)

---------

Co-authored-by: Thijs Snelleman <[email protected]>

* Run workflow on on pull request (#6)

* Update SWIG (#5)

* Small flake8 fix

* Small fixes

* Small fixes

* Sprk 270 (#8)

* temp design check in

* Flake8 fixes

* Refactoring validator as preparation

* Preparing configurator to use validator

* Attempting fix for Github

* pytest fix for gen rep

* Pytest fix for validation scenario

* Re-enabling pytest

* Prepping for testing

* Intermediate check in

* Moving configurator implementations in settings

* Bugfixes moving configurator

* Setting up general configurator CLI

* Fixing configurator writing output configurations from each run to a unified CSV

* Validator and solver running fix

* flake8 fix

* Fixing command calls

* Fixing settings

* Fixing variable name in test

* Continuing work on configurators, cleaning up Components directory

* Removing unused files

* Intermediate check in to check issue with runsolver

* Found bug in smac target algorithm, was using the wrong runsolver output file to detect runtime.

* Updating solver wrapper to be able to read configurations from file

* Bugfixes SMAC wrappers

* Reverting sparkle settings to original

* Reverting slurm settings to original

* Moving direcotries to unified output directory

* Correcting file structure

* Refactoring, flake8

* Wrapping up file organisation

* Refactoring code to work with new implementation

* Bug fixes

* Fixing code for report generation

* flake8

* Fixing solver input for validate after config to match amount of configurations

* Attempted bug fix

* Bugfix for ablation?

* Bugfix ablation

* Refactoring configure_solver_help content

* Renaming to make a closer match to current contents

* description rename

* Fixing rename for imports

* flake8

* pytest fixes

* Fixing variables

* pytest fix

* Pytest fix

* Pytest fix

* pytest fixes

* Fix

* Pytest fix

* removing dead code from test

* Final fixes

* bugfix

* pytest fix

* Removing smac references from global variables

* Removing hard coded smacv2 references from Sparkle all together

* PR changes

* Minor fixes

* flake8

* Minor fixes

* Forgot to check in settings file

* Bugfixes for ablation

* Changed Default CPU value

* Added alias to userguide & settings

* small fix

* corrected method name

* Set solver_calls and cpu_time default to None

* flake8 hates me

---------

Co-authored-by: Thijs Snelleman <[email protected]>
Co-authored-by: Thijs Snelleman <[email protected]>
Co-authored-by: Hadar Shavit <[email protected]>

* Split PerformanceMeasureArgument in two and remove current value information for certain CLI arguments

* Wrap-up of restructuring argparse arguments

* Actual implementation of SPRK-88

* Small fix to generate_report

* Removing print statement, correcting my own mistakes for argsv

* Formatting string without + operator

---------

Co-authored-by: Noah Peil <[email protected]>
Co-authored-by: Brian Schiller <[email protected]>
Co-authored-by: Thijs Snelleman <[email protected]>
Co-authored-by: Thijs Snelleman <[email protected]>
Co-authored-by: Hadar Shavit <[email protected]>

* Fix typo (#10)

Minor change

* bugfix in dev

* SPRK-120 (#15)

* Implementation of SPRK-120

* Change requests

---------

Co-authored-by: Noah Peil <[email protected]>

* Added .kwargs to argparse argument

* Replaced * with ** for kwargs

* Adding Aaron to contributors list

* SPRK-128: Rename clips_per_node (#16)

* Rename clis_per_node

* Requests

* Adding Aaron to contributors list

---------

Co-authored-by: Noah Peil <[email protected]>
Co-authored-by: Thijs Snelleman <[email protected]>

* Fixing permissions

* Fixing bug in remove solver, renaming global_variables symbol from sgh (sparkle_global_help) to gv (#14)

* SPRK-55 (#13)

* Fixes for removing instances from Sparkle through CLI

* Intermediate check

* ignoring runsolver file from compilation

* Fixing all nicknames in commands for configuration

* bugfix from different ticket

* Refactoring and print improvement

* Bugfix feature data frame

* Refactoring useless/dead code

* bug fix args branch

* nickname support run sparkle portfolio selector

* Nickname support for generate report

* flake8

* Simplified extractor nicknaming code

* Simplifying remove instances nickname

* Simplifying remove solver

* Refactoring

* flake8

* Bugfix

* sh test fix

* Preventing the nickname handler from crashing when args are None

* test fix

---------

Co-authored-by: Noah Peil <[email protected]>

* Sprk 80 - [M] Add pcs validity and running check to wrappers (#17)

* Add check argument

* Merge duplicate check pcs functions

* Add pcsparser

* Start with running an instances to check if wrapper runs

* Repo change

* Do checks before adding. Change executable check return type

* Merge and comment on wrong executable check

* fixes

* flake8

* enviroment fix

* Changelog

* PR comments fixes

* Move messages from reading the pcs files to the cli part

* Sprk 285 (#19)

* Fixed check_settings_changes KeyError

* Finishing SPRK-285

* Revert run_on option strings to lowercase again

* Resolved flake8 issues

---------

Co-authored-by: Noah Peil <[email protected]>

* Sprk 220 (#9)

* Add option to set autofolio's timeout

* fixup! Add option to set autofolio's timeout

* Fix autofolio timeout

* Minor fixes selection example

* Updating docs for runsolver (#26)

* Docs bugfix

* Update about usage for docs

* typo

* trying to fix docs compilation

* Bugfixes for docs gen

* removing print statement

* Updating requirements

* Sprk 102 (#25)

* Remove redundant code

* Added default extractor wrapper

* Modified Wrapper

* Implemented new wrapper in add_feature_extractor

* rewrote extractor wrapper code

* Fixed flake8 mistakes

* Some fixes (mostly path related)

* Requested Changes

* Updates

* Few more changes

* Removing dead imports

* Implemented changes to extractor wrapper

* Extractor now works

* Removed print statements

* Minor code layout changes

* standardising

* Wrapping up wrapper changes for extractors

---------

Co-authored-by: Thijs Snelleman <[email protected]>

* Improve status monitoring with logfile status (#28)

* First implementation of monitoring with logfile status

* Formatting and variable renaming

* More formatting

---------

Co-authored-by: Noah Peil <[email protected]>

* Sprk 269 (#18)

* refactor

* Removing construct parallel portfolio from Sparkle

* flake8

* Removing traces of construct parallel portfolio

* flake8

* Adding in solver wrappers for solvers with outdated wrappers

* Bugfixes

* Big changes

* wrapping up report refactoring

* flake8 adapt

* Clean up

* Moving code to more logical place

* flake8

* bugfix from refactor

* minor refactor

* flake8 fixes

* Updating parallel portfolio arguments/settings

* Renaming the command

* bugfix

* Moving arguments to argparse custom

* Bugfix hadar

* Removing dead variables

* Refactoring variables pt 2

* Refactoring gv method

* Bugfixes

* Load snapshot bugfix

* remove feature extractor bugfix

* Minor bug fixes

* flake8

* CLI pass through comments fix

* Bug fixes

* about test fix

* About fix

* Bugfix report generation

* Forgotten print statement

* Reverting refactoring

* Updating CLI test

* Fixing bug

* Final bug fix for test

* Removing dead files

* Bugfixes remove instances CLI test

* remove multi instances bugfix

* CLI test fixes

* Refactoring SMAC

* Refactoring test bugs fix

* Updating changelog

* Bugfix wrapper, updating changelog, minor refactoring

* Minor bug fix solver wrapper

* Bug fix validator

* Bug fixes in compute features / selection example

* Removing useless print statement

* flake8 fix

* Removing dead variable

* Adding file lock for selector writing to performance data csvs

* flake8

* Report bugfixing

* Bug fixes report

* Changelog + bugfix

* bugfix feature extractor removal

---------

Co-authored-by: Hadar Shavit <[email protected]>
Co-authored-by: Noah Peil <[email protected]>
Co-authored-by: Noah Peil <[email protected]>
Co-authored-by: Brian Schiller <[email protected]>
Co-authored-by: Koen van der Blom <[email protected]>
Co-authored-by: Jeroen Rook <[email protected]>

* Version change

* Small fixes

---------

Co-authored-by: Brian Schiller <[email protected]>
Co-authored-by: Hadar Shavit <[email protected]>
Co-authored-by: Noah Peil <[email protected]>
Co-authored-by: Noah Peil <[email protected]>
Co-authored-by: Koen van der Blom <[email protected]>
Co-authored-by: Jeroen Rook <[email protected]>

* Release/0.8.3 (#55)

* Sprk 76 (#7)

* Added cpu_time & solver_calls to configuration budget (missing from run_ablation & get_smac_settings)

* Fixed some flake8 and pytest errors

* Refactor

* Updating Runsolver and placing compilation responsibility in platform initialisation (#3)

* Updating runsolver

* Fixed runsolver make

* Updating runsolver and gitignore structure for local compilation

* Removing runsolver as part of Sparkle, must now be compiled by user

* Fixing sparkle platform intialization with Runsolver compilation

* Refactoring, flake8

* Fixes for instant compilation of runsolver (Conda install of required c packages and necessary path modding)

---------

Co-authored-by: Thijs Snelleman <[email protected]>

* Run workflow on on pull request (#6)

* Update SWIG (#5)

* Small flake8 fix

* Small fixes

* Small fixes

* Sprk 270 (#8)

* temp design check in

* Flake8 fixes

* Refactoring validator as preparation

* Preparing configurator to use validator

* Attempting fix for Github

* pytest fix for gen rep

* Pytest fix for validation scenario

* Re-enabling pytest

* Prepping for testing

* Intermediate check in

* Moving configurator implementations in settings

* Bugfixes moving configurator

* Setting up general configurator CLI

* Fixing configurator writing output configurations from each run to a unified CSV

* Validator and solver running fix

* flake8 fix

* Fixing command calls

* Fixing settings

* Fixing variable name in test

* Continuing work on configurators, cleaning up Components directory

* Removing unused files

* Intermediate check in to check issue with runsolver

* Found bug in smac target algorithm, was using the wrong runsolver output file to detect runtime.

* Updating solver wrapper to be able to read configurations from file

* Bugfixes SMAC wrappers

* Reverting sparkle settings to original

* Reverting slurm settings to original

* Moving direcotries to unified output directory

* Correcting file structure

* Refactoring, flake8

* Wrapping up file organisation

* Refactoring code to work with new implementation

* Bug fixes

* Fixing code for report generation

* flake8

* Fixing solver input for validate after config to match amount of configurations

* Attempted bug fix

* Bugfix for ablation?

* Bugfix ablation

* Refactoring configure_solver_help content

* Renaming to make a closer match to current contents

* description rename

* Fixing rename for imports

* flake8

* pytest fixes

* Fixing variables

* pytest fix

* Pytest fix

* Pytest fix

* pytest fixes

* Fix

* Pytest fix

* removing dead code from test

* Final fixes

* bugfix

* pytest fix

* Removing smac references from global variables

* Removing hard coded smacv2 references from Sparkle all together

* PR changes

* Minor fixes

* flake8

* Minor fixes

* Forgot to check in settings file

* Bugfixes for ablation

* Changed Default CPU value

* Added alias to userguide & settings

* small fix

* corrected method name

* Set solver_calls and cpu_time default to None

* flake8 hates me

---------

Co-authored-by: Thijs Snelleman <[email protected]>
Co-authored-by: Thijs Snelleman <[email protected]>
Co-authored-by: Hadar Shavit <[email protected]>

* Fixing execute permission on example

* Release/0.8.2 (#30)

* Refactor

* Updating Runsolver and placing compilation responsibility in platform initialisation (#3)

* Updating runsolver

* Fixed runsolver make

* Updating runsolver and gitignore structure for local compilation

* Removing runsolver as part of Sparkle, must now be compiled by user

* Fixing sparkle platform intialization with Runsolver compilation

* Refactoring, flake8

* Fixes for instant compilation of runsolver (Conda install of required c packages and necessary path modding)

---------

Co-authored-by: Thijs Snelleman <[email protected]>

* Run workflow on on pull request (#6)

* Update SWIG (#5)

* Sprk 270 (#8)

* temp design check in

* Flake8 fixes

* Refactoring validator as preparation

* Preparing configurator to use validator

* Attempting fix for Github

* pytest fix for gen rep

* Pytest fix for validation scenario

* Re-enabling pytest

* Prepping for testing

* Intermediate check in

* Moving configurator implementations in settings

* Bugfixes moving configurator

* Setting up general configurator CLI

* Fixing configurator writing output configurations from each run to a unified CSV

* Validator and solver running fix

* flake8 fix

* Fixing command calls

* Fixing settings

* Fixing variable name in test

* Continuing work on configurators, cleaning up Components directory

* Removing unused files

* Intermediate check in to check issue with runsolver

* Found bug in smac target algorithm, was using the wrong runsolver output file to detect runtime.

* Updating solver wrapper to be able to read configurations from file

* Bugfixes SMAC wrappers

* Reverting sparkle settings to original

* Reverting slurm settings to original

* Moving direcotries to unified output directory

* Correcting file structure

* Refactoring, flake8

* Wrapping up file organisation

* Refactoring code to work with new implementation

* Bug fixes

* Fixing code for report generation

* flake8

* Fixing solver input for validate after config to match amount of configurations

* Attempted bug fix

* Bugfix for ablation?

* Bugfix ablation

* Refactoring configure_solver_help content

* Renaming to make a closer match to current contents

* description rename

* Fixing rename for imports

* flake8

* pytest fixes

* Fixing variables

* pytest fix

* Pytest fix

* Pytest fix

* pytest fixes

* Fix

* Pytest fix

* removing dead code from test

* Final fixes

* bugfix

* pytest fix

* Removing smac references from global variables

* Removing hard coded smacv2 references from Sparkle all together

* PR changes

* Minor fixes

* flake8

* Minor fixes

* Forgot to check in settings file

* Bugfixes for ablation

* SPRK-88 (#12)

* Creating unified file for CLI arguments

* Aggregate all CLI arguments into argparse_custom

* Made CLI programs use centralised ArgumentContainers

* Fixed SolverPathArgument

* Sprk 76 (#7)

* Added cpu_time & solver_calls to configuration budget (missing from run_ablation & get_smac_settings)

* Fixed some flake8 and pytest errors

* Refactor

* Updating Runsolver and placing compilation responsibility in platform initialisation (#3)

* Updating runsolver

* Fixed runsolver make

* Updating runsolver and gitignore structure for local compilation

* Removing runsolver as part of Sparkle, must now be compiled by user

* Fixing sparkle platform intialization with Runsolver compilation

* Refactoring, flake8

* Fixes for instant compilation of runsolver (Conda install of required c packages and necessary path modding)

---------

Co-authored-by: Thijs Snelleman <[email protected]>

* Run workflow on on pull request (#6)

* Update SWIG (#5)

* Small flake8 fix

* Small fixes

* Small fixes

* Sprk 270 (#8)

* temp design check in

* Flake8 fixes

* Refactoring validator as preparation

* Preparing configurator to use validator

* Attempting fix for Github

* pytest fix for gen rep

* Pytest fix for validation scenario

* Re-enabling pytest

* Prepping for testing

* Intermediate check in

* Moving configurator implementations in settings

* Bugfixes moving configurator

* Setting up general configurator CLI

* Fixing configurator writing output configurations from each run to a unified CSV

* Validator and solver running fix

* flake8 fix

* Fixing command calls

* Fixing settings

* Fixing variable name in test

* Continuing work on configurators, cleaning up Components directory

* Removing unused files

* Intermediate check in to check issue with runsolver

* Found bug in smac target algorithm, was using the wrong runsolver output file to detect runtime.

* Updating solver wrapper to be able to read configurations from file

* Bugfixes SMAC wrappers

* Reverting sparkle settings to original

* Reverting slurm settings to original

* Moving direcotries to unified output directory

* Correcting file structure

* Refactoring, flake8

* Wrapping up file organisation

* Refactoring code to work with new implementation

* Bug fixes

* Fixing code for report generation

* flake8

* Fixing solver input for validate after config to match amount of configurations

* Attempted bug fix

* Bugfix for ablation?

* Bugfix ablation

* Refactoring configure_solver_help content

* Renaming to make a closer match to current contents

* description rename

* Fixing rename for imports

* flake8

* pytest fixes

* Fixing variables

* pytest fix

* Pytest fix

* Pytest fix

* pytest fixes

* Fix

* Pytest fix

* removing dead code from test

* Final fixes

* bugfix

* pytest fix

* Removing smac references from global variables

* Removing hard coded smacv2 references from Sparkle all together

* PR changes

* Minor fixes

* flake8

* Minor fixes

* Forgot to check in settings file

* Bugfixes for ablation

* Changed Default CPU value

* Added alias to userguide & settings

* small fix

* corrected method name

* Set solver_calls and cpu_time default to None

* flake8 hates me

---------

Co-authored-by: Thijs Snelleman <[email protected]>
Co-authored-by: Thijs Snelleman <[email protected]>
Co-authored-by: Hadar Shavit <[email protected]>

* Split PerformanceMeasureArgument in two and remove current value information for certain CLI arguments

* Wrap-up of restructuring argparse arguments

* Actual implementation of SPRK-88

* Small fix to generate_report

* Removing print statement, correcting my own mistakes for argsv

* Formatting string without + operator

---------

Co-authored-by: Noah Peil <[email protected]>
Co-authored-by: Brian Schiller <[email protected]>
Co-authored-by: Thijs Snelleman <[email protected]>
Co-authored-by: Thijs Snelleman <[email protected]>
Co-authored-by: Hadar Shavit <[email protected]>

* Fix typo (#10)

Minor change

* bugfix in dev

* SPRK-120 (#15)

* Implementation of SPRK-120

* Change requests

---------

Co-authored-by: Noah Peil <[email protected]>

* Added .kwargs to argparse argument

* Replaced * with ** for kwargs

* Adding Aaron to contributors list

* SPRK-128: Rename clips_per_node (#16)

* Rename clis_per_node

* Requests

* Adding Aaron to contributors list

---------

Co-authored-by: Noah Peil <[email protected]>
Co-authored-by: Thijs Snelleman <[email protected]>

* Fixing permissions

* Fixing bug in remove solver, renaming global_variables symbol from sgh (sparkle_global_help) to gv (#14)

* SPRK-55 (#13)

* Fixes for removing instances from Sparkle through CLI

* Intermediate check

* ignoring runsolver file from compilation

* Fixing all nicknames in commands for configuration

* bugfix from different ticket

* Refactoring and print improvement

* Bugfix feature data frame

* Refactoring useless/dead code

* bug fix args branch

* nickname support run sparkle portfolio selector

* Nickname support for generate report

* flake8

* Simplified extractor nicknaming code

* Simplifying remove instances nickname

* Simplifying remove solver

* Refactoring

* flake8

* Bugfix

* sh test fix

* Preventing the nickname handler from crashing when args are None

* test fix

---------

Co-authored-by: Noah Peil <[email protected]>

* Sprk 80 - [M] Add pcs validity and running check to wrappers (#17)

* Add check argument

* Merge duplicate check pcs functions

* Add pcsparser

* Start with running an instances to check if wrapper runs

* Repo change

* Do checks before adding. Change executable check return type

* Merge and comment on wrong executable check

* fixes

* flake8

* enviroment fix

* Changelog

* PR comments fixes

* Move messages from reading the pcs files to the cli part

* Sprk 285 (#19)

* Fixed check_settings_changes KeyError

* Finishing SPRK-285

* Revert run_on option strings to lowercase again

* Resolved flake8 issues

---------

Co-authored-by: Noah Peil <[email protected]>

* Sprk 220 (#9)

* Add option to set autofolio's timeout

* fixup! Add option to set autofolio's timeout

* Fix autofolio timeout

* Minor fixes selection example

* Updating docs for runsolver (#26)

* Docs bugfix

* Update about usage for docs

* typo

* trying to fix docs compilation

* Bugfixes for docs gen

* removing print statement

* Updating requirements

* Sprk 102 (#25)

* Remove redundant code

* Added default extractor wrapper

* Modified Wrapper

* Implemented new wrapper in add_feature_extractor

* rewrote extractor wrapper code

* Fixed flake8 mistakes

* Some fixes (mostly path related)

* Requested Changes

* Updates

* Few more changes

* Removing dead imports

* Implemented changes to extractor wrapper

* Extractor now works

* Removed print statements

* Minor code layout changes

* standardising

* Wrapping up wrapper changes for extractors

---------

Co-authored-by: Thijs Snelleman <[email protected]>

* Improve status monitoring with logfile status (#28)

* First implementation of monitoring with logfile status

* Formatting and variable renaming

* More formatting

---------

Co-authored-by: Noah Peil <[email protected]>

* Sprk 269 (#18)

* refactor

* Removing construct parallel portfolio from Sparkle

* flake8

* Removing traces of construct parallel portfolio

* flake8

* Adding in solver wrappers for solvers with outdated wrappers

* Bugfixes

* Big changes

* wrapping up report refactoring

* flake8 adapt

* Clean up

* Moving code to more logical place

* flake8

* bugfix from refactor

* minor refactor

* flake8 fixes

* Updating parallel portfolio arguments/settings

* Renaming the command

* bugfix

* Moving arguments to argparse custom

* Bugfix hadar

* Removing dead variables

* Refactoring variables pt 2

* Refactoring gv method

* Bugfixes

* Load snapshot bugfix

* remove feature extractor bugfix

* Minor bug fixes

* flake8

* CLI pass through comments fix

* Bug fixes

* about test fix

* About fix

* Bugfix report generation

* Forgotten print statement

* Reverting refactoring

* Updating CLI test

* Fixing bug

* Final bug fix for test

* Removing dead files

* Bugfixes remove instances CLI test

* remove multi instances bugfix

* CLI test fixes

* Refactoring SMAC

* Refactoring test bugs fix

* Updating changelog

* Bugfix wrapper, updating changelog, minor refactoring

* Minor bug fix solver wrapper

* Bug fix validator

* Bug fixes in compute features / selection example

* Removing useless print statement

* flake8 fix

* Removing dead variable

* Adding file lock for selector writing to performance data csvs

* flake8

* Report bugfixing

* Bug fixes report

* Changelog + bugfix

* bugfix feature extractor removal

---------

Co-authored-by: Hadar Shavit <[email protected]>
Co-authored-by: Noah Peil <[email protected]>
Co-authored-by: Noah Peil <[email protected]>
Co-authored-by: Brian Schiller <[email protected]>
Co-authored-by: Koen van der Blom <[email protected]>
Co-authored-by: Jeroen Rook <[email protected]>

* Version change

* Small fixes

* Bugfix test files

---------

Co-authored-by: Brian Schiller <[email protected]>
Co-authored-by: Hadar Shavit <[email protected]>
Co-authored-by: Noah Peil <[email protected]>
Co-authored-by: Noah Peil <[email protected]>
Co-authored-by: Koen van der Blom <[email protected]>
Co-authored-by: Jeroen Rook <[email protected]>

* Release/0.8.3 (#57)

* Sprk 76 (#7)

* Added cpu_time & solver_calls to configuration budget (missing from run_ablation & get_smac_settings)

* Fixed some flake8 and pytest errors

* Refactor

* Updating Runsolver and placing compilation responsibility in platform initialisation (#3)

* Updating runsolver

* Fixed runsolver make

* Updating runsolver and gitignore structure for local compilation

* Removing runsolver as part of Sparkle, must now be compiled by user

* Fixing sparkle platform intialization with Runsolver compilation

* Refactoring, flake8

* Fixes for instant compilation of runsolver (Conda install of required c packages and necessary path modding)

---------

Co-authored-by: Thijs Snelleman <[email protected]>

* Run workflow on on pull request (#6)

* Update SWIG (#5)

* Small flake8 fix

* Small fixes

* Small fixes

* Sprk 270 (#8)

* temp design check in

* Flake8 fixes

* Refactoring validator as preparation

* Preparing configurator to use validator

* Attempting fix for Github

* pytest fix for gen rep

* Pytest fix for validation scenario

* Re-enabling pytest

* Prepping for testing

* Intermediate check in

* Moving configurator implementations in settings

* Bugfixes moving configurator

* Setting up general configurator CLI

* Fixing configurator writing output configurations from each run to a unified CSV

* Validator and solver running fix

* flake8 fix

* Fixing command calls

* Fixing settings

* Fixing variable name in test

* Continuing work on configurators, cleaning up Components directory

* Removing unused files

* Intermediate check in to check issue with runsolver

* Found bug in smac target algorithm, was using the wrong runsolver output file to detect runtime.

* Updating solver wrapper to be able to read configurations from file

* Bugfixes SMAC wrappers

* Reverting sparkle settings to original

* Reverting slurm settings to original

* Moving direcotries to unified output directory

* Correcting file structure

* Refactoring, flake8

* Wrapping up file organisation

* Refactoring code to work with new implementation

* Bug fixes

* Fixing code for report generation

* flake8

* Fixing solver input for validate after config to match amount of configurations

* Attempted bug fix

* Bugfix for ablation?

* Bugfix ablation

* Refactoring configure_solver_help content

* Renaming to make a closer match to current contents

* description rename

* Fixing rename for imports

* flake8

* pytest fixes

* Fixing variables

* pytest fix

* Pytest fix

* Pytest fix

* pytest fixes

* Fix

* Pytest fix

* removing dead code from test

* Final fixes

* bugfix

* pytest fix

* Removing smac references from global variables

* Removing hard coded smacv2 references from Sparkle all together

* PR changes

* Minor fixes

* flake8

* Minor fixes

* Forgot to check in settings file

* Bugfixes for ablation

* Changed Default CPU value

* Added alias to userguide & settings

* small fix

* corrected method name

* Set solver_calls and cpu_time default to None

* flake8 hates me

---------

Co-authored-by: Thijs Snelleman <[email protected]>
Co-authored-by: Thijs Snelleman <[email protected]>
Co-authored-by: Hadar Shavit <[email protected]>

* Fixing execute permission on example

* Release/0.8.2 (#30)

* Refactor

* Updating Runsolver and placing compilation responsibility in platform initialisation (#3)

* Updating runsolver

* Fixed runsolver make

* Updating runsolver and gitignore structure for local compilation

* Removing runsolver as part of Sparkle, must now be compiled by user

* Fixing sparkle platform intialization with Runsolver compilation

* Refactoring, flake8

* Fixes for instant compilation of runsolver (Conda install of required c packages and necessary path modding)

---------

Co-authored-by: Thijs Snelleman <[email protected]>

* Run workflow on on pull request (#6)

* Update SWIG (#5)

* Sprk 270 (#8)

* temp design check in

* Flake8 fixes

* Refactoring validator as preparation

* Preparing configurator to use validator

* Attempting fix for Github

* pytest fix for gen rep

* Pytest fix for validation scenario

* Re-enabling pytest

* Prepping for testing

* Intermediate check in

* Moving configurator implementations in settings

* Bugfixes moving configurator

* Setting up general configurator CLI

* Fixing configurator writing output configurations from each run to a unified CSV

* Validator and solver running fix

* flake8 fix

* Fixing command calls

* Fixing settings

* Fixing variable name in test

* Continuing work on configurators, cleaning up Components directory

* Removing unused files

* Intermediate check in to check issue with runsolver

* Found bug in smac target algorithm, was using the wrong runsolver output file to detect runtime.

* Updating solver wrapper to be able to read configurations from file

* Bugfixes SMAC wrappers

* Reverting sparkle settings to original

* Reverting slurm settings to original

* Moving direcotries to unified output directory

* Correcting file structure

* Refactoring, flake8

* Wrapping up file organisation

* Refactoring code to work with new implementation

* Bug fixes

* Fixing code for report generation

* flake8

* Fixing solver input for validate after config to match amount of configurations

* Attempted bug fix

* Bugfix for ablation?

* Bugfix ablation

* Refactoring configure_solver_help content

* Renaming to make a closer match to current contents

* description rename

* Fixing rename for imports

* flake8

* pytest fixes

* Fixing variables

* pytest fix

* Pytest fix

* Pytest fix

* pytest fixes

* Fix

* Pytest fix

* removing dead code from test

* Final fixes

* bugfix

* pytest fix

* Removing smac references from global variables

* Removing hard coded smacv2 references from Sparkle all together

* PR changes

* Minor fixes

* flake8

* Minor fixes

* Forgot to check in settings file

* Bugfixes for ablation

* SPRK-88 (#12)

* Creating unified file for CLI arguments

* Aggregate all CLI arguments into argparse_custom

* Made CLI programs use centralised ArgumentContainers

* Fixed SolverPathArgument

* Sprk 76 (#7)

* Added cpu_time & solver_calls to configuration budget (missing from run_ablation & get_smac_settings)

* Fixed some flake8 and pytest errors

* Refactor

* Updating Runsolver and placing compilation responsibility in platform initialisation (#3)

* Updating runsolver

* Fixed runsolver make

* Updating runsolver and gitignore structure for local compilation

* Removing runsolver as part of Sparkle, must now be compiled by user

* Fixing sparkle platform intialization with Runsolver compilation

* Refactoring, flake8

* Fixes for instant compilation of runsolver (Conda install of required c packages and necessary path modding)

---------

Co-authored-by: Thijs Snelleman <[email protected]>

* Run workflow on on pull request (#6)

* Update SWIG (#5)

* Small flake8 fix

* Small fixes

* Small fixes

* Sprk 270 (#8)

* temp design check in

* Flake8 fixes

* Refactoring validator as preparation

* Preparing configurator to use validator

* Attempting fix for Github

* pytest fix for gen rep

* Pytest fix for validation scenario

* Re-enabling pytest

* Prepping for testing

* Intermediate check in

* Moving configurator implementations in settings

* Bugfixes moving configurator

* Setting up general configurator CLI

* Fixing configurator writing output configurations from each run to a unified CSV

* Validator and solver running fix

* flake8 fix

* Fixing command calls

* Fixing settings

* Fixing variable name in test

* Continuing work on configurators, cleaning up Components directory

* Removing unused files

* Intermediate check in to check issue with runsolver

* Found bug in smac target algorithm, was using the wrong runsolver output file to detect runtime.

* Updating solver wrapper to be able to read configurations from file

* Bugfixes SMAC wrappers

* Reverting sparkle settings to original

* Reverting slurm settings to original

* Moving direcotries to unified output directory

* Correcting file structure

* Refactoring, flake8

* Wrapping up file organisation

* Refactoring code to work with new implementation

* Bug fixes

* Fixing code for report generation

* flake8

* Fixing solver input for validate after config to match amount of configurations

* Attempted bug fix

* Bugfix for ablation?

* Bugfix ablation

* Refactoring configure_solver_help content

* Renaming to make a closer match to current contents

* description rename

* Fixing rename for imports

* flake8

* pytest fixes

* Fixing variables

* pytest fix

* Pytest fix

* Pytest fix

* pytest fixes

* Fix

* Pytest fix

* removing dead code from test

* Final fixes

* bugfix

* pytest fix

* Removing smac references from global variables

* Removing hard coded smacv2 references from Sparkle all together

* PR changes

* Minor fixes

* flake8

* Minor fixes

* Forgot to check in settings file

* Bugfixes for ablation

* Changed Default CPU value

* Added alias to userguide & settings

* small fix

* corrected method name

* Set solver_calls and cpu_time default to None

* flake8 hates me

---------

Co-authored-by: Thijs Snelleman <[email protected]>
Co-authored-by: Thijs Snelleman <[email protected]>
Co-authored-by: Hadar Shavit <[email protected]>

* Split PerformanceMeasureArgument in two and remove current value information for certain CLI arguments

* Wrap-up of restructuring argparse arguments

* Actual implementation of SPRK-88

* Small fix to generate_report

* Removing print statement, correcting my own mistakes for argsv

* Formatting string without + operator

---------

Co-authored-by: Noah Peil <[email protected]>
Co-authored-by: Brian Schiller <[email protected]>
Co-authored-by: Thijs Snelleman <[email protected]>
Co-authored-by: Thijs Snelleman <[email protected]>
Co-authored-by: Hadar Shavit <[email protected]>

* Fix typo (#10)

Minor change

* bugfix in dev

* SPRK-120 (#15)

* Implementation of SPRK-120

* Change requests

---------

Co-authored-by: Noah Peil <[email protected]>

* Added .kwargs to argparse argument

* Replaced * with ** for kwargs

* Adding Aaron to contributors list

* SPRK-128: Rename clips_per_node (#16)

* Rename clis_per_node

* Requests

* Adding Aaron to contributors list

---------

Co-authored-by: Noah Peil <[email protected]>
Co-authored-by: Thijs Snelleman <[email protected]>

* Fixing permissions

* Fixing bug in remove solver, renaming global_variables symbol from sgh (sparkle_global_help) to gv (#14)

* SPRK-55 (#13)

* Fixes for removing instances from Sparkle through CLI

* Intermediate check

* ignoring runsolver file from compilation

* Fixing all nicknames in commands for configuration

* bugfix from different ticket

* Refactoring and print improvement

* Bugfix feature data frame

* Refactoring useless/dead code

* bug fix args branch

* nickname support run sparkle portfolio selector

* Nickname support for generate report

* flake8

* Simplified extractor nicknaming code

* Simplifying remove instances nickname

* Simplifying remove solver

* Refactoring

* flake8

* Bugfix

* sh test fix

* Preventing the nickname handler from crashing when args are None

* test fix

---------

Co-authored-by: Noah Peil <[email protected]>

* Sprk 80 - [M] Add pcs validity and running check to wrappers (#17)

* Add check argument

* Merge duplicate check pcs functions

* Add pcsparser

* Start with running an instances to check if wrapper runs

* Repo change

* Do checks before adding. Change executable check return type

* Merge and comment on wrong executable check

* fixes

* flake8

* enviroment fix

* Changelog

* PR comments fixes

* Move messages from reading the pcs files to the cli part

* Sprk 285 (#19)

* Fixed check_settings_changes KeyError

* Finishing SPRK-285

* Revert run_on option strings to lowercase again

* Resolved flake8 issues

---------

Co-authored-by: Noah Peil <[email protected]>

* Sprk 220 (#9)

* Add option to set autofolio's timeout

* fixup! Add option to set autofolio's timeout

* Fix autofolio timeout

* Minor fixes selection example

* Updating docs for runsolver (#26)

* Docs bugfix

* Update about usage for docs

* typo

* trying to fix docs compilation

* Bugfixes for docs gen

* removing print statement

* Updating requirements

* Sprk 102 (#25)

* Remove redundant code

* Added default extractor wrapper

* Modified Wrapper

* Implemented new wrapper in add_feature_extractor

* rewrote extractor wrapper code

* Fixed flake8 mistakes

* Some fixes (mostly path related)

* Requested Changes

* Updates

* Few more changes

* Removing dead imports

* Implemented changes to extractor wrapper

* Extractor now works

* Removed print statements

* Minor code layout changes

* standardising

* Wrapping up wrapper changes for extractors

---------

Co-authored-by: Thijs Snelleman <[email protected]>

* Improve status monitoring with logfile status (#28)

* First implementation of monitoring with logfile status

* Formatting and variable renaming

* More formatting

---------

Co-authored-by: Noah Peil <[email protected]>

* Sprk 269 (#18)

* refactor

* Removing construct parallel portfolio from Sparkle

* flake8

* Removing traces of construct parallel portfolio

* flake8

* Adding in solver wrappers for solvers with outdated wrappers

* Bugfixes

* Big changes

* wrapping up report refactoring

* flake8 adapt

* Clean up

* Moving code to more logical place

* flake8

* bugfix from refactor

* minor refactor

* flake8 fixes

* Updating parallel portfolio arguments/settings

* Renaming the command

* bugfix

* Moving arguments to argparse custom

* Bugfix hadar

* Removing dead variables

* Refactoring variables pt 2

* Refactoring gv method

* Bugfixes

* Load snapshot bugfix

* remove feature extractor bugfix

* Minor bug fixes

* flake8

* CLI pass through comments fix

* Bug fixes

* about test fix

* About fix

* Bugfix report generation

* Forgotten print statement

* Reverting refactoring

* Updating CLI test

* Fixing bug

* Final bug fix for test

* Removing dead files

* Bugfixes remove instances CLI test

* remove multi instances bugfix

* CLI test fixes

* Refactoring SMAC

* Refactoring test bugs fix

* Updating changelog

* Bugfix wrapper, updating changelog, minor refactoring

* Minor bug fix solver wrapper

* Bug fix validator

* Bug fixes in compute features / selection example

* Removing useless print statement

* flake8 fix

* Removing dead variable

* Adding file lock for selector writing to performance data csvs

* flake8

* Report bugfixing

* Bug fixes report

* Changelog + bugfix

* bugfix feature extractor removal

---------

Co-authored-by: Hadar Shavit <[email protected]>
Co-authored-by: Noah Peil <[email protected]>
Co-authored-by: Noah Peil <[email protected]>
Co-authored-by: Brian Schiller <[email protected]>
Co-authored-by: Koen van der Blom <[email protected]>
Co-authored-by: Jeroen Rook <[email protected]>

* Version change

* Small fixes

* Bugfix test files

* Release/0.8.3 (#54)

* Refactor

* Updating Runsolver and placing compilation responsibility in platform initialisation (#3)

* Updating runsolver

* Fixed runsolver make

* Updating runsolver and gitignore structure for local compilation

* Removing runsolver as part of Sparkle, must now be compiled by user

* Fixing sparkle platform intialization with Runsolver compilation

* Refactoring, flake8

* Fixes for instant compilation of runsolver (Conda install of required c packages and necessary path modding)

---------

Co-authored-by: Thijs Snelleman <[email protected]>

* Run workflow on on pull request (#6)

* Update SWIG (#5)

* Sprk 270 (#8)

* temp design check in

* Flake8 fixes

* Refactoring validator as preparation

* Preparing configurator to use validator

* Attempting fix for Github

* pytest fix for gen rep

* Pytest fix for validation scenario

* Re-enabling pytest

* Prepping for testing

* Intermediate check in

* Moving configurator implementations in settings

* Bugfixes moving configurator

* Setting up general configurator CLI

* Fixing configurator writing output configurations from each run to a unified CSV

* Validator and solver running fix

* flake8 fix

* Fixing command calls

* Fixing settings

* Fixing variable name in test

* Continuing work on configurators, cleaning up Components directory

* Removing unused files

* Intermediate check in to check issue with runsolver

* Found bug in smac target algorithm, was using the wrong runsolver output file to detect runtime.

* Updating solver wrapper to be able to read configurations from file

* Bugfixes SMAC wrappers

* Reverting sparkle settings to original

* Reverting slurm settings to original

* Moving direcotries to unified output directory

* Correcting file structure

* Refactoring, flake8

* Wrapping up file organisation

* Refactoring code to work with new implementation

* Bug fixes

* Fixing code for report generation

* flake8

* Fixing solver input for validate after config to match amount of configurations

* Attempted bug fix

* Bugfix for ablation?

* Bugfix ablation

* Refactoring configure_solver_help content

* Renaming to make a closer match to current contents

* description rename

* Fixing rename for imports

* flake8

* pytest fixes

* Fixing variables

* pytest fix

* Pytest fix

* Pytest fix

* pytest fixes

* Fix

* Pytest fix

* removing dead code from test

* Final fixes

* bugfix

* pytest fix

* Removing smac references from global variables

* Removing hard coded smacv2 references from Sparkle all together

* PR changes

* Minor fixes

* flake8

* Minor fixes

* Forgot to check in settings file

* Bugfixes for ablation

* SPRK-88 (#12)

* Creating unified file for CLI arguments

* Aggregate all CLI arguments into argparse_custom

* Made CLI programs use centralised ArgumentContainers

* Fixed SolverPathArgument

* Sprk 76 (#7)

* Added cpu_time & solver_calls to configuration budget (missing from run_ablation & get_smac_settings)

* Fixed some flake8 and pytest errors

* Refactor

* Updating Runsolver and placing compilation responsibility in platform initialisation (#3)

* Updating runsolver

* Fixed runsolver make

* Updating runsolver and gitignore structure for local compilation

* Removing runsolver as part of Sparkle, must now be compiled by user

* Fixing sparkle platform intialization with Runsolver compilation

* Refactoring, flake8

* Fixes for instant compilation of runsolver (Conda install of required c packages and necessary path modding)

---------

Co-authored-by: Thijs Snelleman <[email protected]>

* Run workflow on on pull request (#6)

* Update SWIG (#5)

* Small flake8 fix

* Small fixes

* Small fixes

* Sprk 270 (#8)

* temp design check in

* Flake8 fixes

* Refactoring validator as preparation

* Preparing configurator to use validator

* Attempting fix for Github

* pytest fix for gen rep

* Pytest fix for validation scenario

* Re-enabling pytest

* Prepping for testing

* Intermediate check in

* Moving configurator implementations in settings

* Bugfixes moving configurator

* Setting up general configurator CLI

* Fixing configurator writing output configurations from each run to a unified CSV

* Validator and solver running fix

* flake8 fix

* Fixing command calls

* Fixing settings

* Fixing variable name in test

* Continuing work on configurators, cleaning up Components directory

* Removing unused files

* Intermediate check in to check issue with runsolver

* Found bug in smac target algorithm, was using the wrong runsolver output file to detect runtime.

* Updating solver wrapper to be able to read configurations from file

* Bugfixes SMAC wrappers

* Reverting sparkle settings to original

* Reverting slurm settings to original

* Moving direcotries to unified output directory

* Correcting file structure

* Refactoring, flake8

* Wrapping up file organisation

* Refactoring code to work with new implementation

* Bug fixes

* Fixing code for report generation

* flake8

* Fixing solver input for validate after config to match amount of configurations

* Attempted bug fix

* Bugfix for ablation?

* Bugfix ablation

* Refactoring configure_solver_help content

* Renaming to make a closer match to current contents

* description rename

* Fixing rename for imports

* flake8

* pytest fixes

* Fixing variables

* pytest fix

* Pytest fix

* Pytest fix

* pytest fixes

* Fix

* Pytest fix

* removing dead code from test

* Final fixes

* bugfix

* pytest fix

* Removing smac references from global variables

* Removing hard coded smacv2 references from Sparkle all together

* PR changes

* Minor fixes

* flake8

* Minor fixes

* Forgot to check in settings file

* Bugfixes for ablation

* Changed Default CPU value

* Added alias to userguide & settings

* small fix

* corrected method name

* Set solver_calls and cpu_time default to None

* flake8 hates me

---------

Co-authored-by: Thijs Snelleman <[email protected]>
Co-authored-by: Thijs Snelleman <[email protected]>
Co-authored-by: Hadar Shavit <[email protected]>

* Split PerformanceMeasureArgument in two and remove current value information for certain CLI arguments

* Wrap-up of restructuring argparse arguments

* Actual implementation of SPRK-88

* Small fix to generate_report

* Removing print statement, correcting my own mistakes for argsv

* Formatting string without + operator

---------

Co-authored-by: Noah Peil <[email protected]>
Co-authored-by: Brian Schiller <[email protected]>
Co-authored-by: Thijs Snelleman <[email protected]>
Co-authored-by: Thijs Snelleman <[email protected]>
Co-authored-by: Hadar Shavit <[email protected]>

* Fix typo (#10)

Minor change

* bugfix in dev

* SPRK-120 (#15)

* Implementation of SPRK-120

* Change requests

---------

Co-authored-by: Noah Peil <[email protected]>

* Added .kwargs to argparse argument

* Replaced * with ** for kwargs

* Adding Aaron to contributors list

* SPRK-128: Rename clips_per_node (#16)

* Rename clis_per_node

* Requests

* Adding Aaron to contributors list

---------

Co-authored-by: Noah Peil <[email protected]>
Co-authored-by: Thijs Snelleman <[email protected]>

* Fixing permissions

* Fixing bug in remove solver, renaming global_variables symbol from sgh (sparkle_global_help) to gv (#14)

* SPRK-55 (#13)

* Fixes for removing instances from Sparkle through CLI

* Intermediate check

* ignoring runsolver file from compilation

* Fixing all nicknames in commands for configuration

* bugfix from different ticket

* Refactoring and print improvement

* Bugfix feature data frame

* Refactoring useless/dead code

* bug fix args branch

* nickname support run sparkle portfolio selector

* Nickname support for generate report

* flake8

* Simplified extractor nicknaming code

* Simplifying remove instances nickname

* Simplifying remove solver

* Refactoring

* flake8

* Bugfix

* sh test fix

* Preventing the nickname handler from crashing when args are None

* test fix

---------

Co-authored-by: Noah Peil <[email protected]>

* Sprk 80 - [M] Add pcs validity and running check to wrappers (#17)

* Add check argument

* Merge duplicate check pcs functions

* Add pcsparser

* Start with running an instances to check if wrapper runs

* Repo change

* Do checks before adding. Change executable check return type

* Merge and comment on wrong executable check

* fixes

* flake8

* enviroment fix

* Changelog

* PR comments fixes

* Move messages from reading the pcs files to the cli part

* Sprk 285 (#19)

* Fixed check_settings_changes KeyError

* Finishing SPRK-285

* Revert run_on option strings to lowercase again

* Resolved flake8 issues

---------

Co-authored-by: Noah Peil <[email protected]>

* Sprk 220 (#9)

* Add option to set autofolio's timeout

* fixup! Add option to set autofolio's timeout

* Fix autofolio timeout

* Minor fixes selection example

* Updating docs for runsolver (#26)

* Docs bugfix

* Update about usage for docs

* typo

* trying to fix docs compilation

* Bugfixes for docs gen

* removing print statement

* Updating requirements

* Sprk 102 (#25)

* Remove redundant code

* Added default extractor wrapper

* Modified Wrapper

* Implemented new wrapper in add_feature_extractor

* rewrote extractor wrapper code

* Fixed flake8 mistakes

* Some fixes (mostly path related)

* Requested Changes

* Updates

* Few more changes

* Removing dead imports

* Implemented changes to extractor wrapper

* Extractor now works

* Removed print statements

* Minor code layout changes

* standardising

* Wrapping up wrapper changes for extractors

---------

Co-authored-by: Thijs Snelleman <[email protected]>

* Improve status monitoring with logfile status (#28)

* First implementation of monitoring with logfile status

* Formatting and variable renaming

* More formatting

---------

Co-authored-by: Noah Peil <[email protected]>

* Sprk 269 (#18)

* refactor

* Removing construct parallel portfolio from Sparkle

* flake8

* Removing traces of construct parallel portfolio

* flake8

* Adding in solver wra…
  • Loading branch information
9 people authored Sep 27, 2024
1 parent b68e331 commit e5d67e7
Showing 1 changed file with 6 additions and 5 deletions.
11 changes: 6 additions & 5 deletions .github/workflows/documentation.yml
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
# Simple workflow for deploying static content to GitHub Pages
name: Deploy static content to Pages
name: Deploy Documentation

on: # Runs on pushes targeting the default branch
push:
Expand Down Expand Up @@ -39,10 +39,11 @@ jobs:
run: |
conda install -y python=3.9 # https://github.com/conda/conda/issues/13560#issuecomment-1992720842
conda env update --file dev-env.yml --name base
pip install sphinx sphinx_rtd_theme myst_parser sphinxcontrib-autoprogram
- name: Compile code reports
run: pytest --all --cov sparkle/ --cov-report=html:Documentation/source/_static/coverage
pytest --all --html=Documentation/source/_static/junit/index.html
pip install -r Documentation/requirements.txt
- name: Run Code Coverage report
run: pytest --all --cov sparkle/ --cov-report=html:Documentation/source/_static/coverage
- name: Run tests report
run: pytest --all --html=Documentation/source/_static/junit/index.html
- name: Build Documentation
run: |
cd Documentation
Expand Down

0 comments on commit e5d67e7

Please sign in to comment.