-
Notifications
You must be signed in to change notification settings - Fork 29
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Resource limit #55
base: master
Are you sure you want to change the base?
Resource limit #55
Commits on Oct 16, 2020
-
Configuration menu - View commit details
-
Copy full SHA for 240cea6 - Browse repository at this point
Copy the full SHA 240cea6View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1ff4676 - Browse repository at this point
Copy the full SHA 1ff4676View commit details
Commits on Oct 18, 2020
-
Updated
.gitignore
to ignore some Cabal artifactsDavid Ellis committedOct 18, 2020 Configuration menu - View commit details
-
Copy full SHA for 3e2186e - Browse repository at this point
Copy the full SHA 3e2186eView commit details -
Draft implementation for core functionality for resource limited jobs (…
…saurabhnanda#38) Many small changes were required, but the majority were mechanical changes. With the exception of the `createJob`/`scheduleJob` family of function, this should be mostly backwards compatible with existing user code that does not use "internal" functions. Further discussion about how to handle backwards compatibility is needed. Note also that this commit by itself is NOT compatible with existing databases. A future commit will address migration from existing to new database definitions. The intention is for this feature to have a negligable impact on performance when the resource limiting features are not being used, and only a minor impact when they are used. However, performance testing has not yet been done. Material changes inclue: - New resource table - New `resource_id` column in to job table - New `cfgDefaultResourceLimit` configuration value - New `createResourceJob` and `scheduleResourceJob` functions - New `TableNames` type to carry the now multiple values needed - Updated existing functions and queries to account for these changes - Updated dequeueing queries to implement resource concurrency limits - New `DevelDb` module to the `devel` executable to help ad hoc testing TODO: - Resource record management functions - Migration functionality (need to discuss database versioning) - Unit tests - Performance tests - Documentation updates - Resource management UI
David Ellis committedOct 18, 2020 Configuration menu - View commit details
-
Copy full SHA for baeff32 - Browse repository at this point
Copy the full SHA baeff32View commit details
Commits on Oct 19, 2020
-
Configuration menu - View commit details
-
Copy full SHA for 05bd9cc - Browse repository at this point
Copy the full SHA 05bd9ccView commit details -
Setup CI using Github Actions (saurabhnanda#50)
* setup a simple CI using GitHub actions * describe a simple dev setup process * build branches with pull requests against master, run build on multiple operating systems * trigger CI for all branches * always checkout the ref * build only on pull_request events not to duplicate builds * build only on Ubuntu
Configuration menu - View commit details
-
Copy full SHA for ac25d5b - Browse repository at this point
Copy the full SHA ac25d5bView commit details -
Reduced database notification payload (saurabhnanda#43)
Because PostgreSQL limits notification payloads to 8000 bytes by default, passing the full job record in the notification artificially limits the job payload size. By passing only required fields in the notification, this limitation is removed.
Configuration menu - View commit details
-
Copy full SHA for cec5558 - Browse repository at this point
Copy the full SHA cec5558View commit details -
Updated
.gitignore
to ignore some Cabal artifactsDavid Ellis committedOct 19, 2020 Configuration menu - View commit details
-
Copy full SHA for 265d06d - Browse repository at this point
Copy the full SHA 265d06dView commit details -
Draft implementation for core functionality for resource limited jobs (…
…saurabhnanda#38) Many small changes were required, but the majority were mechanical changes. With the exception of the `createJob`/`scheduleJob` family of function, this should be mostly backwards compatible with existing user code that does not use "internal" functions. Further discussion about how to handle backwards compatibility is needed. Note also that this commit by itself is NOT compatible with existing databases. A future commit will address migration from existing to new database definitions. The intention is for this feature to have a negligable impact on performance when the resource limiting features are not being used, and only a minor impact when they are used. However, performance testing has not yet been done. Material changes inclue: - New resource table - New `resource_id` column in to job table - New `cfgDefaultResourceLimit` configuration value - New `createResourceJob` and `scheduleResourceJob` functions - New `TableNames` type to carry the now multiple values needed - Updated existing functions and queries to account for these changes - Updated dequeueing queries to implement resource concurrency limits - New `DevelDb` module to the `devel` executable to help ad hoc testing TODO: - Resource record management functions - Migration functionality (need to discuss database versioning) - Unit tests - Performance tests - Documentation updates - Resource management UI
David Ellis committedOct 19, 2020 Configuration menu - View commit details
-
Copy full SHA for ee7d216 - Browse repository at this point
Copy the full SHA ee7d216View commit details
Commits on Oct 20, 2020
-
Introduced
dropJobTables
and refactoredMigrations.hs
Because there are unit tests that delete tabes, and now that there are multiple table names in play, it seemed useful to explicitly implement a deletion function. Becuase this deserved a comment, I also added comments to the other externally useful functions in this module, and rearranged the file a bit to highlight these defintions.
David Ellis committedOct 20, 2020 Configuration menu - View commit details
-
Copy full SHA for 8595a3c - Browse repository at this point
Copy the full SHA 8595a3cView commit details -
Added
mkResourceConfig
for use with resource-limited jobsDavid Ellis committedOct 20, 2020 Configuration menu - View commit details
-
Copy full SHA for 1a1c56b - Browse repository at this point
Copy the full SHA 1a1c56bView commit details -
Updated tests for resource-limited jobs
David Ellis committedOct 20, 2020 Configuration menu - View commit details
-
Copy full SHA for 7c727b0 - Browse repository at this point
Copy the full SHA 7c727b0View commit details -
Organized imports in
test/Test.hs
David Ellis committedOct 20, 2020 Configuration menu - View commit details
-
Copy full SHA for 0b6738f - Browse repository at this point
Copy the full SHA 0b6738fView commit details -
Updated tests to allow env var specification of database connection
Now, if the environment variable "ODD_JOBS_TEST_DB_CONNECT" is set, it will be used as a connection string for unit test. If not, the existing hard-coded default connection will be used. This is useful when developing in a containerized environment.
David Ellis committedOct 20, 2020 Configuration menu - View commit details
-
Copy full SHA for bb06cdf - Browse repository at this point
Copy the full SHA bb06cdfView commit details -
Merge branch 'resource-limit-tests' into resource-limit
This includes the changes that are on `fix/tests` branch.
David Ellis committedOct 20, 2020 Configuration menu - View commit details
-
Copy full SHA for 984da57 - Browse repository at this point
Copy the full SHA 984da57View commit details