Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support Slurm 24.11 and REST API v0.0.40 #400

Merged
merged 25 commits into from
Nov 21, 2024
Merged

Support Slurm 24.11 and REST API v0.0.40 #400

merged 25 commits into from
Nov 21, 2024

Conversation

rezib
Copy link
Contributor

@rezib rezib commented Nov 19, 2024

Pending tasks:

  • Fix frontend unit tests
  • Update documentation
  • Understand failure with archived job on Slurm 24.11
  • Fix metrics with list of job states
  • Inventory of default filtered fields in configuration to verify their presence
  • Update CHANGELOG.md
  • Update screenshots

fix #366

@rezib rezib added the feature New feature or enhancement to develop. label Nov 19, 2024
@rezib rezib added this to the v4.0.0 milestone Nov 19, 2024
@rezib rezib self-assigned this Nov 19, 2024
@rezib rezib force-pushed the pr/feat-366 branch 6 times, most recently from 445445e to 40bc7ed Compare November 21, 2024 09:09
Remove unused fields from default filters of slurmrestd responses:

- required on /slurm/*/jobs endpoint.
- state_reason on, /slurm/*/job/<id> endpoint
@rezib rezib marked this pull request as ready for review November 21, 2024 14:53
rezib added 19 commits November 21, 2024 16:46
Note dev/crawl-tests-assets has been modified to bump to Slurm REST API
v0.0.40, and limit nodes dump to 100 nodes at maximum, and jobs dumps on
agent and gateway to 100 jobs as well.

The new API brings some changes:

- The slurm key in meta hash of ping response is now lowercase,
- Job state in now an array of states.
Bump [slurmrestd] > version default value from 0.0.39 to 0.0.40 in
agent configuration for compatibility with Slurm 24.11.
Bump minimal required Slurm version in agent from 23.02.0 to 23.11.0.
In Slurm REST API v0.0.40, meta > slurm > version > {major,minor,micro}
are now strings, they must be converted to integers for version
comparaison.
The slurm key in meta object of Slurm REST API ping response is
lowercase since v0.0.40.
Check metrics collector does not report unknown jobs/nodes/cores with
tests assets.
When requesting not existing nodes, Slurm REST API v0.0.40 does not
return empty nodes array anymore in the response. The error message has
also slightly changed.
The job_state field of jobs in Slurm REST API 0.0.40 is now a list of
states, rather than a simple string.
In dev/crawl-tests-assets script, try to read admin password from
environment before prompting the user interactively. This makes possible
to launch the script non-interactively.
Update ClusterJob and ClusterIndividualJob interfaces with all their
inner objects to match new objects returned by Slurm REST API v0.0.40.
Adapt frontend code base to Slurm jobs job_state field type change from
a string to an array of strings with Slurm REST API 0.0.40.
Update ClusterNode and ClusterIndividualNode interfaces with all their
inner objects to match new objects returned by Slurm REST API v0.0.40.
Update ClusterQOS and ClusterReservation interfaces with all their
inner objects to match new objects returned by Slurm REST API v0.0.40.
Adapt NodeView to the node boot_time and last_busy fields type change
from number to ClusterOptionalNumber object.
Adapt ReservationsView to the reservation start_time and end_time fields
type change from number to ClusterOptionalNumber object.
@rezib rezib merged commit 3b1d45e into main Nov 21, 2024
9 checks passed
@github-actions github-actions bot locked and limited conversation to collaborators Nov 21, 2024
@rezib rezib deleted the pr/feat-366 branch November 26, 2024 07:43
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
feature New feature or enhancement to develop.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Support Slurm 24.11 and REST API v0.0.40
1 participant