Add support for running Slurm commands from Apptainer environment

[hansemro]

To make Slurm commands work from within an Apptainer environment (from a compute node), the container needs the following:

• Some bindings from the compute node:
  • /var/spool/slurmd/
  • /run/slurm/ : contains active slurm configuration (conf which is symlinked to /var/spool/slurmd/conf-cache)
    • this path is used by slurm client utilities
  • /run/munge/
• Slurm 22.05.5 (installed from local yum repo on Klone)
  • Steps described throughout HYAK101 tutorial: https://hyak.uw.edu/docs/hyak101/python/container#our-general-purpose-container-definition
• Add slurm user to /etc/passwd and /etc/group
  • As described in HYAK101 tutorial.

From initial testing, I have been able to use slurm tools from a Rocky Linux 8 container (which is what the host environment is based on). However, more work will be required to get slurm working from a non-RHEL8 distribution (such as Ubuntu).

Although the HYAK101 tutorial describes some of the steps to get Slurm working, it yields a less reproducible container as it fetches files from Klone's host environment rather than off the internet.

[hansemro]

Relevant development branch: https://github.com/hansemro/hyak_vnc_apptainer/tree/slurm_hyak_tools