Code

The Great LDAPification#33

Code

Open

camillescottatwork wants to merge 141 commits intomainucdavis/cheeto:mainfrom ldap-refactorucdavis/cheeto:ldap-refactorCopy head branch name to clipboard

+27,217-1,764

Commits

Commits on Jul 18, 2024

• Move notebooks to their own directory

  camillescottatwork

  committed
  8e7ad31

  Copy full SHA for 8e7ad31

Commits on Jul 19, 2024

• Add conda environment file

  camillescottatwork

  committed
  5b82740

  Copy full SHA for 5b82740

• Vendor xdg-base-dirs single-file dependency (https://github.com/srstevenson/xdg-base-dirs/blob/main/src/xdg_base_dirs/__init__.py)

  camillescottatwork

  committed
  40ba268

  Copy full SHA for 40ba268

• Add basic config file support and subcommands

  camillescottatwork

  committed
  3b81b46

  Copy full SHA for 3b81b46

Commits on Jul 24, 2024

• Update deprecated NewType marshmallow types to Annotated

  camillescottatwork

  committed
  e74f948

  Copy full SHA for e74f948

• Fix deprecated ruamel.safe_load usage

  camillescottatwork

  committed
  52ec54e

  Copy full SHA for 52ec54e

• Sketch out testing code, add basic 'cheeto puppet validate' tests

  camillescottatwork

  committed
  29ea542

  Copy full SHA for 29ea542

Commits on Jul 25, 2024

• Merge branch 'main' into ldap-refactor

  camillescottatwork

  committed
  17b728c

  Copy full SHA for 17b728c

• Remove pyyaml entirely in favor of using ruamel for both loading and dumping; ensure all dictionary keys and listlikes are sorted properly in YAML output

  camillescottatwork

  committed
  5473201

  Copy full SHA for 5473201

• Update dependencies: particularly, updated marshmallow and marshmallow_dataclass for typing.Annotated support

  camillescottatwork

  committed
  c438594

  Copy full SHA for c438594

• Add tests for overriding values and bad shell

  camillescottatwork

  committed
  bf1197f

  Copy full SHA for bf1197f

• TestUserRecord load

  camillescottatwork

  committed
  8c20cfb

  Copy full SHA for 8c20cfb

• Remove old tests directory

  camillescott

  committed
  2520c80

  Copy full SHA for 2520c80

Commits on Jul 29, 2024

• Test some basic user and group record loads

  camillescott

  committed
  e4fc792

  Copy full SHA for e4fc792

• Add tests for parse_yaml and puppet_merge

  camillescott

  committed
  7390eba

  Copy full SHA for 7390eba

• Tests for parse_yaml_forest

  camillescott

  committed
  f05a78c

  Copy full SHA for f05a78c

Commits on Jul 30, 2024

• Basic LDAPManager with user querying, tests

  camillescott

  committed
  2101306

  Copy full SHA for 2101306

• gssapi dev package for gssapi package

  camillescott

  committed
  4d88253

  Copy full SHA for 4d88253

Commits on Jul 31, 2024

• ADd ipython as dev dependency

  camillescottatwork

  committed
  34fb353

  Copy full SHA for 34fb353

• Add user and group classes and attrs to LDAP config

  camillescottatwork

  committed
  5e85c7a

  Copy full SHA for 5e85c7a

• Add testing config.yaml and UCD schemas

  camillescottatwork

  committed
  a02f58d

  Copy full SHA for a02f58d

• Parse test config.yaml for testing config rather than creating and instance manually

  camillescottatwork

  committed
  0708d5c

  Copy full SHA for 0708d5c

Commits on Aug 3, 2024

• user querying and adding, group adding

  camillescottatwork

  committed
  3cfaa50

  Copy full SHA for 3cfaa50

Commits on Aug 9, 2024

• Basic ldap-sync for puppet YAML tree

  camillescottatwork

  committed
  5aa5da7

  Copy full SHA for 5aa5da7

Commits on Aug 14, 2024

• Initial schemas, functions for database

  camillescottatwork

  committed
  4b71c3f

  Copy full SHA for 4b71c3f

Commits on Aug 15, 2024

• Update test config.yaml, remove unused collection field from mongo config

  camillescottatwork

  committed
  cdb4cc5

  Copy full SHA for cdb4cc5

Commits on Aug 19, 2024

• Merged Mongo UserRecord type

  camillescottatwork

  committed
  71bbbf2

  Copy full SHA for 71bbbf2

• site user query tweaks

  camillescott

  committed
  e28d0bb

  Copy full SHA for e28d0bb

Commits on Aug 20, 2024

• User status updates, CLI for it

  camillescottatwork

  committed
  352b438

  Copy full SHA for 352b438

• Add YAML string representers to make sure long strings do not get weird extra linebreaks added when dumped

  camillescottatwork

  committed
  f725fe0

  Copy full SHA for f725fe0

• Add database index command; finish implementing full site-level user querying CLI

  camillescottatwork

  committed
  abb92e6

  Copy full SHA for abb92e6

• Add group querying CLI

  camillescottatwork

  committed
  58aca08

  Copy full SHA for 58aca08

• Fix querying for full records; fix param types with query params using marshmallow field deserialization

  camillescottatwork

  committed
  a589ba4

  Copy full SHA for a589ba4

Commits on Aug 22, 2024

• Major group membership functionality

  camillescottatwork

  committed
  9dcbdb7

  Copy full SHA for 9dcbdb7

• Add convenience properties to puppet UserRecord

  camillescottatwork

  committed
  86a6b76

  Copy full SHA for 86a6b76

Commits on Aug 28, 2024

• Generate HiPPO openapi client

  camillescottatwork

  committed
  054fdec

  Copy full SHA for 054fdec

• Generate UCD IAM openapi client

  camillescottatwork

  committed
  3f99e53

  Copy full SHA for 3f99e53

• Migrate to mongoengine.

  camillescottatwork

  committed
  20d03dd

  Copy full SHA for 20d03dd

• Remove openapi geneator metadata files

  camillescottatwork

  committed
  330ab03

  Copy full SHA for 330ab03

• hippoapi event handling

  camillescottatwork

  committed
  c9c0b6d

  Copy full SHA for c9c0b6d

• Full hippoapi event processing, basic ldap load

  camillescottatwork

  committed
  2d1eda2

  Copy full SHA for 2d1eda2

Commits on Aug 29, 2024

• new-system subcommand for generating new system groups

  camillescottatwork

  committed
  98b64d6

  Copy full SHA for 98b64d6

Commits on Aug 30, 2024

• Implement Slurm information in database

  camillescottatwork

  committed
  b4a6a49

  Copy full SHA for b4a6a49

• Implement slurmers - ie slurm account membership without group membership

  camillescottatwork

  committed
  0fbf723

  Copy full SHA for 0fbf723

• Add guarded database purge function

  camillescottatwork

  committed
  dffa360

  Copy full SHA for dffa360

• Add sitename index field to slurm qos in database

  camillescottatwork

  committed
  0e4b465

  Copy full SHA for 0e4b465

• Slurm sync adapter for database source

  camillescottatwork

  committed
  cd85a1b

  Copy full SHA for cd85a1b

• implement signal handlers for global groups and slurmers

  camillescottatwork

  committed
  9e7c97b

  Copy full SHA for 9e7c97b

Commits on Aug 31, 2024

• Convenience properties for parent dereferencing; user portion of puppet dump

  camillescottatwork

  committed
  b964b57

  Copy full SHA for b964b57

Commits on Sep 5, 2024

• Storage schemas, loading; some refactoring

  camillescottatwork

  committed
  00fbbf6

  Copy full SHA for 00fbbf6

Commits on Sep 6, 2024

• Add user groups to database on load

  camillescottatwork

  committed
  6613395

  Copy full SHA for 6613395

Commits on Sep 10, 2024

• Full Storage implementation, puppet yaml from database

  camillescottatwork

  committed
  0296e41

  Copy full SHA for 0296e41

Commits on Sep 13, 2024

• storage syncing, storage ldap

  camillescottatwork

  committed
  90e6738

  Copy full SHA for 90e6738

Commits on Sep 14, 2024

• Finalize storage schemas

  camillescottatwork

  committed
  a8a25cf

  Copy full SHA for a8a25cf

• storage to-puppet

  camillescottatwork

  committed
  bd61383

  Copy full SHA for bd61383

Commits on Sep 15, 2024

• Represent ordereddict in yaml dump, separate user and group storages in storage dump

  camillescottatwork

  committed
  f9a7a87

  Copy full SHA for f9a7a87

Commits on Sep 16, 2024

• Add sshkey syncing; ldap force; and sympa dump

  camillescottatwork

  committed
  55d917a

  Copy full SHA for 55d917a

• Add root-key generation command

  camillescottatwork

  committed
  2250979

  Copy full SHA for 2250979

• Make sure the special groups still get created during ldap sync

  camillescottatwork

  committed
  58c9bf5

  Copy full SHA for 58c9bf5

• Remove defaults channel from environment yaml

  camillescottatwork

  committed
  c917aac

  Copy full SHA for c917aac

• Add site list, don't use rich print

  camillescottatwork

  committed
  8302d9a

  Copy full SHA for 8302d9a

• add TLS mongo config option, have cheeto print some basic info to stderr on launch and db connect

  camillescottatwork

  committed
  f79b9a9

  Copy full SHA for f79b9a9

• implement git syncing for new puppet standard

  camillescottatwork

  committed
  81a82d8

  Copy full SHA for 81a82d8

• bump version

  camillescottatwork

  committed
  9801b01

  Copy full SHA for 9801b01

• Handle empty commit properly

  camillescottatwork

  committed
  7b78c12

  Copy full SHA for 7b78c12

• Give SiteSlurmAccount slurm attribute on SiteGroup a default

  camillescottatwork

  committed
  2f55aa8

  Copy full SHA for 2f55aa8

• Allow using domain name for --site argument in cheeto slurm sync

  camillescottatwork

  committed
  65af2ce

  Copy full SHA for 65af2ce

• bump version

  camillescottatwork

  committed
  1091056

  Copy full SHA for 1091056

• Make defaults for PuppetSlurmTRES -1 instead of None

  camillescottatwork

  committed
  f3c52e9

  Copy full SHA for f3c52e9

Commits on Sep 17, 2024

• Add group type field; add slurm as access type; add sync cmd for old puppet

  camillescottatwork

  committed
  534fe65

  Copy full SHA for 534fe65

• bump version

  camillescottatwork

  committed
  e66d8d7

  Copy full SHA for e66d8d7

Commits on Sep 18, 2024

• add additional account level slurm params; optimize association handling; fix bugs with slurm tres types

  camillescottatwork

  committed
  d4a998b

  Copy full SHA for d4a998b

• bump version

  camillescottatwork

  committed
  120c176

  Copy full SHA for 120c176

• fix sitename bugs in event processing; fix bugs in home storage querying

  camillescottatwork

  committed
  a12cd0d

  Copy full SHA for a12cd0d

• bump version

  camillescottatwork

  committed
  362a4aa

  Copy full SHA for 362a4aa

• add class user type, fix some bugs with puppet dumping

  camillescottatwork

  committed
  273a50e

  Copy full SHA for 273a50e

Commits on Sep 19, 2024

• Fix slurm sacctmgr account add

  camillescottatwork

  committed
  dabb69b

  Copy full SHA for dabb69b

Commits on Sep 20, 2024

• Implement add and remove for all SiteGroup listfields; fix repeated config parsing

  camillescottatwork

  committed
  dd4e0fb

  Copy full SHA for dd4e0fb

Commits on Sep 21, 2024

• Implement ldap_synced update in custom QuerySet; add user access methods and subcommand

  camillescottatwork

  committed
  8eb9900

  Copy full SHA for 8eb9900

• Add help text to database user subcommands

  camillescottatwork

  committed
  e465331

  Copy full SHA for e465331

Commits on Sep 25, 2024

• Change some puppet.py dataclass types to List to preserve sorting

  camillescottatwork

  committed
  4f77321

  Copy full SHA for 4f77321

• Fix ordering on a few more fields

  camillescottatwork

  committed
  86cc374

  Copy full SHA for 86cc374

Commits on Sep 26, 2024

• Fix bad .only() call in query_user_exists

  camillescottatwork

  committed
  5abd939

  Copy full SHA for 5abd939

Commits on Oct 4, 2024

• Add class group type; refactor command method names; add some more pretty prints

  camillescottatwork

  committed
  a5ffa41

  Copy full SHA for a5ffa41

• Regenerate hippoapi

  camillescottatwork

  committed
  1029c4c

  Copy full SHA for 1029c4c

Commits on Oct 8, 2024

• Start reorg for mail

  camillescottatwork

  committed
  4366051

  Copy full SHA for 4366051

• Upgrade dependencies

  camillescottatwork

  committed
  9660fe5

  Copy full SHA for 9660fe5

Commits on Oct 12, 2024

• Add xkcdpass and pyescrypt to poetry conf

  camillescottatwork

  committed
  efc2124

  Copy full SHA for efc2124

• Add config profiles

  camillescottatwork

  committed
  934636c

  Copy full SHA for 934636c

• Implement set-password and generate-passwords subcommands

  camillescottatwork

  committed
  426a807

  Copy full SHA for 426a807

• bit of formatting

  camillescottatwork

  committed
  63654e7

  Copy full SHA for 63654e7

Commits on Oct 14, 2024

• More rearrangment

  camillescottatwork

  committed
  deecac8

  Copy full SHA for deecac8

Commits on Oct 24, 2024

• Storage collection commands; user show queries; command aliases; etc

  camillescottatwork

  committed
  84aad67

  Copy full SHA for 84aad67

Commits on Oct 25, 2024

• Slurm command group; subcommands for new QOSes and associations

  camillescottatwork

  committed
  7c08582

  Copy full SHA for 7c08582

• Add --status filtering on user show

  camillescottatwork

  committed
  40b2882

  Copy full SHA for 40b2882

Commits on Oct 28, 2024

• Implement basic n-gram search for users

  camillescottatwork

  committed
  4ceee92

  Copy full SHA for 4ceee92

• Remove deprecated user query and group query subcommands

  camillescottatwork

  committed
  c08cf3e

  Copy full SHA for c08cf3e

Commits on Nov 1, 2024

• Bring in CmdTree and related code from Cryptic

  camillescottatwork

  committed
  a672ff8

  Copy full SHA for a672ff8

• config command and postprocessors

  camillescottatwork

  committed
  5559827

  Copy full SHA for 5559827

• Move EnumAction to args

  camillescottatwork

  committed
  c8d5d36

  Copy full SHA for c8d5d36

• Convert cheeto subcommands to new CmdTree API

  camillescottatwork

  committed
  ab976d1

  Copy full SHA for ab976d1

• Remove a bunch of the old command registration

  camillescottatwork

  committed
  0fb19a2

  Copy full SHA for 0fb19a2

• Fixes to handle_site_ functions

  camillescottatwork

  committed
  21ae791

  Copy full SHA for 21ae791

• Merge branch '_tmp' into ldap-refactor

  camillescottatwork

  committed
  7309256

  Copy full SHA for 7309256

• more arg changes

  camillescottatwork

  committed
  55e6366

  Copy full SHA for 55e6366

Commits on Nov 4, 2024

• Refactor out CmdTree code and use ponderosa; convert database commands to ponderosa

  camillescottatwork

  committed
  2d5b1d0

  Copy full SHA for 2d5b1d0

• Move all commands to cmds submodule, remove some deprecated commands

  camillescottatwork

  committed
  59b7cd3

  Copy full SHA for 59b7cd3

Commits on Nov 5, 2024

• arg cleanup, ponderosa version bump

  camillescottatwork

  committed
  b6ca841

  Copy full SHA for b6ca841

• Remove double logging handler with defaulted /dev/null; instead do no logging by default, log to stderr with --log, and log to file --log=<file>. also allows setting --log-level

  camillescottatwork

  committed
  2011172

  Copy full SHA for 2011172

• Properly enforce uniqueness constraint on GlobalUser and GlobalGroup gids and uids

  camillescottatwork

  committed
  225314e

  Copy full SHA for 225314e

• Fix edge cases in get_next_system_id and related funcs

  camillescottatwork

  committed
  9551a85

  Copy full SHA for 9551a85

• Improved Document pretty-printing and improved new-class command

  camillescottatwork

  committed
  148316a

  Copy full SHA for 148316a

Commits on Nov 20, 2024

• Email templates and impl, updated mongoengine with transaction support, fixes to some subcommands

  camillescottatwork

  committed
  8fcdde9

  Copy full SHA for 8fcdde9

• decompose some subcommands, add commands for adding existing global users and groups to sites

  camillescottatwork

  committed
  e26465f

  Copy full SHA for e26465f

• Allow setting gid in create_user

  camillescottatwork

  committed
  22b278c

  Copy full SHA for 22b278c

Commits on Nov 21, 2024

• force add banner.txt

  camillescottatwork

  committed
  16287f9

  Copy full SHA for 16287f9

• bump version: 1.0

  camillescottatwork

  committed
  d80facf

  Copy full SHA for d80facf

• Fix missing imports; bump version to 1.0.1

  camillescottatwork

  committed
  6d98a1c

  Copy full SHA for 6d98a1c

• Fix subtle bug with site_arg postprocessor

  camillescottatwork

  committed
  6cfc5c3

  Copy full SHA for 6cfc5c3

Commits on Dec 18, 2024

• Add site creation subcommand

  camillescottatwork

  committed
  019750b

  Copy full SHA for 019750b

• Have sync-new-puppet dump 'share' table as well

  camillescottatwork

  committed
  b031e7b

  Copy full SHA for b031e7b

• bump: v1.0.2 -> v1.1.0

  camillescottatwork

  committed
  f7a93f9

  Copy full SHA for f7a93f9

Commits on Dec 23, 2024

• Export /share as 2775

  camillescottatwork

  committed
  b0145e9

  Copy full SHA for b0145e9

• v1.1.1

  camillescottatwork

  committed
  a98d5e3

  Copy full SHA for a98d5e3

Commits on Jan 16, 2025

• mark ldap_synced False in hippo updatesshkey event

  camillescottatwork

  committed
  cf0c510

  Copy full SHA for cf0c510

• 1.1.1 => 1.1.2

  camillescottatwork

  committed
  f8aaecb

  Copy full SHA for f8aaecb

Commits on Jan 17, 2025

• generate hippoapi script

  camillescottatwork

  committed
  bd565eb

  Copy full SHA for bd565eb

• Update gitignore

  camillescottatwork

  committed
  19c55c5

  Copy full SHA for 19c55c5

Commits on Jan 21, 2025

• Add poetry-bumpversion

  camillescottatwork

  committed
  c2381a5

  Copy full SHA for c2381a5

• Add marshmallow import to types.py

  camillescottatwork

  committed
  1d16421

  Copy full SHA for 1d16421

• Implement loading of sub-sites

  camillescottatwork

  committed
  77839d7

  Copy full SHA for 77839d7

Commits on Jan 22, 2025

• v1.1.3

  camillescottatwork

  committed
  156b939

  Copy full SHA for 156b939

Commits on Jan 23, 2025

• Normalize QOS representation between cheeto DB and slurmdb

  camillescottatwork

  committed
  cb66b2f

  Copy full SHA for cb66b2f

• v1.1.4

  camillescottatwork

  committed
  828f37e

  Copy full SHA for 828f37e

• More help info for core subcommands

  camillescottatwork

  committed
  a359fa9

  Copy full SHA for a359fa9

Commits on Jan 24, 2025

• Implement storage source edit command

  camillescottatwork

  committed
  374256b

  Copy full SHA for 374256b

• v1.1.5

  camillescottatwork

  committed
  755a89e

  Copy full SHA for 755a89e

• Improve storage show output

  camillescottatwork

  committed
  5fdc1f7

  Copy full SHA for 5fdc1f7

• v1.1.6

  camillescottatwork

  committed
  3d6f069

  Copy full SHA for 3d6f069

• Reload StorageSource after updating before displaying in storage source edit

  camillescottatwork

  committed
  5ad6d0a

  Copy full SHA for 5ad6d0a

• v1.1.7

  camillescottatwork

  committed
  4b043ec

  Copy full SHA for 4b043ec