Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Consume raw/generator unmerged dump data in MSUnmerged #12059

Open
wants to merge 8 commits into
base: master
Choose a base branch
from
Open

Consume raw/generator unmerged dump data in MSUnmerged #12059

wants to merge 8 commits into from

Commits on Oct 2, 2024

  1. Log each step in the pipeline cleaning up RSE 

    Log error whenever the list of files from RucioConMon is empty
    @amaltaro
    amaltaro committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    7365886 View commit details
    Browse the repository at this point in the history

  2. Fix RucioConMon gzipped response content 

    Return a generator object for gzipped content

Fix generator return value

remove debugging line
    @amaltaro
    amaltaro committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    55a73af View commit details
    Browse the repository at this point in the history

  3. Return unique list of protected LFNS from wmstatsserver

    @amaltaro
    amaltaro committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    cb31ddb View commit details
    Browse the repository at this point in the history

  4. Refactor filterUnmergedFiles method; drop file list/dict

    @amaltaro
    amaltaro committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    9972a0a View commit details
    Browse the repository at this point in the history

  5. Refactor cleanRSE method; list content recursively 

    filterUnmergedFiles method no longer exists

Fix check for isDeletable

Fix key name for dirsDeletedFail

check if ctx object exist before freeing it
    @amaltaro
    amaltaro committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    128da10 View commit details
    Browse the repository at this point in the history

  6. fix unit tests for RucioConMon 

    temporarily remove integration tag for unit tests

fix RucioConMon unit test

fix MSUnmerged unit tests

resolve MSUnmerged unit tests
    @amaltaro
    amaltaro committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    48fdb05 View commit details
    Browse the repository at this point in the history

  7. Standlone script to test gfal rmdir

    @amaltaro
    amaltaro committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    9c9a4d6 View commit details
    Browse the repository at this point in the history

  8. Remove sub-directories before going full scale with file deletion

    @amaltaro
    amaltaro committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    f01c556 View commit details
    Browse the repository at this point in the history