Skip to content

Releases: kpedro88/CondorProduction

v0.6.0

11 Jun 19:40
Compare
Choose a tag to compare
  • add Clean mode to deal with large numbers of log files
  • add stageOut() Bash helper function
  • add option to avoid scram b ProjectRename in case it breaks
  • add option to use gfal-copy for non-xrootd endpoints
  • remove recursive ssh option (no longer useful after FNAL refactor: https://uscms.org/uscms_at_work/computing/setup/condor_refactor.shtml)
  • add and update special settings for FNAL, CMS Connect, UMD
  • handle SL7 operating system
  • code improvements and bug fixes

v0.5.0

27 Jul 16:08
Compare
Choose a tag to compare

This release includes new features:

  • manageJobs.py options: -f, --finished [n] (view only n finished jobs) and -p, --progress (show job progress (time and nevents))
  • manageJobs.py submits schedd.edit() requests in batches when possible (significant speed improvement)

and bug fixes:

  • environment setting XrdSecGSISRVNAMES=cmseos.fnal.gov needed for offsite use of xrdfs root://cmseos.fnal.gov ls
  • typos in step1.sh related to copying CMSSW tarball via xrdcp

v0.4.0

21 Jan 00:28
Compare
Choose a tag to compare

This release includes numerous bug fixes and some new features, introduced after running a large-scale production on CMS Connect.

  • addition of linkScripts.py & associated configuration
  • getFromClassAd() in jobExecCondor.sh to use job ClassAd values in executables
  • allow use of site name in lieu of xrootd address (see https://twiki.cern.ch/twiki/bin/view/Main/XrootdMonitoring#Access_test)
  • store matched site name and machine host name for job management (CMS Connect-specific)
  • add -q, --no-queue-arg for job (re)submission (edits JDL file instead of using condor_submit -queue)
  • allow specifying stuck job threshold for management with --stuck-threshold [num]

v0.3.1

09 Oct 15:33
Compare
Choose a tag to compare

Bug fixes and documentation:

  • require user in manageJobs
  • document limitation of manageJobs with respect to picking up a user-specified backup directory
  • remove use of -e in bash scripts; could cause undesirable behavior (if user wants to handle certain errors within the script instead of just exiting)

v0.3.0

03 Oct 16:52
Compare
Choose a tag to compare

Interface changes:

  • Increased abstraction in jobSubmitter.run(): initRun(), runPerJob(), finishRun() functions
  • Reorganized missing mode and protoJob class to simplify keeping track of job names based on numbers

v0.2.1

03 Oct 15:15
Compare
Choose a tag to compare

Minor updates from v0.2.0: bug fixes, exception handling, README updates.

v0.2.0

26 Sep 22:40
Compare
Choose a tag to compare

Interface change: use OrderedDict to store find/replace patterns for protoJob (easier to override individual patterns).

v0.1.1

26 Sep 22:25
Compare
Choose a tag to compare

Minor addition: cacheAll.py script to expedite caching of unneeded directories before making CMSSW tarballs.

v0.1.0

25 Sep 16:40
Compare
Choose a tag to compare

First tagged release. Currently in alpha stage of development. Basic README describes job submission and management functionality; more examples will be added later.