forked from dmwm/WMCore
-
Notifications
You must be signed in to change notification settings - Fork 0
/
CHANGES
1673 lines (1538 loc) · 87.5 KB
/
CHANGES
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
0.9.84 to 0.9.85:
- Add UFC as a dependency to CRABClient. pull request #4868 from bbockelm
- Get rid of --voms cms when doing myproxy-init. pull request #4867 from mmascher
- Add config_couch_instance to ASO config for CMSWEB deployment. pull request #4862 from HassenRiahi
- Updating oneEventMode for WMCore. pull request #4859 from PerilousApricot
- Move DB imports out of module-level. pull request #4858 from PerilousApricot
- add option for Tier0 specific LFNs. pull request #4861 from hufnagel
- Add WMCore.Services.UserFileCache dependency for crabstaskworker. pull request #4854 from mmascher
- fix phedex injection for dbs3. pull request #4853 from ticoann
- fix cp stageout to always create 775 directories. pull request #4846 from hufnagel
0.9.83 to 0.9.84:
- Merge pull request #4838 from ticoann/error_handler
- Merge pull request #4850 from ticoann/fix_indent_error
- Merge pull request #4848 from ticoann/site_matching_fix
- fix indentation
- Merge pull request #4849 from PerilousApricot/bugfix/crabserver-rpm-fix
- Merge pull request #4847 from mmascher/arbitrary-prescript-CMSSW
- Adding WMCore.WMSpec to crabserver
- Merge pull request #4842 from ticoann/tier0_acqera_fix
- Improve Scram runtime wrapper: allow to use an arbitrary file (even stdout)
- fix potential location list
- Merge pull request #4845 from mmascher/arbitrary-prescript-CMSSW
- Merge pull request #4839 from ticoann/fix_resource_control_unit_test
- Allow the execution of arbitrary scramPreScripts in the CMSSW executor
- fix acquisionEra, processingVersion, processingString set when it is assigned initialization
- Merge pull request #4836 from ticoann/wmagent_monitor_improvement
- Merge pull request #4840 from ticoann/fix_bad_jobcode
- fix bad job code
- fix updateSiteInformation function
- fixes #4832
- Merge pull request #4826 from lucacopa/alarming_improvements
- This Fixes #4820 and #4786 This combine patch includes:
- wmstats disk couch process warning
- Merge pull request #4835 from hufnagel/fixtypo-4822
- fix typo in 4822 merged pull request
- Merge pull request #4822 from hufnagel/http-debug
- Merge pull request #4829 from ticoann/change_default_config_cache
- Merge pull request #4830 from ticoann/add_wmstats_script
- Merge pull request #4831 from ticoann/fix_job_submitter_typo
- fix typo
- add wmstats status change script
- set default config cache name sync with production name
- Merge pull request #4606 from hufnagel/removeiooverrides
- Merge pull request #4828 from lucacopa/dbsUrl_configFile_fix
- Fixes #4827
- print out returned content from http errors
- remove IO overrides
0.9.82 to 0.9.83:
- Merge pull request #4824 from yuyiguo/hidata2
- update Lexicon.py to handle 3 or 4 count of /store/hidata/... lfn by YG
0.9.81 to 0.9.82:
- Merge pull request #4812 from ticoann/resource_control_fix
- fix changeSiteState function
- Merge pull request #4811 from ticoann/filter_success_from_wmstats
- Merge pull request #4803 from ticoann/fix_job_reporting
- Merge pull request #4806 from ticoann/merge_parentage_fix
- Merge pull request #4804 from pkonst/fix-os-requirement
- Merge pull request #4808 from ticoann/disk_postfix_fix
- Merge pull request #4809 from ticoann/need_permission_to_access_reqmgr
- Merge pull request #4810 from ticoann/fix_couchapp_init_script
- fix couchapp init script
- comment out reqmgr archive state update directly
- fix Disk prefix filter
- add unittest
- filter successful jobs propagating to central wmstats
- fix parentage for non merge job
- fix local job couch view due transition change
- Fixed job OS requirement in the JDL
0.9.79 to 0.9.81:
- add task summary table. Pull request #4794
- get rid of -k option in myproxy-logon and remove the server DN from my myproxy credential name (now is only sha1(self.userDN).hexdigest()). Pull request #4789
- Improve AnalyticsDataCollector reporting WMAgentConfig. Pull requests #4788, #4785
- don't use WMAGENT_CONFIG env. Pull request #4784
- change Oracle constraints. Pull request #4783
- support for all in one test. Pull request #4778
- added two json templates for reqmgr client, for hg1309. Pull request #4777
- Fixes # 4618 : Remove tableSpaces and FK Constraints. Pull request #4774
- set default state for wq calls. Pull request #4775
- update the creation time job splitting samples. Pull request #4773
- fix to import HTTPException. Pull request #4770
- remove obsolete retry algorithm code. Pull request #4766
- fix WorkQueue unittest. Pull request #4761
- Add dashboard dependency to reqmgr2. Pull request #4757
- Implement deterministic pileup support. Pull request #4752
- Configure T1 disk sites overrride. Pull request #4739
- Updating dependencies for crabserver, crabclient and aso. Pull request #4637
0.9.78 to 0.9.79:
- add drain mode, handle replication error, filter stalled request, fix agent error nummber update. pull request #4751
- Properly validate processed dataset. Pull request #4733
- Undo the column sizes to the older values. DB complains about limitation. Need to figure out how to change default DB settings. Pull request #4732
- Added wildcard support cmsnameToS(C)E for CRAB 2. Pull request #4731
- Fix issue with None in parameter validation. Pull request #4730
- Fix corner case in EventBased ACDC. Pull request #4728
- Unit test fix after latest patch. Pull request #4726
- Fixes #4618, Increased cache_dir, task, fwjr_path column sizes. Pull request #4725
- ReqMgr2 software versions update problem fixed. Pull request #4723
- add WMStep dep. Pull request #4722
- add crabtaskworker system. Pull request #4721
- Working Version of the updateSiteInfo. Pull request #4653
- Add OS requirement to the jdl. Pull request #4719
- Fix unit tests. Pull request #4717
- ReqMgr2 request validation fixed. Pull request #4714
- reqmgr2 get implementation and test (initial version). Pull request #4713
- Workload validation refactoring. Pull request #4705
- Fix query outdated in Oracle. Pull request #4710
- temp fix for when site information is missing from fwjr. need to find why information is missing. Pull request 4708.
- Fixes for DBS3 duplicate insertions. Pull request #4709
- Improve the JobAccountant logging. pull request #4738
- refactor ErrorHandler code. Pull request #4641
0.9.77 to 0.9.78:
- ReqMgr2 request injection extended, polished. Pull request #4707.
- add GQ LQ link and request alert for assigned, acquired and running status. Pull request #4704.
- ReqMgr1, 2 - StoreResults injection. Pull request #4702.
- ReqMgr2 request injection prototype. Pull request #4701.
- Bugfix for JobUpdater. Pull request #4700.
- ReqMgr2 unittests. Pull request #4697.
- Continuing to silence jenkins
- Trying to silence jenkins
- SimpleMyProxy: use logger from arguments if there is one. Pull request #4694.
- ReqMgr TaskChain request templates added. Pull request #4693.
- RelValMC further clean up. Pull request #4691.
- Fixed issue #4681. Increased VSS limit to 20411724. Pull request #4690.
- Remove the RelVal MC Spec. Pull request #4687.
- Remove PromptSkimming from the system. Pull request #4688.
- Fixed WMExceptions code and duplicate/incorrect errors. issue 4623. Pull request #4685.
- Add /store/mc/* to qualified lfn names. YG. Pull request #4655.
0.9.76 to 0.9.77:
- add check on cert/proxy length. Pull request 4682.
- check voms- exec. pull request #4680
- Update cache area param for ASO. Pull request #4674
- Add AMQ_AUTH_FILE. Pull request #4658
- Kill child process when shutdown. Pull request #4632.
0.9.75 to 0.9.76:
- Configuration defaults for 0.9.69a. Pull request #4676.
- Use stale views in the TaskArchiver. Pull request #4675.
- fix acdc resubmission. Pull request #4668.
- Fix bug in WMBSHelper when no subs are present. Pull request #4663.
- increase default request timeout to 2 min. Pull request #4660
- Catch proxy errors. Pull request #4650
- Clean up the log. Pull request #4639
- Fix location update for Pileup on Generation. Pull request #4629
- Catch duplicate insertions in DBS. Pull request #4626
- Fix bug with updating the logArch location. Pull request #4624
- if parent job don't exist ignore. Pull request #4579.
0.9.74 to 0.9.75:
- ReqMgr2 - request status, request types APIs, other fixes
for VM deployment from CamelCase renaming. Pull request #4669.
0.9.73 to 0.9.74:
- ReqMgr SiteDB v2, forgotten dependency fix. Pull request #4666.
0.9.72 to 0.9.73:
- Replacing old SiteDB v1 API with v2. Pull request #4664.
- Add support in Reqmgr for deterministic pileup. Pull request #4662.
- Allow overrides on the Primary dataset. Pull request #4652.
- Allow multiple DQMConfigCacheIDs in TaskChain. Pull request #4651.
0.9.71 to 0.9.72:
- Using SiteDB v2 API. Pull request #4661.
0.9.70 to 0.9.71:
- WMStats request alert failure warning. Pull request #4657.
- [a lot of commits missing here!]
0.9.69 to 0.9.70:
- ReqMgr2 auxiliary database. Pull request #4619.
0.9.68 to 0.9.69:
- PhEDEx improvement. Pull request #4617
- Remove custodial site. Pull request #4617
- Fix JobPrio update in Condor. Pull request #4616
0.9.67 to 0.9.68:
- Bugfix unit test. Pull request #4611.
- Fix pileup dataset location tracking. Pull request #4607 from dballesteros7
- Fix sizePerEvent for MC. Pull request #4608 from dballesteros7
- fix ListForSubmitter DAO to work with Oracle. Pull request #4605 from hufnagel.
- workaround for CERN xrootd bug. Pull request #4604 from hufnagel
- Bugfixes. Pull request #4602.
- Fix Ops proxy argument. Pull request #4601.
- ReqMgr Oracle/CouchDB consistency work. Pull request #4600 from zdenekmaxa
- Fix column sizes in oracle table. Pull request #4598 from dballesteros7
- Clean working directories when testing patching. Pull request #4597 from PerilousApricot
- Fixed version of MyProxy module UI free, with unit test. Pull request #4592 from cinquo
0.9.65 to 0.9.67:
- Fix issue with DBS3 upload. Pull request #4593
- Implement ACDC cleanup operations in ReqMgr. Pull request #4590
- Deploy DBS3Upload in standard WMAgent. Pull request #4591
- Fix queries for Oracle compatibility. Pull request #4589
0.9.64 to 0.9.65:
- filter out "closed-out","announced","aborted","rejected" status from request alert. Pull request #4583
- Add ACDC Server CouchApp to cmsweb. Pull request #4587
- add detail site job information for request. Pull request #4586
- Fix a few unit tests. Pull request #4585
0.9.63 to 0.9.64:
- Cascade close-out. Implement the option to close-out/announce requests and cascade the status change to all resubmission children for the request. Pull request #4575.
- refactor wmstats adding agent view, adding back search option for job view. Pull request #4577
- Support a many-to-many CMS site to SE relation. Pull request #4576.
- Fix ASO installation scripts. Pull request #4571
- Extend LHEStepZero support. Include a new option that indicates if we are processing lhe input files instead of forking a generator in cmsRun. Pull request #4567
- Align Proxy to the slc6 ui. get-proxy-info returns a string in a different format on the UI found on slc6. Pull request #4559
- Remove site lists for second-level tasks. Pull Request #4568
- Record location changes in WMBS and Couch
- Report where job started. Disregard thresholds for jobs with multiple possible running sites. For monitoring purposes, report one random site in the possible site list as the 'pending' site. Pull request #4557
- Priority handling improvement allowing priorities to span schedds. Pull request #4554
- Fix cases where performance parameters are None. Pull request #4549
- Make robust merge jobs. Pull request #4580, #4566
0.9.62 to 0.9.63:
- Removed GroupUser couchapp from ReqMgr unittests. Pull request #4565.
- Remove unused etc/ReqMgrConfig.py. Pull request #4560.
0.9.61 to 0.9.62:
- Return ProcessingString and ProcessingVersion from the get request ReqMgr
call. Pull request #4563.
- Configuring ASO databases when setting up an agent. Pull request #4553.
0.9.60 to 0.9.61:
- ReqMgr2 project startup. Pull request #4555.
0.9.59 to 0.9.60:
- Add OpenSSL dependency to support new myproxy client by Diego
- Add Jenkins bits to git
0.9.58 to 0.9.59:
- Fix broken DBS3Buffer creation in Oracle. Pull request 4543.
- Store correctly the SizePerEvent and friends. Pull request #4540.
- Add the listDatasetFileDetails API to the DBSReader classes for CRAB3. Pull
request #4539.
- Change the harvesting job splitter to have two distinct modes: periodic and
end of run. Fix StdBase so that it configures the harvesting job splitter
correctly. Pull request #4459.
0.9.57 to 0.9.58:
- Catch empty lumi runs. Pull request #4537.
- Include performance estimates in Condor JDLs. Pull request #4536.
- Avoid re-running performance killed jobs. Pull request #4538.
- Fix the resource control call to load all T1s and T2s which was broken by
the migration to SiteDB V2. Pull request #4532.
0.9.56 to 0.9.57:
- Fix DbsUrl for clones. Pull request #4535.
- ReqMgr - removing wrong DBS URL from configuration. Pull request #4534.
0.9.55 to 0.9.56:
- Merge requested by seangchan
- fix running close eta
- ReqMgr fixed unittets for #4516
0.9.54 to 0.9.55:
- ReqMgr request parameter DbsUrl stored in CouchDB. Pull request #4516.
0.9.53 to 0.9.54:
- Restore DBS Url in CouchDB. Pull request #4515.
0.9.52 to 0.9.53:
- add requestor if not specified. Pull request #4514.
0.9.51 to 0.9.52:
- WMStats April updates. Pull request #4513.
- Fix the initial location for pileup. Pull request #4512.
- Include workflow performance information in the workflow. Pull request #4508.
- Add WMCore.WMSpec.Steps.Templates as a WorkQueue dependency. Pull request
#4511.
- Allow the DBS blocking settings to be specified per request. Pull request
#4471.
- Start tracking the location of pileup data in the WorkQueue. Pull request
#4507.
- Add a validation function for the ReqMgr CouchApp. Pull request #4505.
- Fix the job splitting page in ReqMgr to work in Firefox. Pull request #4503.
- Allow ACDC requests to use xrootd. Pull request #4502.
- Fix the ReqMgr GetRequest DAO so that it fetches all request information. Pull request
#4501.
- Second round of ReqMgr CouchDB values fixes. Pull request #4500.
- First round of ReqMgr CouchDB values fixes. Pull request #4499.
- Updates to ReqMgr Oracle/CouchDB consistency tools. Pull request #4497.
- Further remove per user and group priorities in the ReqMgr. Fix links to broken
pages. Pull request #4495.
- Vastly simplify request priorities by removing per user and group priorities. Pull
request #4494.
- Properly display the ScramArch on the request details page and fix links to the
original config and tweak. Pull request #4492.
- Add support for changing the job splitting parameters for a request from the ReqMgr
command line script. Pull request #4470.
- Properly handle jobs with no input files that go through the cool off state. Pull
request #4493.
- Add Transient OutputModule functionality to the TaskChain request type. Pull request
#4488.
- When updating LogCollect information in WMStats from the JobAccountant don't bomb out
if there is a communication error. Pull request #4481.
0.9.50 to 0.9.51:
- Fixes automatic testing of TaskChain requests. Pull request #4489.
- Fix most unit tests. Pull request #4487.
- Merge pull request #4485 from dballesteros7/FixUnitTests
- Restore the T2_XX_SiteA/B/C sites, SEs and CEs
- Merge pull request #4484 from giffels/sitedbv2-unittest-fix
- Fix broken unittest caused SiteDBv2 emulator. Pull request #4418.
- ReqMgr2 - CouchDB request docs null fields. Pull request #4466.
- SiteDB emulator
- Move Service/SiteDB to SiteDBv2
0.9.49 to 0.9.50:
- Merge pull request #4463 from ticoann/add_acdc_info
- Merge pull request #4467 from hufnagel/lsfsubmitfix
- fix LSF submission when overloaded
- Merge pull request #4461 from dballesteros7/CheckReplicationStatusLQ
- WorkQueue fixes
- add the unittest
- add acdc and agent info in job document
0.9.48 to 0.9.49:
- Fix straight to merge when splitting is changed. Pull request #4457.
- Fix paused jobs script so that it doesn't crash if there are not paused
jobs. Pull request #4455.
- Adds unit test for dashboard reco performance reporting. Pull request
#4434.
0.9.47 to 0.9.48:
- Update file metadata in WMBS if the file already exists. Pull
request #4443.
0.9.46 to 0.9.47:
- Fixes for campaign information in WMStates. Pull request #4453.
- Improve site states functionality. Pull request #4444.
- Fix diagnostics for when CMSSW segfaults. Pull request #4445.
- Fix ACDC for MonteCarlo workflows. Pull request #4452.
- Remove the check for the local wmc-dist-patch script as it is not
shipped with the project source code. It gets included only during
RPM build time. Pull request #4446.
- Include task type priority in LSF jobs. Pull request #4447.
- Fix file deletion in the CERN stageout plugin. Pull request #4412.
0.9.45 to 0.9.46:
- Make sure the campaign is passed to WMStats with ACDC requests. Pull
request #4448.
- Merge pull request #4442 from ticoann/deploy_march_1
- Squashed commit of the following:
- Several WMStats improvements from pull request #4442:
* Reformat the request summary.
* Add log archive location information
* Submit agent information with a POST to avoid errors from
long messages.
0.9.44 to 0.9.45:
- Fix issues with the handling of large requests in the WorkQueue. Pull
request #4439.
0.9.43 to 0.9.44:
- Bugfix in WMStats update document. Pull request #4437.
- Updates to WMStats for the March cmsweb release. Pull request #4436.
- Fix bug in stageout exception handler. Pull request #4435.
0.9.42 to 0.9.43:
- Improve ACDC splitting in the global queue. Pull request #4433.
0.9.40 to 0.9.41:
- Update the ReqMgr database consistency check logs and scripts. Pull request
#4430.
- Fix unit tests that were broken by PhEDEx changes and output ignoring changes.
Pull request #4429.
- Fix a number of ReqMgr issues, pull request #4426:
* Fix issues on the job splitting page
* Fix display of output datasets for request that drop output modules
* Fix the lumiMissingByWorkflow view in the WorkloadSummary.
* Expose AutoApprove sites to ReqMgr.
- Add the ability to create open requests that will pickup new data as it
is added to DBS. Pull request #4425.
- Fix document deletion in CouchDB. Pull request #4424, #4404, #4396.
- When deleting a request in the ReqMgr delete it from CouchDB and Oracle.
Pull request #4423.
- Delete the dead code in the Processing and Production directories for the
ReqMgr. Pull request #4421.
- Fix a number of ReqMgr issues, pull request #4419:
* Change the SoftTimeout default parameters value.
* Add access control when deleting requests.
* Add a state transition from completed to aborted.
* Display all possible LFNs for all requests.
* Fixes for ACDC resubmission.
- Fixes for DBS3 upload only mode. Pull request #4415.
- Archive rejected workflows and disable tracking in WMStats. Pull request
#4414.
- Enforce integer processing versions. Pull request #4402.
- Fix corner cases for smart error handling. Pull request #4407.
- Fix problems with DBS3 upload uncovered during the DBS2/3 consistancy
check. Pull request #4406.
- Prevent the TaskArchiver from crashing if central CouchDB is down. Pull
request #4397.
- Fix a typo in the CouchCoucPoller. Pull request #4393.
- Add suport for stageout from the HLT Cloud at CERN. Pull request #4401.
- Support ReqMgr localhost testing/running. Pull request #4395.
0.9.39 to 0.9.40:
- Fixes from the testing of DBS3 upload. Pull request #4391.
- add script to unregister agent when agent is retired or inactive.
Pull request #4389.
- check components are alive using pid and also thread status. Pull
request #4381.
- Fix unit tests breakage due to Specs_t. Pull request #4387.
- Get the correct times out of a report if any. Pull request #4385.
- ReqMgr testing enhanced by TaskChain requests. Pull request #4384.
- ReqMgr CustodialSite bug fix. Pull request #4379.
0.9.38 to 0.9.39:
- Display the amount of time a request has been in a particular state in
WMStats. Pull request #4374.
- Fix the priority setting of cloned requests. Pull request #4377.
- Fix the cmsRun configuration for DQM harvesting jobs. Pull request #4371.
0.9.37 to 0.9.38:
- Fix accounting of lumis when a run black/white list is specified for a
request. Pull request #4369.
- Add a column to the job table in WMStats to display the number of queued
jobs. Pull request #4370.
0.9.36 to 0.9.37:
- Give the t0-operator role writer permissions in WMStats. Pull request
#4365.
- Fix PREP ID search in WMStats. Pull request #4367.
- Retry WMStats replication when it fails. Pull request #4362.
- Remove the t0wmstats dependencies. Pull request #4359.
- The aborted-archived and normal-archived are final states and transitions out
of them should not be allowed. Pull request #4360.
- Fix the EventBased splitting algorithm to work around issues with zero event
lumis. Pull request #4361.
- Make sure that the run white and black lists gets passed to the job splitting
algorithms so that they can use them. Pull request #4368.
- Fix the DBS3Uploader and modify it to support an upload only mode. Kill off the
SQLite code in DBSBuffer and DBS3Buffer. Pull request #4358.
0.9.35 to 0.9.36:
- Minor ReqMgr fixes. Pull request #4357:
* Cloned requests will beging in the assignment-approved state instead
of new.
* PhEDEx subscriptions arguments have been added into the JSON request
template.
- Add the ability to not stage the output of a particular output module
to merged storage. Pull request #4355.
0.9.34 to 0.9.35:
- Add an option to the PhEDExInjector to make only replica subscriptions. Pull
request #4354.
- Fix a bug with the handling of requests with the running-open and running-closed
status in WMStats. Pull request #4353.
- WMStats updates - Add the ability to search by date and Prep ID,
improve the request detail view, add a couch status monitor, fix a
bug when filtering and data is being refreshed. Pull request #4352.
- ReqMgr2 - Oracle, CouchDB database cleanup. Pull request #4351.
- Update the ALCAHarvest runtime code to support the new dropbox
format. Pull request #4950.
- Fix EOS StageIn at CERN. Pull request #4349.
- Fix the DQM Harvesting job splitter so that it properly handles sites
with multiple SEs. Pull request #4348.
- Fix WMBSMergeBySize for sites that have multiple SEs. Pull request
#4347.
0.9.33 to 0.9.34:
- Fix sandbox creation so that is works with patch releases. Pull request #4339.
- Display docstrings in RESTAPI documentation. Pull request #4340.
- Fix the handling of the site parameter in the error summary when the site
is an empty dictionary. Pull request #4342.
- Fix smart lumi splitting when running over a too big single lumi file.
Pull request #4334.
- Fix the cleanup of the workflow timestamp cache in the JobSubmitter. Pull
request #4335.
- Remove dead code and view from the ReqMgr couchapp. Pull request #4332.
- Avoid crashes on custodial PhEDEx subscriptions to non-MSS sites. Pull
request #4325.
- Ensure that the JobSubmitter submits jobs from the oldest workflow first.
Pull request #4327.
- Add a method to WMStatsReader that reports requests sorted by state that also
includes a timestamp of the last state transition. Pull request #4328.
- Remove dead code from the ConfigCache and clean up views. Pull request
#4324.
- Fix WMStats so that it functions correctly when there are no jobs in a
request. Pull request #4326.
- Deploy WorkloadSummary with reqmon instead of ReqMgr. Pull request #4232.
- Add a merged flag to the FWJR so that it's possible to calculat lumi information
for monitoring. Pull request #4336.
- WMStats feature development, pull request #4345:
* Change the layout of the warning and summary box.
* Add more filters.
* Propagate more information (lumi, performance, job type)
0.9.32 to 0.9.33:
- Publish job state transition information to WMStats. Pull request #4311.
- Fix timeout kills in the LSF plugin. Pull request #4322.
- Remve the unused RemoteMsg component and OpsClipboard. Pull request #4316
and #4319.
- Make permissions stricter in the ReqMgr when changing request parameters.
Pull request #4313.
- Change LogCollect reporting from a reduce to list to avoid reduce overflows. Pull
request #4312.
- Do the SE name => Site name conversion also for failed jobs. Pull request #4308.
0.9.31 to 0.9.32:
- Fix Reduce function for outputByWorkflowName. Pull request #4310.
- Include the new PSet pickle in the logArchs. Pull request #4307.
- Added basic http(s) url validation for DBS3. Pull request #4306.
0.9.30 to 0.9.31:
- Improve the WorkloadSummary. Add histograms for failing jobs per site and per
step. Add a routine the determine missing lumis in a request. Finally, improve
the unit test in the TaskArchiver for the WorkloadSummary. Pull request #4298.
- Fix the WorkloadSummary unit tests. Pull request #4304.
- Make sure that the status change time is an INT so that it doesn't cause problems
on Oracle. Pull request #4301.
- Allow /store/hidata and /store/himc to be used as base LFNs when assigning
requests. Pull requests #4300 and #4302.
- Add support for requests that read data via xrootd. Pull request #4299.
- Allow the use of configs from the ConfigCache for DQM harvesting. Pull request #4295.
- Allow the user to determine the config cache database to use when making request.
Add a handful of improvements to the ReqMgr Ops script. Pull request #4293.
- Adds a real LogCollect fwjr to the TaskArchiver test and changes to support it better.
Changes in the summary document. Pull request #4291.
- Remove restriction of autoapprove on custodial subscriptions. Pull request #4288.
- Fix the resource control script which had the pending and running slots swapped.
Pull request #4283.
- Check for null auth in the Workload Summary cuchapp and all it. Pull request #4284.
- Propagate output dataset information to WMStats. Pull request #4279.
- Fix the resource control class to correctly insert job types. Pull request #4277.
- Check that files contains at least one good lumi before adding them to WMBS. Pull
request #4285.
- Make component sleeping more configurable. Pull request #4246.
- Add support for veryinf an adler32 checksum in the LCG module. Pull request #4222.
- Remove the auto increment check in the JobCreator as it caused more problems than it
solved. Improve the ChangeState code to handle update conflicts as a more reasonable
work around. Pull request #4147.
- Catch any exceptions that occur when attempting to overwrite a FWJR file. This solves a
problems where permissions may be set incorrectly on FWJR files. Pull request #4164.
0.9.29 to 0.9.30:
- Fix unit tests broke by pull request #4270. Pull request #4272.
0.9.28 to 0.9.29:
- Implement Pending jobs per task/site functionality. Pull request #4270.
- Add support for Tier0 run states to the AnalyticsDataCollector.
Pull request #4265.
- Fix the broken stageout override code. Pull request #4261.
- Add a method to the lexicon to validate DBS users. Pull request #4239.
- Add support for CVMFS based on HN conversation and identical CRAB boostrapping
code. Pull request #4258.
- Fix a typo in the jobStatusByWorkflowAndSite view. Pull request #4220.
- Implement request cloning in the ReqMgr. Pull request #4237.
- Add support for creating ACDC requests that run over arbitrary
collection names. Pull request #4242.
- Display all errors correctly in the workload summary. Pull request #4244.
- Clean up ConfigCache parameter naming. Pull request #4223.
- Delete job summary data for requests that are announced or
aborted. Pull request #4227.
- Add support for overriding the location for files injected into
PhEDEx. Pull request #4260.
0.9.27 to 0.9.28:
- ONEOFF build for Zdenek to revert his previous patch
- Bugfix StdBase DQMHarvest validation
- Remove updates in cancellation - stop conflicts
- Revert "Revert "Ops ReqMgr interaction script, ProcConfigCacheID renaming""
0.9.26 to 0.9.27:
- Bugfix for wmagent-mod-config from fancy PhEDEx transfers commit.
Pull request #4231.
- Bugfix for PrimaryDataset handling in RelVal. Pull request #4228.
- Add per-request switch for stageout. Pull request #4194.
0.9.25 to 0.9.26:
- Improve error handling in Dashboard runtime. Pull request #4208.
- Fix a bug in GetAndMarkNewFinishedSubscriptions. Pull request #4208.
- Create error report for createFailed jobs. Pull request #4206.
- Make maxRetries flexible between job types. Pull request #4137.
- Implement alternative fileset closing policy. Pull request #4209.
- Add t0wmstats dependency. Pul request #4203.
- ReqMgr unittests fixes, removing hardcoded CMSSW version in tests,
tests cleanup. Pull request #4202.
- Fixing giant log files/memory leaks. Pull request #4196.
- A large amount of whitespace fixes. Pull request #4150.
0.9.24 to 0.9.25
- Change acdc integration test to look at all previous requests for one
to resubmit
- Test inject script fixed, unittests fixed, some improved logging and
exception handling
0.9.23 to 0.9.24:
- Add the ability to ignore select output modules in ACDC requests. Pull request #4099.
- Ensure canceled workflows get cleaned up. Pull request #4160.
- Set SplitOnRun back to true in LumiBased. Pull request #4128.
0.9.22 to 0.9.23:
- Improve error handling in AnalysisDataCollector. Fixes #4187.
- Removing extra slash from analysis spec. Fixes #4131.
- Bugfix for validation of DQM Harvesting parameters. Pull request #4129.
0.9.21 to 0.9.22:
- Store phedex subscription information in workloads and propagate this
information to DBSBuffer so that we can be smarter about which PhEDEx
subscriptions are made. Pull request #4171.
- Better handling of the initial LFN counter. Pull request #4174.
- Obsolete Alerts couchapp removed, AlertsCollector replication finalized.
- Fix file deletions in the CERN rfcp stageout plugin. Pull request #4126.
- Change the query used to find completed subscriptions so that subscriptions
are deleted top down instead of bottom up. Pull reuqest #4167.
- Make TaskChain more configurable. Pull request #4175.
- Add a job splitting algorithms that is a hybrid of LumiBased and
EventBased. Pull request #4127.
- Merge the Tier1PromptReco and PromptReco specs. Pull request #4118.
0.9.20 to 0.9.21:
- Include the jobType in all jobs run through ChangeState. Pull request #4169.
- Change the monitor status when assignRequest is called directly. Pull request #4166.
- Include the JobSubmmary link to the WMStats job summary. Pull request #4168.
- Fix alerts not sent in StatusPoller, wrong usage of getattr, and print the stacktrace
of the generic Exception thrown. Pull request #4161.
0.9.19 to 0.9.20:
- Improvements to the WMStats monitor layout. Add support for running without a
ReqMgr to support the Tier0 and Analysis. Pul request #4157.
- Combine the TaskArchiver and CleanupManager to handle cases where the
ReqMgr is not used. Pull request #4142.
- Upload the toPublish.json with the user's credentials. Fixes #4135
- Fix RequestManager unittests. Pull request #3958.
- Fix ReqMgr and WorkQueue URL for the integration tests.
- Merge pull request #4125 from dballesteros7/fix-taskarchiver-bug
- Fix the cleaning of filesets with no subscriptions in the TaskArchiver.
Pull request #4125.
- Fix the inputAsyncStageOut view: delete undefined task variable. Pull request #4123.
- Use copy.copy instead of copy.deepcopy so that we don't try to copy the logging
object in the gLite BossAir plugin. Pull request #4120.
- Add a log message in WorkQueueReqMgrInterface when there is a problem processing
a request. Pull rquest #4122.
- Fix TaskChain unit test. Pull request #4119.
- Reduce default couchdb queue size for ChangeState. Pull request #4079.
0.9.18 to 0.9.19:
- Write the CMSSW configuration as a binary pickle file to avoid issues
with non-binary pickled configs. Pull request #4109.
- Make LogCollect optional for PromptReco. Pull request #4068.
- Make teams optional for the Global WorkQueue.
- Set several move parameters for AsyncStageout in
wmagent-mod-config. Pull request #4106.
- Remove unneeded parameters in the Async Stageout inputAsyncStageOut
view. Pull request #4101.
- Increate the size of the LFN column in DBSBuffer. Fixes #4907.
- Add the "New" state to the LSF BossAir plugin map. Pull request #4080.
- Initial version of the ReqMgr integration tests. Pull request #4070.
- In the paused-jobs utility update the job summary when unpausing jobs.
Pull request #4111.
- Propagate job state changes to WMStats in the RetryManager's PauseAlgo.
Pull request #4096.
- Bug fixes for AlcaHarvesting. Pull request #4105.
- Put the LumiMask in the spec instead of pulling from ACDC. Fixes #3968.
- Improve the TaskArchiver so that it pulls run and lumi information from
WMBS instead of the JobDump. Improve the queries used to find finished
subscriptions. Pull request #4073.
- Fix a typo. Pull request #4107.
- Fix the WorkQueue so that couch conflicts don't block request completion.
- Add a view to aid in T0 backlog monitoring. Pull request #4065.
0.9.17 to 0.9.18:
- Fix WMStats user validation. Pull request #4103.
0.9.16 to 0.9.17:
- Add the ability to turn off DQM Harvesting. Pull request #4093:
o If the "DisableHarvest" parameter is present in any request DQM harvesting
will be disabled.
- Make the RetryManager more flexible. Pull request #3961:
o Different job types can be assigned different cool off parameters and
algorithms.
- Fix handling of request timeouts in the WorkQueue. Fixes #4087.
- Fix the CleanupManager so that it doesn't crash when they are issues
communicating with couch. Fixes #4088.
0.9.15 to 0.9.16:
- Add support for specifying pileup information for individual tasks in
TaskChain requests. Pull request #4084.
o The MCPileup or DataPileup parameter may be added to any task
dictionary.
0.9.14 to 0.9.15:
- Only add new files to open blocks in the Local WorkQueue.
- Fix the closing of open blocks in the Global WorkQueue.
0.9.13 to 0.9.14:
- Refactor WMStats monitoring. Include support for the Tier0 with monitoring
of runs and paused jobs. Pull request #4059.
- Add options to filter by site and task in the paused jobs tool. Fixes #4061.
- Change alert address alert emails are sent from to [email protected].
Improve the behavior of process pollers. Pull request #4060.
- Fix Tier0 DBS2 upload problems. Pull request #4064.
- Fix a typo in the MockPlugin. Fixes #3931.
- Cut off error messages at a 1000 characters in the UpdateWorkerError DAO.
Pull request #4062.
- Improve the performance of the SiblingSubscriptionsComplete DAO. Pull
request #4072.
- Add the Harvesting task type when adding tasks for the resource control.
Pull request #4071.
- Remove the duplicate TimePerEvent field in the ReqMgr request creation form.
Pull request #4075.
- Fix the Resource Control unit test which was broken by #4071. Pull
request #4077.
- Improve WorkQueue cancellation handling. Fixes #3856.
- Remove the symlink to the couchskel from the wmagent-couchapp-init script.
Pull request #4081.
- Fix Condor JDL so that all strings are quoted. Pull request #4083.
- Don't throw 500 errors in the ReqMgr if a request isn't in WMStats. Pull
request #4082.
- Look for killed jobs in the JobArchiverPoller. Pull request #4085.
0.9.12 to 0.9.13:
- Make the inputMode parameter optional and default it to couchDb. Pull
request #4057.
- Fix the AlcaHarvest run time code so that it's output works with the
JobAccountant. Pull request #4056.
- Fix issues in the gLite BossAir plugin when retrieving a user's proxy.
Pull request #4058.
0.9.11 to 0.9.12:
- Store CMS Names in the drain list instead of site names. This fixes
draining in the JobSubmitter. Pul request #4049.
- Add the GlobalTag parameter to WMTweaks. Pull request #4051.
- Fix build problems due to import of cherrpy. Pull request #4054.
0.9.10 to 0.9.11:
- Improve automated unit testing including a known-failing-tests whitelist.
- Rewrite AllertsCollector for cmsweb. Pull request #4008.
- Add a script that allows running tests against the DMWM Jenkins. Pull
request #4015.
- Use pickle instead of dumpPython when serializing CMSSW PSets. Fixes #4009.
- Make ErrorHandler, TaskArchiver and JobArchiver logs more verbose so that it
is easier to tell if a component is locked up. Pull request #4024.
- Implement general DQM harvesting in WMAgent. Pull request #4032:
o Any workflow that produces DQM or DQMROOT data will have that data
harvested and uploaded to the DQM GUI.
o The ProcScenario parameter is now mandatory. This parameter will be
passed to Configuration.DataProcessing to create the harvesting config.
If the inputMode parameter is "scenario" than the same scenarion will be
used to create the processing config.
o There is an optional parameter DqmSequences that can be submitted at
request creation time. It is a list of strings just like a block
black/white list.
- Handle open blocks in the WorkQueue. If a request runs over open blocks
periodically check them. Once a block is closed it will be injected into
WMBS. Fixes #3980.
- Add support for Alca Harvesting. Pull request #4045.
- Fix loading of javascript for the Analysis view in WMStats. Pull request #45
- Fix issues between wmagent-couchapp-init and couchskel. Pull request #42
- Load the the job in the ListForSubmitter DAO so that the job is handled
properly during submission errors. Pull request #3964.
- Fix the UnpackUserTarball script to work with XRootD. Pull request #3955.
- Fix reporting of pending and submit jobs in WMStats. Pull request #3985.
- Improve WorkQueue stuck element diagnostics. Add checks for parent data
locations.
- Prevent WorkQueue from crashing on WMStats errors.
- Remove the HarvestingScheduler component. Pull request #3995.
- Make the FindDASToUpload DAO work on Oracle. Pull request #3996.
- Change the TaskArchiver subscription delete order to avoid deleting
directories out of order. Pull request #3997.
- Make sure the name attributes exists in jobs handled by the JobSubmitter
so that jobs that fail submission don't crash when being reorted to
the JobDump. Pull request #4001.
- Correctly handle jobs that don't have plugins when reporting their state
to the dashboard. Pull request #4003.
- Project the JobTracker from invalid FrameworkJobReports. Pull
request #4004.
- Fix the filtering of run and lumi information when interacting with ACDC.
Pull request #3952.
- Update the new storage/stageout plugins. Pull request #43.
- Update the Vanderbilt storage plugin to work better with stagein. Pull
request #3951.
- Remove obsolete Periodic and EndOfRun job splitters. Pull request #3993.
- Fix WorkQueue MonteCarlo splitting unit tests.
- Increase the WorkQueue retry time to one day.
- Limit the WorkQueue get work call to a managebale number of workflows.
Fixes #4006.
- Do not cause the ReqMgr to throw an error if a request does not exist in
WMStats. Pull request #4021.
- Remove DAOs for the deprecated Periodic and EndOfRun job splitting
algorithms. Pull request #4030.
- Fix unit tests for UnpackUserTarball. Fixes #3680.
- Fix BossAir unit tests. Pull request #4025.
- Change WorkQueue splitting to use one lumi section per job instead of 1000
events per lumi section. Pull request #3956.
- Simplify and cleanup the DQM harvesting code. Pull request #4034.
- Include the request name in the condor JDL. Pull request #4040.
- Fix issues initializing the FWJR. Pull request #4042.
- Improve handling of missing directories in the TaskArchiver. Pull
request #4046.
0.9.9 to 0.9.10:
- add acive request tier0 support, layout change and hanle no request case
- group permission fix
0.9.8 to 0.9.9:
- add api for generic request insert (for T0)
- fix estimated time and task level injection percentage
- Fixing vanderbilt's stagein code.
- fix transition change
- Fix dashboard task reporting
- Catch infinite splitting loops in workqueue
- Set defaults for some assign fields
- Add missed wmagent dependencies.
- For some reason, nose is returning None instead of the test name
- Ticket #3888 missed this GROUP_BY statement
0.9.7 to 0.9.8:
- Strip run and lumi information from job objects as it can be huge and isn't needed. Fixes #3946.
0.9.6 to 0.9.7:
- Missing patch from #3945.
0.9.5 to 0.9.6:
- Attempt to handle invalid transactions better in the monitoring. Fixes #3914.
- Merge pull request #30 from ticoann/monitoring
- Fix ReqMgr handling of json encoded parameters. Fixes #3933.
- Allow setting the processing version per task for TaskChain requests. Fixes #3896.
- Fix rewrite rule for allDocs in couchskel. Fixes #3932.
- Kill jobs by WallClock time from the WN. Fixes #3945.
- Require performance information when creating a request. Fixes #3942.
- More support for DQM Harveting in the PromptReco spec. Fixes #3952.
- Merge branch 'master' of github.com:dmwm/WMCore
- Merge pull request #29 from hufnagel/mydev1
- remove sqlite support
- Merge pull request #28 from samircury/harvest-optional-proxy
- Merge pull request #26 from hufnagel/master
- Merge pull request #23 from dballesteros7/promptskimming
- Merge branch 'master' into harvest-optional-proxy
- Revert "adding the task without proxy"
- Revert "Now adds the proxy, all T0 share is commited in the other repo"
- making the proxy optional for the harvest task
- support Tier0 repack error datasets in WMCore, fixes #3949
- change unit test to cover another use case, fixes #3885
- rewrite SiblingSubscriptionsComplete DAO, fixes #3885
0.9.3 to 0.9.5:
- Last time.
0.9.2 to 0.9.3:
- Another attempt.
0.9.1 to 0.9.2:
- New release to test build script.
0.9.0 to 0.9.1:
- Merge pull request #20 from stuartw/patch/buildrelease/github
- Fix broken buildrelease script
- Merge pull request #19 from stuartw/patch/buildrelease/github
- Missed line in buildrelease move to github
- Modify buildrelease script for pure git
- Merge branch 'wmcore-rest'
- Merge pull request #17 from samircury/dqmupload-fix-proxy
- Merge pull request #18 from hufnagel/mydev
- add DQM harvest method to StdBase, fixes #3863
- add special DAO for Harvest job splitter, fixes #3825
- adding a DAO that Harvest Jobsplitter needs
- adding the harvest algorithm
- adds unit test for the Harvesting algorithm
- Commenting out the only part that prevents DQMUpload to work in T0
- Merge pull request #16 from sfoulkes/master
- Fix problems with disabling straight-to-merge. Fixes #3909.
- Merge pull request #15 from sfoulkes/master
- Remove test lines from the CHANGES file.
- Merge remote branch 'upstream/master'
- Test commit.
- Dummy commmit, please ignore
- Merge branch 'svnmaster' into wmcore-rest
- Change XML output format to support arbitrary keys.
- Allow authz_match to work (and fail) if user is missing.
- Fix new substitutions to work also in absence of values.
- Allow value and file substitutions on the front page.
- Not all PUT/POST requests bodies have rfile.
- REST API classes from SiteDB.
- External files removed by automatic javascript compression.
- Add setup.py --compress option to minify HTML, CSS and JS assets.
- Split module documentation into individual files.
- Add setup.py --skip-docs option to skip documentation build.
8.50 to 0.9.0:
- Massive monitoring rewrite.
- Improve the performance of the ErrorHandler when loading jobs that have
input files with large numbers of lumi sections. Fixes #3925.
- Make loading parentage information when loading files in a fileset optional. Fixes #3919.
- Load the task name in the LoadFromIDWithWorkflow DAO. Fixes #3922.
- Strip error message from GWQ to 1000 characters
- Log traceback for workqueue split errors if unknown exception
- Complain if no acdc section in resubmission task.
0.8.49 to 0.8.50:
- Improved ResourceControl and job scheduling. Fixes #3888.
- Support DQM sequences in the PromptReco and Tier1PromptReco specs. Fixes #3879.
- Fail input files for paused jobs that are failed. Fixes #3897.
- Update run and lumi information in WMBS if it is missing. Fixes #3875.
- Cleanups to the Tier1PromptReco spec. Fixes #3850.
- Properly handle files with 0 events in the WorkQueue and job splitting. Fixes #3596.
- Don't kill jobs with a state time of 0. Fixes #3889.
- Make the ForceUnmerged parameter disable straight-to-merge. Fixes #3890.
- Don't associate a CMSSW version with a request if one doesn't already exist. Fixes #3883.
- Report the grid name properly to the dashboard. Fixes #3808.
- Report the plugin used for job submission to the dashboard. Fixes #3893.
- Improve logging in the bootstrapping code. Fixes #3898.
- Ensure that CouchDB URLs do not end in a '/'. Fixes #3899.
- Modified analysis WMSpec: it does not send a logcollect job if saveLog=False. Fixes #3855
- Modify the ParentlessMergeBySize and SiblingProcessingBased subscriptions so that
they work correctly with files available at multiple sites. Fixes #3906.
- Handle some issue with the ConfigSection stuff with nested containers and nested ConfigSections. Fixes #3891.
- Add DBSPublisher.couch_instance to wmagent-couchapp-init and wmagent-mod-config, fixes #3892
- Add storage to wmc-runtime package
- Fix bossair monitoring query to support oracle (T0)
- Add postfields parameters for DELETE verb. Fixes #3860
0.8.48 to 0.8.49:
- Fixups from the last PromptSkimming fixups. Fixes #3864.
- Fix ReqMgr unit test failures. Fixes #3708.
- Cleanup the local workqueue inbox in the PromptSkimming system. Fixes #3857.
- Don't abort a workflow if the user doesn't have permissins. Fixes #3859.
- More white space fixes in UserFileCache. Fixes #3813.
- Fix the handling of datasets that reside in more than one block. Fixes #3845.
- Better protections in the PromptSkimming system for configs that don't get uploaded. Fixes #3843.
- Update alert thresholds. Fixes #3651.
- Add an extra digit to the LFN counter to that datasets produced by different WMAgent instances don't go into the same directory. Fixes #3820.
- Stop the WorkQueue from polling the entire dataset in DBS for PromptSkimming workflows. Fixes #3822.
- Fix the initialization of the first lumi and first event in StdBase. Fixes #3828.
- Support a pileup parameter for TaskChain requests. Fixes #3827.
- WMBSFileFeeder not feeding draining sites. Fixes #3834
- Report the number of events processed/produced by a job to the dashboard. Fixes #3805.
- Identify step attributes with a counter for dashboard reporting. Fixes #3803.
- Add Add couch_user_monitoring_instance to wmagent-mod-config, fixes #3823
- Add the possibility to specify the lenght of the myproxy. Fixes #3819
- Remove unused subdir parameter. Fixes #3800
- Fix some white space corruption. Fixes #3813.
0.8.47 to 0.8.48:
- Guard against empty arguments with Config/DataProcessing configs. Fixes #3797.
- Fix PromptSkimming processing version handling. Fixes #3775.
- Change the default log level for dashboard reporting. Fixes #3717.
- Ignore data from CouchDB that doesn't have a valid site. Fixes #3786.
- Don't require bl_runjob to link to a valid user. Fixes #3791.
- Add run number to PromptSkimming LFNs. Fixes #3793.
- Fix races in PromptSkimming between workflow cleanup and data transfer in the T0. Fixes #3787.
- Support Tier0 LFN conventions in the standard specs. Fixes #3277.
- Update thresholds in the AlertGenerator config.
- Adapted UserFileCache module to the new rest (removed backward compatibility). Fixes #3780,#3662
- Force MySQL to use the best join order for the JobStatusForMonitoring query. Fixes #3778.
- Allow requestors to specifiy an initial event and initial lumi. Fixes #2272.
- Add events_per_lumi option to EventBased splitting. Fixes #3744.
- Fix the running time calculation so that it ignores job restarts. Fixes #3772.
- Fix the WMTweak firstLumi/event treatment. Fixes #3714.
- Add a LHEStep0 workflow. Fixes #3712.
- Add two new base LFNs to the request web interface options. Fixes #3755.
- Modify the WMBS schema to allow for larger event numbers. Fixes #3754.
- Make test division stable when adding new tests. Fixes #3761.
- Attempt to trap os._exit() calls made by cherrypy. Fixes #3760.
- Fix the unit tests for the couch based agent package. Fixes #2178.
- Guard against incorrect config URLs in PromptSkimming. Fixes #3767.
- Improve reports when a job is killed. Fixes #3766.
- Fix performance monitoring thresholds. Fixes #3765.
- Modified the wf name in the fake report. Fixes #2859
- Fix pileup support. Fixes #3711
- Update CVSROOT in buildrelease script.
0.8.46 to 0.8.47:
- Update Lexicon to handle old tier0 LFNs. Fixes #3752.
- Test alerts in the JobTracker unit test. Fixes #3326.
- Add cron entries to build alert views. Fixes #3736.
- Add support for security parameters using instances. Fixes #3751.
0.8.45 to 0.8.46:
- Alert system unit test fixes. Fixes #3701.
- Fix problems with the GetSiteSE DAO. Fixes #3318.
- Use a view that actually exists to trigger view rebuilding.
- Fix the Emulator unit test. Fixes #3716.
- Added key and certificate to Un packUserTarball. Fixes #3479
- Fix cherrpy port/address handling. Fixes #3709.
- Update the test harness so that testers have more control over what is run. Fixes #3699.
- Fix another DAO that broke due to the multi-se changes. Fixes #3700.
- Fix unit test breakage. Fixes #3696.
- Allow overriding the TFC from the spec. Fixes #3311.
- Resolve some problems automatically configuring resource control with sites that have more than one SE.
- Fix the Oracle SiblingSubscriptionsComplete DAO that was broken by the multi-SE patch. Fixes #3318.
- Fix the GetSiteSE DAO. Fixes #3687.
- Update the couch app stateTransition update function to work correctly if the document doesn't exist.
0.8.44 to 0.8.45:
- Initial PromptReco spec. Fixes #3684.
- Fixup LFN conventions. Fixes #3653.
- Support sites with more than one SE. Fixes #3318.
- Remove the CouchURL from the default Tier1PromptReco test arguments. Fixes #3678.