Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Run hltPhase2UpgradeIntegrationTests in IB, add option to run hlt p2 integration script for PRs #2354

Merged
merged 3 commits into from
Oct 2, 2024

Conversation

mmusich
Copy link
Contributor

@mmusich mmusich commented Oct 2, 2024

Title says it all:

  • Run hltPhase2UpgradeIntegrationTests in IB, fe7c021
  • add option to run hlt p2 integration script for PRs, a7fba11

I didn't really test any of this, I am particularly unsure about the second bullet, which is largely based on #2240.

@cmsbuild
Copy link
Contributor

cmsbuild commented Oct 2, 2024

A new Pull Request was created by @mmusich for branch master.

@aandvalenzuela, @cmsbuild, @iarspider, @smuzaffar can you please review it and eventually sign? Thanks.
@antoniovilela, @mandrenguyen, @rappoccio, @sextonkennedy you are the release manager for this.
cms-bot commands are listed here

@cmsbuild
Copy link
Contributor

cmsbuild commented Oct 2, 2024

cms-bot internal usage

@@ -39,6 +39,12 @@ cd HLTrigger/Configuration/test/
ls
./runAll.csh IB | tee -a $WORKSPACE/results/runIB.log
./examLogs.csh | tee -a $WORKSPACE/results/examLogs.out
which hltPhase2UpgradeIntegrationTests || true
if [ $? -eq 0 ]; then
Copy link
Contributor

@smuzaffar smuzaffar Oct 2, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@mmusich , I think this will always pass due to || true so $? will always be 0. You can just do

if which hltPhase2UpgradeIntegrationTests 2>/dev/null ; then

# Upload results
source $WORKSPACE/cms-bot/jenkins-artifacts
touch ${RESULTS_DIR}/15-hlt-p2-integration-report.res ${RESULTS_DIR}/15-hlt-p2-integration-failed.res
if [ -f $WORKSPACE/rundir/Phase2Timing_resources.json ] ; then
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@mmusich , so hltPhase2UpgradeIntegrationTests is support to generate this json file?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@cmsbuild
Copy link
Contributor

cmsbuild commented Oct 2, 2024

Pull request #2354 was updated.

@smuzaffar
Copy link
Contributor

+externals

looks good to me. There is nothing we can test via PR tests at this time. Lets merge it so that bot can recognize the hlt_p2_integration

@cmsbuild
Copy link
Contributor

cmsbuild commented Oct 2, 2024

This pull request is fully signed and it will be integrated in one of the next master IBs after it passes the integration tests. This pull request will now be reviewed by the release team before it's merged. @sextonkennedy, @mandrenguyen, @antoniovilela, @rappoccio (and backports should be raised in the release meeting by the corresponding L2)

@smuzaffar smuzaffar merged commit fe6bbd7 into cms-sw:master Oct 2, 2024
2 of 4 checks passed
@smuzaffar
Copy link
Contributor

@mmusich , I am setting up jenkins job to run the pr test. Any idea how long time test should run? Does it run in single thread/process mode ? Do we need any special resources or can we run it on lxplus?

@mmusich
Copy link
Contributor Author

mmusich commented Oct 2, 2024

Any idea how long time test should run? Does it run in single thread/process mode ?

in my tests it runs in around 30-40 minutes on lxplus. By default I am using 4 parallel cmsRun executions, each one single threaded.

https://github.com/cms-sw/cmssw/blob/17aa1f4d4bab45f9bbf0479f068dbf699efb8d30/HLTrigger/Configuration/scripts/hltPhase2UpgradeIntegrationTests#L57-L58

@smuzaffar
Copy link
Contributor

smuzaffar commented Oct 2, 2024

By default I am using 4 parallel cmsRun executions

is there a way to control the parallel execution? For IBs, the HLT tests run on batch nodes ( with 8 or 16 cores). It will be waste of resources if it run 4 single threaded cmsRun jobs on 16 core node. Can we pass -j $(nproc) to hltPhase2UpgradeIntegrationTests to control the parallel processes?

@mmusich
Copy link
Contributor Author

mmusich commented Oct 2, 2024

Can we pass -j $(nproc) to hltPhase2UpgradeIntegrationTests to control the parallel processes?

we could use the builtin option hltPhase2UpgradeIntegrationTests --parallelJobs $(nproc).

@smuzaffar
Copy link
Contributor

ok I have opened #2356 and started enable hlt-p2-intergation test

@mmusich mmusich deleted the mm_add_ph2_integration branch October 3, 2024 06:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants