Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove JobReport.xml output from igprof tests #8

Merged
merged 1 commit into from
Jul 31, 2024

Conversation

jfernan2
Copy link
Contributor

Same job does not crash without -j JobReport.xml
@gartung gartung merged commit 4ea06a0 into cms-cmpwg:master Jul 31, 2024
@jfernan2
Copy link
Contributor Author

jfernan2 commented Sep 2, 2024

Dear @gartung
This trial did not suceed (see [1] ) igprof crashes at event 5 though a tmp output is created until then [3].

However I am still runing in Jenkins with igprof without problem (e.g. most recent [2])

The only difference is that I do:
igprof -d -pp -z -o step3_igprofCPU.gz -t cmsRun cmsRun step3_igprof.py

and here we do:

igprof -pp -d -t cmsRun -z -o ./igprofCPU_step3.gz -- cmsRun step3_igprof.py >& step3_igprof_cpu.log

I wonder if the "--" might have some effect....

This crash is really blocking the timing profiling in PR test :-(

Thanks

[1] https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-560df3/41217/profiling/29834.21/
or
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-560df3/41217/profiling/index-12634.21.html

[2] https://cmssdt.cern.ch/jenkins/job/release-run-reco-profiling/550/console
[3] https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-560df3/41217/profiling/12634.21/igprofCPU_step3.1.gz.tmp

@gartung
Copy link
Contributor

gartung commented Sep 3, 2024

The IgProf command is a shell script that handles setting LD_PRELOAD=libigprof.so and the correct environment variables needed. The '--' is an option to tell getopt there are no more options to process.

The segfault in Igprof and Vtune when running the Tensorflow library is a known bug that has no resolution.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants