[NGT] Add `ScoutingRecHitAnalyzer` and integrate Calo RecHit monitoring into DQM for scouting 2025 era #49619

sakura-ngt · 2025-12-12T13:55:26Z

PR description:

This PR introduces the following changes:

Introduce a new module ScoutingRecHitAnalyzer for monitoring reconstructed EB and HBHE rechits in scouting data.
Add infrastructure to run the ScoutingRecHitAnalyzer within the DQM framework.
Refactor L1 bits handling for scouting in both online and offline sequences.
Make the top-level folder name configurable to support calo RecHit monitoring outputs.
Update HLT DQM offline sequences to include hltScoutingMonitoringRecHits only for the Run3 Scouting 2025 era via the appropriate era modifier.
Support new bookProfile2D method in DQMStore for variable bin size histograms.

PR validation:

Run successfully the following tests:

DQM online: scram b runtests_TestDQMOnlineClient-scouting_dqm_sourceclient
DQM offfline: runTheMatrix.py -l 16834.0 -t 4 -j 8

If this PR is a backport please specify the original PR and why you need to backport that PR. If this PR will be backported please specify to which release cycle the backport is meant for:

Not a backport, no backport needed. Foreseen to be used in the 2026 pp run.

cmsbuild · 2025-12-12T13:55:54Z

cms-bot internal usage

sakura-ngt · 2025-12-12T13:56:45Z

type ngt

cmsbuild · 2025-12-12T13:57:15Z

-code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-49619/47155

Code check has found code style and quality issues which could be resolved by applying following patch(s)

code-checks:
https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-49619/47155/code-checks.patch
e.g. curl -k https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-49619/47155/code-checks.patch | patch -p1
You can also run scram build code-checks to apply code checks directly

cmsbuild · 2025-12-12T14:26:09Z

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-49619/47156

cmsbuild · 2025-12-12T14:26:28Z

A new Pull Request was created by @sakura-ngt for master.

It involves the following packages:

DQM/HLTEvF (dqm, hlt)
DQM/Integration (dqm)
DQMOffline/HLTScouting (dqm)
DQMServices/Core (dqm)
HLTriggerOffline/Scouting (dqm)

@Martin-Grunewald, @cmsbuild, @ctarricone, @gabrielmscampos, @mmusich, @nothingface0, @rseidita can you please review it and eventually sign? Thanks.
@barvic, @batinkov, @francescobrivio, @missirol, @mmusich, @mtosi, @rociovilar, @threus this is something you requested to watch as well.
@ftenchini, @mandrenguyen, @sextonkennedy you are the release manager for this.

cms-bot commands are listed here

mmusich · 2025-12-12T14:27:36Z

@cmsbuild, please test

cmsbuild · 2025-12-12T16:32:02Z

+1

Size: This PR adds an extra 40KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-33e733/49930/summary.html
COMMIT: 575fbc8
CMSSW: CMSSW_16_0_X_2025-12-12-1100/el8_amd64_gcc13
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/49619/49930/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

You potentially added 200 lines to the logs
ROOTFileChecks: Some differences in event products or their sizes found
Reco comparison results: 12 differences found in the comparisons
Reco comparison had 4 failed jobs
DQMHistoTests: Total files compared: 53
DQMHistoTests: Total histograms compared: 4273241
DQMHistoTests: Total failures: 6
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 4273215
DQMHistoTests: Total skipped: 20
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 18848.904 KiB( 52 files compared)
DQMHistoSizes: changed ( 16834.0,... ): 3141.484 KiB HLT/ScoutingOffline
Checked 227 log files, 198 edm output root files, 53 DQM output files
TriggerResults: no differences found

HLTriggerOffline/Scouting/plugins/ScoutingRecHitAnalyzer.cc

cmsbuild · 2025-12-14T11:43:43Z

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-49619/47166

cmsbuild · 2025-12-14T11:44:04Z

Pull request #49619 was updated. @Martin-Grunewald, @cmsbuild, @ctarricone, @gabrielmscampos, @mmusich, @nothingface0, @rseidita can you please check and sign again.

mmusich · 2025-12-14T11:44:30Z

@cmsbuild, please test

cmsbuild · 2025-12-14T14:31:27Z

-1

Failed Tests: UnitTests
Size: This PR adds an extra 24KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-33e733/49968/summary.html
COMMIT: 6623b90
CMSSW: CMSSW_16_0_X_2025-12-14-0000/el8_amd64_gcc13
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/49619/49968/install.sh to create a dev area with all the needed externals and cmssw changes.

Failed Unit Tests

I found 1 errors in the following unit tests:

---> test testMakeTrackValidationPlots had ERRORS

Comparison Summary

Summary:

You potentially added 203 lines to the logs
ROOTFileChecks: Some differences in event products or their sizes found
Reco comparison results: 5 differences found in the comparisons
Reco comparison had 4 failed jobs
DQMHistoTests: Total files compared: 53
DQMHistoTests: Total histograms compared: 4273241
DQMHistoTests: Total failures: 3
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 4273218
DQMHistoTests: Total skipped: 20
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 18848.904 KiB( 52 files compared)
DQMHistoSizes: changed ( 16834.0,... ): 3141.484 KiB HLT/ScoutingOffline
Checked 227 log files, 198 edm output root files, 53 DQM output files
TriggerResults: no differences found

mmusich · 2025-12-14T16:20:48Z

@cmsbuild, please test

cmsbuild · 2025-12-14T18:14:00Z

+1

Size: This PR adds an extra 16KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-33e733/49970/summary.html
COMMIT: 6623b90
CMSSW: CMSSW_16_0_X_2025-12-14-0000/el8_amd64_gcc13
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/49619/49970/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

You potentially added 202 lines to the logs
ROOTFileChecks: Some differences in event products or their sizes found
Reco comparison results: 5 differences found in the comparisons
Reco comparison had 4 failed jobs
DQMHistoTests: Total files compared: 53
DQMHistoTests: Total histograms compared: 4273241
DQMHistoTests: Total failures: 3
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 4273218
DQMHistoTests: Total skipped: 20
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 18848.904 KiB( 52 files compared)
DQMHistoSizes: changed ( 16834.0,... ): 3141.484 KiB HLT/ScoutingOffline
Checked 227 log files, 198 edm output root files, 53 DQM output files
TriggerResults: no differences found

mmusich · 2025-12-15T07:41:27Z

+hlt

support new bookProfile2D method in DQMStore for variable bin size

20fae4a

cmsbuild added this to the CMSSW_16_0_X milestone Dec 12, 2025

cmsbuild added dqm-pending hlt-pending pending-signatures tests-pending orp-pending code-checks-pending labels Dec 12, 2025

cmsbuild added the ngt label Dec 12, 2025

cmsbuild added code-checks-rejected and removed code-checks-pending labels Dec 12, 2025

sakura-ngt force-pushed the ScoutingRecHitAnalyzer branch from 4121172 to 575fbc8 Compare December 12, 2025 14:24

cmsbuild added code-checks-pending and removed code-checks-rejected labels Dec 12, 2025

cmsbuild added code-checks-approved and removed code-checks-pending labels Dec 12, 2025

cmsbuild added tests-started and removed tests-pending labels Dec 12, 2025

cmsbuild added tests-approved and removed tests-started labels Dec 12, 2025

fwyzard reviewed Dec 13, 2025

View reviewed changes

HLTriggerOffline/Scouting/plugins/ScoutingRecHitAnalyzer.cc Outdated Show resolved Hide resolved

mmusich and others added 2 commits December 14, 2025 12:40

Introduce ScoutingRecHitAnalyzer

7dd310f

add infrastructure to run the ScoutingRecHitAnalyzer in DQM

d92ba12

sakura-ngt added 3 commits December 14, 2025 12:40

refactor L1 bits for scouting in the online and offline sequences

56ae37b

make top folder name configurable

6621b6b

run hltScoutingMonitoringRecHits only in eras 2025 onwards

6623b90

sakura-ngt force-pushed the ScoutingRecHitAnalyzer branch from 575fbc8 to 6623b90 Compare December 14, 2025 11:41

cmsbuild added tests-pending code-checks-pending and removed tests-approved code-checks-approved labels Dec 14, 2025

cmsbuild added code-checks-approved and removed code-checks-pending labels Dec 14, 2025

cmsbuild added tests-started and removed tests-pending labels Dec 14, 2025

cmsbuild added tests-rejected and removed tests-started labels Dec 14, 2025

cmsbuild added tests-started and removed tests-rejected labels Dec 14, 2025

cmsbuild added tests-approved and removed tests-started labels Dec 14, 2025

cmsbuild added hlt-approved and removed hlt-pending labels Dec 15, 2025

mmusich mentioned this pull request Dec 15, 2025

Use better input lumisection for wf 2025.0000001 #49627

Open

[NGT] Add ScoutingRecHitAnalyzer and integrate Calo RecHit monitoring into DQM for scouting 2025 era #49619

Are you sure you want to change the base?

[NGT] Add ScoutingRecHitAnalyzer and integrate Calo RecHit monitoring into DQM for scouting 2025 era #49619

Conversation

sakura-ngt commented Dec 12, 2025

PR description:

PR validation:

If this PR is a backport please specify the original PR and why you need to backport that PR. If this PR will be backported please specify to which release cycle the backport is meant for:

Uh oh!

cmsbuild commented Dec 12, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

sakura-ngt commented Dec 12, 2025

Uh oh!

cmsbuild commented Dec 12, 2025

Uh oh!

cmsbuild commented Dec 12, 2025

Uh oh!

cmsbuild commented Dec 12, 2025

Uh oh!

mmusich commented Dec 12, 2025

Uh oh!

cmsbuild commented Dec 12, 2025

Comparison Summary

Uh oh!

Uh oh!

cmsbuild commented Dec 14, 2025

Uh oh!

cmsbuild commented Dec 14, 2025

Uh oh!

mmusich commented Dec 14, 2025

Uh oh!

cmsbuild commented Dec 14, 2025

Failed Unit Tests

Comparison Summary

Uh oh!

mmusich commented Dec 14, 2025

Uh oh!

cmsbuild commented Dec 14, 2025

Comparison Summary

Uh oh!

mmusich commented Dec 15, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

[NGT] Add `ScoutingRecHitAnalyzer` and integrate Calo RecHit monitoring into DQM for scouting 2025 era #49619

[NGT] Add `ScoutingRecHitAnalyzer` and integrate Calo RecHit monitoring into DQM for scouting 2025 era #49619

cmsbuild commented Dec 12, 2025 •

edited

Loading