bump up GPU matrix relval workflows to use D127 in CMSSW > 20

[mmusich]

Follow-up to cms-sw/cmssw#51633 , as per cms-sw/cmssw#51670 (comment)

Cc: @fwyzard

[cmsbuild]

A new Pull Request was created by @mmusich for branch master.

@akritkbehera, @cmsbuild, @iarspider, @raoatifshad, @smuzaffar can you please review it and eventually sign? Thanks.
@ftenchini, @mandrenguyen, @sextonkennedy you are the release manager for this.
cms-bot commands are listed here

[cmsbuild]

cms-bot internal usage

[mmusich]

enable gpu

[mmusich]

@cmsbuild, please test

[cmsbuild]

Pull request #2823 was updated.

[cmsbuild]

-1

Failed Tests: RelVals-AMD_MI300X
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-b574a9/55256/summary.html
COMMIT: dec36f6
CMSSW: CMSSW_20_1_X_2026-08-11-1100/el9_amd64_gcc13
Additional Tests: GPU,AMD_MI300X,AMD_W7900,NVIDIA_H100,NVIDIA_L40S,NVIDIA_T4
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cms-bot/2823/55256/install.sh to create a dev area with all the needed externals and cmssw changes.

Failed RelVals-AMD_MI300X

• 37634.40437634.404_TTbar_14TeV+Run4D127_Patatrack_PixelOnlyAlpaka_Profiling/step2_TTbar_14TeV+Run4D127_Patatrack_PixelOnlyAlpaka_Profiling.log
• 37634.750337634.7503_TTbar_14TeV+Run4D127_HLTHeterogeneousValid/step2_TTbar_14TeV+Run4D127_HLTHeterogeneousValid.log

Comparison Summary

Summary:

• You potentially added 1 lines to the logs
• Reco comparison results: 0 differences found in the comparisons
• DQMHistoTests: Total files compared: 44
• DQMHistoTests: Total histograms compared: 3433258
• DQMHistoTests: Total failures: 1
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 3433239
• DQMHistoTests: Total skipped: 18
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 43 files compared)
• Checked 191 log files, 159 edm output root files, 44 DQM output files
• TriggerResults: no differences found

AMD_W7900 Comparison Summary

Summary:

• No significant changes to the logs found
• Reco comparison results: 63 differences found in the comparisons
• DQMHistoTests: Total files compared: 7
• DQMHistoTests: Total histograms compared: 172823
• DQMHistoTests: Total failures: 7850
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 164973
• DQMHistoTests: Total skipped: 0
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 6 files compared)
• Checked 25 log files, 20 edm output root files, 7 DQM output files
• TriggerResults: no differences found

NVIDIA_H100 Comparison Summary

Summary:

• No significant changes to the logs found
• Reco comparison results: 70 differences found in the comparisons
• DQMHistoTests: Total files compared: 7
• DQMHistoTests: Total histograms compared: 172823
• DQMHistoTests: Total failures: 9296
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 163527
• DQMHistoTests: Total skipped: 0
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 6 files compared)
• Checked 25 log files, 20 edm output root files, 7 DQM output files
• TriggerResults: found differences in 1 / 6 workflows

NVIDIA_L40S Comparison Summary

Summary:

• No significant changes to the logs found
• Reco comparison results: 106 differences found in the comparisons
• DQMHistoTests: Total files compared: 7
• DQMHistoTests: Total histograms compared: 172823
• DQMHistoTests: Total failures: 11031
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 161792
• DQMHistoTests: Total skipped: 0
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 6 files compared)
• Checked 25 log files, 20 edm output root files, 7 DQM output files
• TriggerResults: no differences found

NVIDIA_T4 Comparison Summary

Summary:

• No significant changes to the logs found
• Reco comparison results: 97 differences found in the comparisons
• DQMHistoTests: Total files compared: 7
• DQMHistoTests: Total histograms compared: 172823
• DQMHistoTests: Total failures: 10909
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 161914
• DQMHistoTests: Total skipped: 0
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 6 files compared)
• Checked 25 log files, 20 edm output root files, 7 DQM output files
• TriggerResults: no differences found

[mmusich]

@akritkbehera @smuzaffar @mandrenguyen @ftenchini please let's merge this.

[mandrenguyen]

+1

[mmusich]

@cmsbuild, please test for CMSSW_20_0_X

[cmsbuild]

REMINDER @sextonkennedy, @ftenchini, @mandrenguyen: This PR was tested with cms-sw/cmssw#51670, please check if they should be merged together

[cmsbuild]

-1

Failed Tests: RelVals RelVals-AMD_MI300X
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-b574a9/55268/summary.html
COMMIT: dec36f6
CMSSW: CMSSW_20_0_X_2026-08-11-2300/el8_amd64_gcc13
Additional Tests: GPU,AMD_MI300X,AMD_W7900,NVIDIA_H100,NVIDIA_L40S,NVIDIA_T4
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cms-bot/2823/55268/install.sh to create a dev area with all the needed externals and cmssw changes.

Failed RelVals

• 37834.0

----- Begin Fatal Exception 12-Aug-2026 10:16:56 CEST-----------------------
An exception of category 'NoSecondaryFiles' occurred while
   [0] Constructing the EventProcessor
   [1] Constructing module: class=MixingModule label='mix'
Exception Message:
RootEmbeddedFileSequence no input files specified for secondary input source.
----- End Fatal Exception -------------------------------------------------

Failed RelVals-AMD_MI300X

• 37634.40237634.402_TTbar_14TeV+Run4D126_Patatrack_PixelOnlyAlpaka/step2_TTbar_14TeV+Run4D126_Patatrack_PixelOnlyAlpaka.log
• 37634.40437634.404_TTbar_14TeV+Run4D126_Patatrack_PixelOnlyAlpaka_Profiling/step2_TTbar_14TeV+Run4D126_Patatrack_PixelOnlyAlpaka_Profiling.log

AMD_W7900 Comparison Summary

Summary:

• No significant changes to the logs found
• Reco comparison results: 95 differences found in the comparisons
• DQMHistoTests: Total files compared: 7
• DQMHistoTests: Total histograms compared: 163207
• DQMHistoTests: Total failures: 13997
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 149210
• DQMHistoTests: Total skipped: 0
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 6 files compared)
• Checked 25 log files, 20 edm output root files, 7 DQM output files
• TriggerResults: no differences found

NVIDIA_H100 Comparison Summary

Summary:

• No significant changes to the logs found
• Reco comparison results: 118 differences found in the comparisons
• DQMHistoTests: Total files compared: 7
• DQMHistoTests: Total histograms compared: 163207
• DQMHistoTests: Total failures: 15137
• DQMHistoTests: Total nulls: 1
• DQMHistoTests: Total successes: 148069
• DQMHistoTests: Total skipped: 0
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 6 files compared)
• Checked 25 log files, 20 edm output root files, 7 DQM output files
• TriggerResults: no differences found

NVIDIA_L40S Comparison Summary

Summary:

• No significant changes to the logs found
• Reco comparison results: 117 differences found in the comparisons
• DQMHistoTests: Total files compared: 7
• DQMHistoTests: Total histograms compared: 163207
• DQMHistoTests: Total failures: 11043
• DQMHistoTests: Total nulls: 1
• DQMHistoTests: Total successes: 152163
• DQMHistoTests: Total skipped: 0
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 6 files compared)
• Checked 25 log files, 20 edm output root files, 7 DQM output files
• TriggerResults: no differences found

NVIDIA_T4 Comparison Summary

Summary:

• No significant changes to the logs found
• Reco comparison results: 209 differences found in the comparisons
• DQMHistoTests: Total files compared: 7
• DQMHistoTests: Total histograms compared: 163207
• DQMHistoTests: Total failures: 12781
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 150426
• DQMHistoTests: Total skipped: 0
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 6 files compared)
• Checked 25 log files, 20 edm output root files, 7 DQM output files
• TriggerResults: no differences found

[mmusich]

-1

so, other than the (known) test failures on AMD_MI300X, the failure for 37834.0 is unrelated and expected, since there is no backport of cms-sw/cmssw#51667 in CMSSW_20_0_X.
Concerning the discussion at #2823 (comment), I would argue that the GPU workflows that are actually testable in the GPU matrix directly are the ones proposed in this PR (as the tests above deomonstrate for both 20_1_X and 20_0_X).
If the wf numbering for 20_0_X is inconsistent with the expectations this needs to be dealt with elsewhere (see cms-sw/cmssw#51658 (comment))

[mmusich]

ignore tests-rejected with ib-failure

[Moanwar]

-1

so, other than the (known) test failures on AMD_MI300X, the failure for 37834.0 is unrelated and expected, since there is no backport of cms-sw/cmssw#51667 in CMSSW_20_0_X. Concerning the discussion at #2823 (comment), I would argue that the GPU workflows that are actually testable in the GPU matrix directly are the ones proposed in this PR (as the tests above deomonstrate for both 20_1_X and 20_0_X). If the wf numbering for 20_0_X is inconsistent with the expectations this needs to be dealt with elsewhere (see cms-sw/cmssw#51658 (comment))

Yeah, sounds fair. And it’s good that we identified the inconsistency between the 20_1_X and 20_0_X releases in the workflows numbers.

[smuzaffar]

+externals

[cmsbuild]

This pull request is fully signed and it will be integrated in one of the next master IBs (test failures were overridden). This pull request will be automatically merged.