[Bug]: Many deduped download jobs getting into system

[LalaP]

Checked for duplicates

Yes - I've already checked

Describe the bug

Operating OPERA FWD cluster for few years it is normal to have some deduped jobs max about 150 daily getting into the system.
Yet after deployment of PCM 3.2.0 this number has increased significantly. about 1K a day
The screen shot bellow was taken 2025-10-21 which is deduped jobs since 2025-10-07 (2 weeks)
Note all the deduped jobs are download and majority SLC

What did you expect?

I suspect that there is an underlying cause for this. In case it is affecting COST, performance, and resources utilization would be nice for PCM to investigate it.

Reproducible steps

Not sure if this is reproducable easily. 
But currently there 2 weeks worth of deduped jobs sitting on OPS-fwd cluster

Environment

ops-fwd
PCM 3.2.0

[LalaP]

@hhlee445 Do you guys need the deduped ? Or I may drop the current ones and look as they are getting in (since we always have)
Currently we have 21K sitting on OPS venue.