scheduled workflows aren't started or getting "Pending" status for no clear reason #981
Description
@fudiwei I updated the Certimate to
v0.4.0-alpha.5and some of my scheduled workflow still hanging, the system logs in "Diagnostic" mentioned concurrency limit reason, but the workflow still not running from expected run time (at 18:00) until now.This happens if I set same cron jobs in all of my workflows (which is
0 */2 * * *), I'm never had this issue yet when I set different cron job in every single workflow.There is a screenshots for pending running workflow:
The system log contents are as follows below:
[2025-09-11 20:00:01] workflow run #xw2imaqe5w83bth (work#24oktv6in42oe89) stopped [2025-09-11 20:00:01] workflow run #75fk05sjgy2zn1k (work#4otg78c0wnm6646) stopped [2025-09-11 20:00:01] workflow run #xw2imaqe5w83bth (work#24oktv6in42oe89) started [2025-09-11 20:00:01] workflow run #75fk05sjgy2zn1k (work#4otg78c0wnm6646) started [2025-09-11 20:00:01] workflow run #xw2imaqe5w83bth (work#24oktv6in42oe89) is being dispatched ... [2025-09-11 20:00:01] workflow run #2kwrf3g4wnons3v (work#35rkl93p277c7uj) stopped [2025-09-11 20:00:01] workflow run #75fk05sjgy2zn1k (work#4otg78c0wnm6646) is being dispatched ... [2025-09-11 20:00:01] workflow run #jck54re4ebmkj9n (work#o62vwzfsa5623kl) stopped [2025-09-11 20:00:00] workflow run #2kwrf3g4wnons3v (work#35rkl93p277c7uj) started [2025-09-11 20:00:00] workflow run #2kwrf3g4wnons3v (work#35rkl93p277c7uj) is being dispatched ... [2025-09-11 20:00:00] workflow run #z0r7di4r8cqyoce (work#986rb9m44dyetoj) stopped [2025-09-11 20:00:00] workflow run #jck54re4ebmkj9n (work#o62vwzfsa5623kl) started [2025-09-11 20:00:00] workflow run #jck54re4ebmkj9n (work#o62vwzfsa5623kl) is being dispatched ... [2025-09-11 20:00:00] workflow run #f6fj53znlyk0soi (work#la5thk24embh22n) stopped [2025-09-11 20:00:00] workflow run #xw2imaqe5w83bth is pending, because the maximum concurrency (limit: 2) has been reached [2025-09-11 20:00:00] workflow run #75fk05sjgy2zn1k is pending, because the maximum concurrency (limit: 2) has been reached [2025-09-11 20:00:00] workflow run #2kwrf3g4wnons3v is pending, because the maximum concurrency (limit: 2) has been reached [2025-09-11 20:00:00] workflow run #jck54re4ebmkj9n is pending, because the maximum concurrency (limit: 2) has been reached [2025-09-11 20:00:00] workflow run #f6fj53znlyk0soi (work#la5thk24embh22n) started [2025-09-11 20:00:00] workflow run #z0r7di4r8cqyoce (work#986rb9m44dyetoj) started [2025-09-11 20:00:00] workflow run #75fk05sjgy2zn1k is pending, because the maximum concurrency (limit: 2) has been reached [2025-09-11 20:00:00] workflow run #2kwrf3g4wnons3v is pending, because the maximum concurrency (limit: 2) has been reached [2025-09-11 20:00:00] workflow run #jck54re4ebmkj9n is pending, because the maximum concurrency (limit: 2) has been reached [2025-09-11 20:00:00] workflow run #2kwrf3g4wnons3v is pending, because the maximum concurrency (limit: 2) has been reached [2025-09-11 20:00:00] workflow run #jck54re4ebmkj9n is pending, because the maximum concurrency (limit: 2) has been reached [2025-09-11 20:00:00] workflow run #jck54re4ebmkj9n is pending, because the maximum concurrency (limit: 2) has been reached [2025-09-11 20:00:00] workflow run #f6fj53znlyk0soi (work#la5thk24embh22n) is being dispatched ... [2025-09-11 20:00:00] workflow run #z0r7di4r8cqyoce (work#986rb9m44dyetoj) is being dispatched ... [2025-09-11 18:00:01] workflow run #lua0y9xmtk7vecb (work#35rkl93p277c7uj) stopped [2025-09-11 18:00:01] workflow run #4qhgyqhumnmq0av (work#la5thk24embh22n) stopped [2025-09-11 18:00:01] workflow run #ad4wgjviru91s1y (work#24oktv6in42oe89) stopped [2025-09-11 18:00:01] workflow run #lua0y9xmtk7vecb (work#35rkl93p277c7uj) started [2025-09-11 18:00:01] workflow run #lua0y9xmtk7vecb (work#35rkl93p277c7uj) is being dispatched ... [2025-09-11 18:00:01] workflow run #jrm3gsad71cmjbf (work#986rb9m44dyetoj) stopped [2025-09-11 18:00:00] workflow run #4qhgyqhumnmq0av (work#la5thk24embh22n) started [2025-09-11 18:00:00] workflow run #4qhgyqhumnmq0av (work#la5thk24embh22n) is being dispatched ... [2025-09-11 18:00:00] workflow run #1tqhkswa99xmbgy (work#4otg78c0wnm6646) stopped [2025-09-11 18:00:00] workflow run #jrm3gsad71cmjbf (work#986rb9m44dyetoj) started [2025-09-11 18:00:00] workflow run #jrm3gsad71cmjbf (work#986rb9m44dyetoj) is being dispatched ... [2025-09-11 18:00:00] workflow run #ad4wgjviru91s1y (work#24oktv6in42oe89) is being dispatched ... [2025-09-11 18:00:00] workflow run #lua0y9xmtk7vecb is pending, because the maximum concurrency (limit: 2) has been reached [2025-09-11 18:00:00] workflow run #lua0y9xmtk7vecb is pending, because the maximum concurrency (limit: 2) has been reached [2025-09-11 18:00:00] workflow run #4qhgyqhumnmq0av is pending, because the maximum concurrency (limit: 2) has been reached [2025-09-11 18:00:00] workflow run #jrm3gsad71cmjbf is pending, because the maximum concurrency (limit: 2) has been reached [2025-09-11 18:00:00] workflow run #4qhgyqhumnmq0av is pending, because the maximum concurrency (limit: 2) has been reached [2025-09-11 18:00:00] workflow run #ad4wgjviru91s1y (work#24oktv6in42oe89) started [2025-09-11 18:00:00] workflow run #jrm3gsad71cmjbf is pending, because the maximum concurrency (limit: 2) has been reached [2025-09-11 18:00:00] workflow run #hxuawvqck3b2khj is pending, because the maximum concurrency (limit: 2) has been reached [2025-09-11 18:00:00] workflow run #hxuawvqck3b2khj is pending, because the maximum concurrency (limit: 2) has been reached [2025-09-11 18:00:00] workflow run #lua0y9xmtk7vecb is pending, because the maximum concurrency (limit: 2) has been reached [2025-09-11 18:00:00] workflow run #4qhgyqhumnmq0av is pending, because the maximum concurrency (limit: 2) has been reached [2025-09-11 18:00:00] workflow run #jrm3gsad71cmjbf is pending, because the maximum concurrency (limit: 2) has been reached [2025-09-11 18:00:00] workflow run #hxuawvqck3b2khj is pending, because the maximum concurrency (limit: 2) has been reached [2025-09-11 18:00:00] workflow run #1tqhkswa99xmbgy (work#4otg78c0wnm6646) started [2025-09-11 18:00:00] workflow run #ad4wgjviru91s1y (work#24oktv6in42oe89) is being dispatched ... [2025-09-11 18:00:00] workflow run #1tqhkswa99xmbgy (work#4otg78c0wnm6646) is being dispatched ...The following screenshot is about my current cron jobs and workflow dispatcher:
I tried set and export the
CERTIMATE_WORKFLOW_MAX_WORKERSto16before start the Certimate, but when I started it seems that maximum concurrency limit still at 2 and the "Concurrency" on Workflow Dispatcher still shows 2 as you can see the screenshot above.There is the latest log:
[2025-09-11 22:00:01] workflow run #h5ga4htbh9eour7 (work#986rb9m44dyetoj) stopped [2025-09-11 22:00:00] workflow run #8iceh7sv2naj56a (work#la5thk24embh22n) stopped [2025-09-11 22:00:00] workflow run #h5ga4htbh9eour7 (work#986rb9m44dyetoj) started [2025-09-11 22:00:00] workflow run #h5ga4htbh9eour7 (work#986rb9m44dyetoj) is being dispatched ... [2025-09-11 22:00:00] workflow run #ew3tha1rn289wj1 (work#o62vwzfsa5623kl) stopped [2025-09-11 22:00:00] workflow run #8iceh7sv2naj56a (work#la5thk24embh22n) started [2025-09-11 22:00:00] workflow run #8iceh7sv2naj56a (work#la5thk24embh22n) is being dispatched ... [2025-09-11 22:00:00] workflow run #1qbi8kght54xka8 (work#4otg78c0wnm6646) stopped [2025-09-11 22:00:00] workflow run #1qbi8kght54xka8 (work#4otg78c0wnm6646) started [2025-09-11 22:00:00] workflow run #ew3tha1rn289wj1 (work#o62vwzfsa5623kl) started [2025-09-11 22:00:00] workflow run #1qbi8kght54xka8 (work#4otg78c0wnm6646) is being dispatched ... [2025-09-11 22:00:00] workflow run #pos5f1ictq3q9ez (work#35rkl93p277c7uj) stopped [2025-09-11 22:00:00] workflow run #ew3tha1rn289wj1 (work#o62vwzfsa5623kl) is being dispatched ... [2025-09-11 22:00:00] workflow run #hv3c1713bbejwq7 (work#24oktv6in42oe89) stopped [2025-09-11 22:00:00] workflow run #hv3c1713bbejwq7 (work#24oktv6in42oe89) started [2025-09-11 22:00:00] workflow run #pos5f1ictq3q9ez (work#35rkl93p277c7uj) started [2025-09-11 22:00:00] workflow run #h5ga4htbh9eour7 is pending, because the maximum concurrency (limit: 2) has been reached [2025-09-11 22:00:00] workflow run #8iceh7sv2naj56a is pending, because the maximum concurrency (limit: 2) has been reached [2025-09-11 22:00:00] workflow run #1qbi8kght54xka8 is pending, because the maximum concurrency (limit: 2) has been reached [2025-09-11 22:00:00] workflow run #ew3tha1rn289wj1 is pending, because the maximum concurrency (limit: 2) has been reached [2025-09-11 22:00:00] workflow run #8iceh7sv2naj56a is pending, because the maximum concurrency (limit: 2) has been reached [2025-09-11 22:00:00] workflow run #1qbi8kght54xka8 is pending, because the maximum concurrency (limit: 2) has been reached [2025-09-11 22:00:00] workflow run #ew3tha1rn289wj1 is pending, because the maximum concurrency (limit: 2) has been reached [2025-09-11 22:00:00] workflow run #1qbi8kght54xka8 is pending, because the maximum concurrency (limit: 2) has been reached [2025-09-11 22:00:00] workflow run #ew3tha1rn289wj1 is pending, because the maximum concurrency (limit: 2) has been reached [2025-09-11 22:00:00] workflow run #ew3tha1rn289wj1 is pending, because the maximum concurrency (limit: 2) has been reached [2025-09-11 22:00:00] workflow run #hv3c1713bbejwq7 (work#24oktv6in42oe89) is being dispatched ... [2025-09-11 22:00:00] workflow run #pos5f1ictq3q9ez (work#35rkl93p277c7uj) is being dispatched ...