Allow Agents to Spawn Concurrent Workers

[MMartyn]

Hello!

• Vote on this issue by adding a 👍 reaction
• If you want to implement this feature, comment to let us know (we'll work with you on design, scheduling, etc.)

Issue details

I would like the ability to configure an agent to create multiple concurrent workers. Currently, the agents are 1 to 1 which causes deployments to queue if there aren't any idle agents. I figure a knob to control the level of concurrency would be nice so that the cluster maintainers can decide how much elasticity they will permit before queuing.

Affected area/feature

[komalali]

This is possible today. You can create as many agents as you want. If they have the same token, they're part of the same pool.

[MMartyn]

The issue with that is that the agents are long living so they consume resources even if they aren't needed. I hadn't checked exactly how much they were using so I suppose if it is minimal then it is not a big problem.

[rshade]

Are you using kubernetes? If so you can use the replicas to control this. The agent is pretty cheap resource wise as far as I can tell. You could also set requests/limits to constrain it.