Use Dynamic Workload Scheduler

[killian-mahe]

Google launched Dynamic Workload Scheduler at the end of last year. It optimizes the allocation and utilization of AI/ML resources like GPUs and TPUs. It operates in two modes:

Flex Start Mode

Allows flexible and cost-effective access to GPUs/TPUs by requesting capacity as needed, with no minimum duration. This mode is ideal for shorter, less predictable tasks.

Calendar Mode

Enables users to reserve GPU/TPU capacity for specific future dates, ensuring availability for scheduled workloads, suitable for tasks with defined start times and durations​.

Is this feature usable with the Kedro VertexAI plugin?

[killian-mahe]

Happy New Year 2025! 🎉

I hope everything is going well. I wanted to follow up on this discussion regarding the compatibility of the Dynamic Workload Scheduler with the Kedro VertexAI plugin. Have there been any updates or findings on this topic?

Looking forward to your feedback!