Skip to content

Support project cache invalidation across nodes in cluster mode #1304

@minwoo1999

Description

@minwoo1999

What would you like to be added:
A mechanism to broadcast and propagate project cache invalidation events across all nodes in a sharded cluster.

Why is this needed:
Currently, each node maintains its own in-memory project cache. While cache invalidation in the interceptor works for single-node deployments, it does not guarantee consistency in cluster mode since other nodes still retain stale cache. To ensure consistent behavior across nodes, especially after operations like API key rotation or project updates, a distributed cache invalidation mechanism or inter-node broadcast system is necessary.

See also: sharded-cluster-mode.md

This issue is derived from #1296.

Additional context:
For now, leaving a TODO or design consideration for this enhancement would be helpful for future implementation planning.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    Status

    Backlog

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions