Enable store to automatically discover prefixes in bucket

[k24dizzle]

Use Case:

Say I have multiple clusters, that use the prefix field so that the sidecar can put metrics in the same bucket, but under different prefixes.

From what I understand, I would have to have a thanos-store for each prefix to start reading those metrics.

Would it be possible to have just one thanos-store, connected to that bucket, that is smart enough to discover all the prefixes that exist in that bucket?

Related Issue(s):

• Recursive reads from object storage subfolders using single Store Gateway thanos#6999
• Multiple sidecar have set "prefix", how set store to read all of them? thanos#5517 (comment)

[k24dizzle]

perhaps something like a prefixes: field

[boris-smidt-klarrio]

Or a recursive depth which would allow you to say

clusters/my-cluster1/blocks
clusters/my-cluster1/blocks

this could then be covered with

prefix: clusters
depth: 2

Looking at the code your suggestion 'breaks' the PrefixedBucket abstraction. But i think the 'depth' part can actually work transparently.