Propagate metadata through the shared cache

[loewenheim]

The metadata added in #1617 are currently only written to the local file system, but not propagated through the GCS shared cache. While this is now less urgent since we are running fewer pods, we should still implement it to make it possible to share negative cache entries.