Google Batch log to bucket

[june-hua]

New feature

Enable users to direct job logs to a specified Google Cloud Storage (GCS) bucket path, rather than exclusively relying on GCP Cloud Logging.

Use case

This functionality addresses user needs related to log accessibility and permission management. Users/service accounts may not have log reader permissions or may wish to store their logs in a bucket.

Suggested implementation

Google Batch LogsPolicy has a PATH option. It is currently set to CLOUD_LOGGING. If PATH is selected, log files can be written to a GCS bucket that is mounted to a specified path on the job VM.