[release test] move azure related functions to cloud_util.py

[aslonnie]

out of util.py. also adding its own py_library

[gemini-code-assist]

Code Review

This pull request refactors the codebase by moving Azure-related utility functions from util.py into a new, dedicated cloud_util.py module. This is a good improvement for code organization and modularity. The corresponding BUILD.bazel files and tests are updated accordingly. My review includes a couple of suggestions to improve consistency in URL handling for Azure and to ensure temporary files are properly cleaned up.

[gemini-code-assist]

The upload_working_dir_to_azure function calls archive_directory to create a temporary zip file, but this file is not deleted after being uploaded to Azure. This will leave temporary files in the execution environment. It's a good practice to ensure temporary resources are cleaned up. You can use a try...finally block to ensure the file is removed even if the upload fails.

    archived_file_path = archive_directory(working_dir)
    try:
        archived_filename = os.path.basename(archived_file_path)
        azure_file_path = f"{azure_directory_uri}/{archived_filename}"
        upload_file_to_azure(
            local_file_path=archived_file_path, azure_file_path=azure_file_path
        )
        return azure_file_path
    finally:
        if os.path.exists(archived_file_path):
            os.remove(archived_file_path)

[gemini-code-assist]

The function convert_abfss_uri_to_https returns a URL with dfs.core.windows.net, while upload_file_to_azure in the same file uses blob.core.windows.net when creating a BlobServiceClient. This inconsistency can be confusing and lead to potential issues. For better maintainability and clarity, it's recommended to consistently use the blob storage endpoint (blob.core.windows.net) throughout, especially since you are using azure.storage.blob.BlobServiceClient.

def convert_abfss_uri_to_https(uri: str) -> str:
    """Convert ABFSS URI to HTTPS URI.
    ABFSS URI format: abfss://[email protected]/path
    Returns: HTTPS URI format: https://account.blob.core.windows.net/container/path
    """
    account, container, path = _parse_abfss_uri(uri)
    return f"https://{account}.blob.core.windows.net/{container}/{path}"