Hitting error using COPY to S3

[minni89]

Can anyone help with the following error

test_db=# COPY (SELECT * FROM pgbench_tellers) TO 's3://pqtests/table4.parquet' WITH (format 'parquet');
ERROR:  failed to close parquet writer: External: Generic S3 error: Client error with status 404 Not Found: The requested URL was not found on this server.

[aykut-bozkurt]

seems like the bucket does not exist. (or please make sure you set endpoint (AWS_ENDPOINT_URL) correct )

[minni89]

I'm able to write data to bucket using aws s3 cp, AWS_ENDPOINT_URL is also correct.

[aykut-bozkurt]

Is that a local machine? Can you share the environment variables and aws config file with redacted secrets?

[minni89]

Yes, it's a local machine.
postgres@hostname:~$ aws s3 cp /etc/postgresql/17/main/data.parquet s3://pqtests/table4.parquet
upload: ../../../etc/postgresql/17/main/data.parquet to s3://pqtests/table4.parquet

postgres@hostname-7490:~$ cat ~/.aws/credentials
[postgres]
aws_access_key_id =
aws_secret_access_key =
[default]
aws_access_key_id =
aws_secret_access_key =

postgres@hostname-7490:~$ cat ~/.aws/config
[postgres]
region =
output = none
[default]
region =
output =none