Replies: 5 comments 6 replies
-
Any help is appreciated here |
Beta Was this translation helpful? Give feedback.
-
@A-Mongy AFAIK the gcs connector should be working fine. The issue you posted seems related with ca-certs on runtime. I find some docs here (https://bobcares.com/blog/curl-error-77-problem-with-the-ssl-ca-cert/). Since you have already updated ca-certs, would you please do a quick test by using the nightly package? thanks, -yuan |
Beta Was this translation helpful? Give feedback.
-
@A-Mongy, I just reviewed the relevant code. This log cannot tell the bucket is accessible. It is logged before the reader is initialized. |
Beta Was this translation helpful? Give feedback.
-
@zhztheplayer any hints on this? |
Beta Was this translation helpful? Give feedback.
-
I have to add to this, when triggering a spark submit to only read data from GCS, reading a CSV or parquet file. There is no issues and it reads and prints the data from the file with no issue. So definitely not a GCS access issue and not a curl issue. However, if I try to write data I can see the issue.
|
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
-
I am trying to test Gluten with Velox backend with spark 3.4.1
I am using the jar from https://downloads.apache.org/incubator/gluten/1.3.0-incubating/ for spark34
GCS configs are correctly set
curl seems to be working right, I tried to update the ca certificates also, so I am not sure what is the issue here.
I get the following error in the executor logs
Beta Was this translation helpful? Give feedback.
All reactions