cluster_pairwise_predictions_at_threshold() failing when linking two 140M records #1037
Answered
by
reyvasquez-vh
reyvasquez-vh
asked this question in
Q&A
-
Previously, I had issues with linking two 35M records. See #1017 I am now trying to link two 140M records, and the code fails at And also: |
Beta Was this translation helpful? Give feedback.
Answered by
reyvasquez-vh
Feb 10, 2023
Replies: 1 comment 1 reply
-
The problem here was with storage for checkpoints. Pointing checkpoint to S3 bucket instead of using node spaces fixed the issue. |
Beta Was this translation helpful? Give feedback.
1 reply
Answer selected by
reyvasquez-vh
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
The problem here was with storage for checkpoints. Pointing checkpoint to S3 bucket instead of using node spaces fixed the issue.