error creating linker object in pyspark #1083
-
Hi, I have been trying to initialize a linker object in a pyspark environment following the steps described in: Workshop Materials/notebooks/Splink in Databricks - Expert Answer.py I am trying to keep the environment as simple as possible:
Importing the SparkLinker:
This throws up an error: ImportError: initialization failed The traceback leads to a line which appears to import duckdb:
I am not sure if I am overlooking something, or if there may be a conflict with another package? |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment 4 replies
-
I don't have access to databricks so difficult to test. What happens if you try to run |
Beta Was this translation helpful? Give feedback.
I don't have access to databricks so difficult to test. What happens if you try to run
import duckdb
directly? What error message do you get if any?