SNOW-1775480: Update cloudpickle dependency to allow >=3.0 #2538
Labels
feature
New feature or request
status-triage_done
Initial triage done, will be further handled by the driver team
What is the current behavior?
Cloudpickle dependency is pinned at
<=2.2.1
What is the desired behavior?
Allow a wider dependency range for cloudpickle which includes versions
>=3.0
How would this improve
snowflake-snowpark-python
?The newer release is a requirement for the popular distributed computing library dask: https://github.com/dask/dask/blob/7ab0c93cfca0af130c778f9c1baec29a1f10b616/pyproject.toml#L33
Older versions of dask are compatible with the old cloudpickle versions, but there are many fixes and improvments in dask that have since been released since the
2024.08.1
release. A couple of those specific fixes that I would like to pick up are the crux of my issue.Additionally, if support of python version 3.12 is intended at some point for the snowpark project, then the cloudpickle 3.0 version would likely be ideal (as this is the first release with official, tested support for python 3.12)
References, Other Background
I can see that the current snowpark pyproject references challenges on the support on the backend:
snowpark-python/setup.py
Lines 23 to 24 in 5a0aca2
It would be helpful to understand if this is something that can't easily be supported by the snowpark library, or if this can be supported but will take some time. Thanks for you help!
The text was updated successfully, but these errors were encountered: