You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
In places where we create an empty dask DataFrame, such as in a soft association table or after a filter that doesn't create any partitions, we don't actually make an empty Dask DataFrame. In dask versions < 2024.3.0 without dask expressions dask would make a single partition with the pandas empty df from the meta. In dask >= 2024.3.0, from_delayed with an empty list of inputs raises an error so with #288, we create the empty single partition ourselves. For empty catalogs with no pixels, I think it makes sense to have an empty dask df with no partitions if possible.
The text was updated successfully, but these errors were encountered:
In places where we create an empty dask DataFrame, such as in a soft association table or after a filter that doesn't create any partitions, we don't actually make an empty Dask DataFrame. In dask versions < 2024.3.0 without dask expressions dask would make a single partition with the pandas empty df from the meta. In dask >= 2024.3.0,
from_delayed
with an empty list of inputs raises an error so with #288, we create the empty single partition ourselves. For empty catalogs with no pixels, I think it makes sense to have an empty dask df with no partitions if possible.The text was updated successfully, but these errors were encountered: