Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Crossfit fails with cudf 25.02 due to 'cudf._lib' has no attribute 'transform' #104

Open
praateekmahajan opened this issue Dec 23, 2024 · 0 comments · May be fixed by #105
Open

Crossfit fails with cudf 25.02 due to 'cudf._lib' has no attribute 'transform' #104

praateekmahajan opened this issue Dec 23, 2024 · 0 comments · May be fixed by #105

Comments

@praateekmahajan
Copy link
Contributor

praateekmahajan commented Dec 23, 2024 •
edited
Loading 

  File "/opt/conda/envs/rapids/lib/python3.10/site-packages/crossfit/op/base.py", line 100, in __call__
    output = self.call(data, *args, **kwargs)
  File "/opt/conda/envs/rapids/lib/python3.10/site-packages/crossfit/op/tokenize.py", line 155, in call
    input_ids, attention_mask = self.call_column(data[col])
  File "/opt/conda/envs/rapids/lib/python3.10/site-packages/crossfit/op/tokenize.py", line 129, in call_column
    input_ids = create_list_series_from_1d_or_2d_ar(
  File "/opt/conda/envs/rapids/lib/python3.10/site-packages/crossfit/backend/cudf/series.py", line 95, in create_list_series_from_1d_or_2d_ar
    mask = cudf._lib.transform.bools_to_mask(as_column(mask_col))
AttributeError: module 'cudf._lib' has no attribute 'transform'

From https://github.com/rapidsai/cudf/pull/17505/files

Probably the following solves it

import pylibcudf as plc
plc.transform(...)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Fix list creation for cudf 25.02 VibhuJawa/crossfit
1 participant
@praateekmahajan