Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Nullability Sentinel Very Hard to Use #352

Open
WillAyd opened this issue Feb 22, 2024 · 0 comments
Open

Nullability Sentinel Very Hard to Use #352

WillAyd opened this issue Feb 22, 2024 · 0 comments

Comments

@WillAyd
Copy link

WillAyd commented Feb 22, 2024

This is arguably more feedback than an issue / question, but while I was trying to use the DataFrame Interchange API I found the requirement of supporting custom sentinels as a consumer rather burdensome. As far as I understand, if the array describes itself as using a sentinel, then it is up the consumer to query describe_null() and convert that PyObject to whatever type works with the buffer.

For types that span multiple words (ex: 256 bit decimal), such a sentinel seems really hard if not impossible to support. Even for more primitive types, you have to jump through some hoops with the CPython API to do that translation.

Trying to support all of those cases in a lower level extension makes it a ton of effort to fully adhere to this specification

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant