[Feature] adding transform functionality #2499
Closed
otacilio-psf
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
As in PySpark, the transform functionality allows you to split your transformations into units of work, creating a function for each, and then call them on your DataFrame, enabling the ability to chain transformations.
Having your transformations as functions helps in unit testing them.
PR with the changes: #2498
PySpark reference
Beta Was this translation helpful? Give feedback.
All reactions