Skip to content

[CH] support customized file scan which does not support transform #1218

@lhuang09287750

Description

@lhuang09287750

Is your feature request related to a problem or challenge? Please describe what you are trying to do.
When we use customized file scan( not support transform ) , the output spark columnar format data cannot be passed to a transform supported exec directly.

Describe the solution you'd like
A columnar(spark) to columnar(backend native) plan ts needed between file scan and its transform supported parent

Describe alternatives you've considered
Otherwise we can use a step combined of C2R and R2C instead
For C2R and R2C are already implemented

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions