[SPARK-52444][SQL][CONNECT] Add support for Variant/Char/Varchar Literal #51215
Conversation
HyukjinKwon
changed the title
|
ping @hvanhovell to take a look. |
|
|
||
| message Char { | ||
| string value = 1; | ||
| optional int32 length = 2; |
There was a problem hiding this comment.
This is only needed when the length of the value and the intended data type do not match right? If so please document this.
There was a problem hiding this comment.
I think when using Char or Varchar, the length field is better to provide, or String type is preferred. We will use the length field if it's provided and do some validation, or use len(value) as a default when length is omitted. I added these descriptions to the documents.
| @@ -240,6 +243,21 @@ message Expression { | |||
| Strings strings = 6; | |||
| } | |||
| } | |||
|
|
|||
| message Variant { | |||
There was a problem hiding this comment.
Please make sure to provide a reference to the format that is used here.
There was a problem hiding this comment.
I added a reference to Spark's VariantVal, and I searched the docs directory without finding expressions-related docs, so I changed no documents in the docs directory.
There was a problem hiding this comment.
@hvanhovell Thank you for your review, I'm sorry that I forgot to submit my reply, and I have resolved your comments, PTAL again.
| @@ -240,6 +243,21 @@ message Expression { | |||
| Strings strings = 6; | |||
| } | |||
| } | |||
|
|
|||
| message Variant { | |||
There was a problem hiding this comment.
I added a reference to Spark's VariantVal, and I searched the docs directory without finding expressions-related docs, so I changed no documents in the docs directory.
|
|
||
| message Char { | ||
| string value = 1; | ||
| optional int32 length = 2; |
There was a problem hiding this comment.
I think when using Char or Varchar, the length field is better to provide, or String type is preferred. We will use the length field if it's provided and do some validation, or use len(value) as a default when length is omitted. I added these descriptions to the documents.
What changes were proposed in this pull request?
We are currently missing support for a number of DataTypes, add Variant/Char/Varchar in this PR,
Strings with Collation, YearMonthIntervalType with begin/end and DayTimeIntervalType with begin/end require us to change the expression structure and will be done in another PR.
Why are the changes needed?
Align the gap between literal expressions and data types.
Does this PR introduce any user-facing change?
Yes.
fun.lit()can pass a VariantVal.How was this patch tested?
fun.litandfun.typedLit.Was this patch authored or co-authored using generative AI tooling?
No