add: `UPPER`, `LOWER` and `TRIM` support for `CHAR/VARCHAR` types #1839

XuechunHHH · 2025-10-01T21:51:53Z

Relevant Issues

Related to Issue Add string functions support for CHAR/VARCHAR #1838

Description

Add UPPER, LOWER and TRIM functions support on CHAR/VARCHAR types.
Formalize Concat operator length/type handling for string types.
Update submodule.

Other Information

Updated Unreleased Section in CHANGELOG: YES
Any backward-incompatible changes? NO
Any new external dependencies? NO
Do your changes comply with the contributing and code style guidelines? YES

License Information

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

github-actions · 2025-10-01T21:58:31Z

CROSS-COMMIT-REPORT-PARTIQLCORE ❌

	BASE (154B9B4)	TARGET (7A62BED)	+/-
% Passing	94.65%	93.36%	-1.29% ⭕
Passing	6440	6501	61 ✅
Failing	176	276	100 ⭕
Ignored	188	186	-2 ✅
Total Tests	6804	6963	159 ✅

Testing Details

Base Commit: 154b9b4
Target Commit: 7a62bed
Java Version: 17.0.16

Result Details

❌ REGRESSION DETECTED. See Now Failing/Ignored Tests. ❌
New passing tests: 255
New failing tests: 27
New ignored tests: 0
Passing in both: 6246
Failing in both: 170
Ignored in both: 186
PASSING in BASE but now FAILING in TARGET: 81
PASSING in BASE but now IGNORED in TARGET: 0
FAILING in BASE but now PASSING in TARGET: 2
IGNORED in BASE but now PASSING in TARGET: 0

New Tests Added

The complete list can be found in GitHub CI summary, either from Step Summary or in the Artifact.

Now FAILING Tests ❌

The complete list can be found in GitHub CI summary, either from Step Summary or in the Artifact.

Now Passing Tests

The following 2 test(s) were previously FAILING in BASE but are now PASSING in TARGET. Before merging, confirm they are intended to pass:

Click here to see

repeated field on struct is ambiguous{identifier:"REPEATED",cn:9,bn:"REPEATED"}, compileOption: STRICT
repeated field on struct is ambiguous{identifier:" "repeated" ",cn:10,bn:"repeated"}, compileOption: STRICT

CROSS-COMMIT-REPORT-PARTIQLEXTENDED ✅

	BASE (154B9B4)	TARGET (7A62BED)	+/-
% Passing	34.25%	35.22%	0.97% ✅
Passing	670	696	26 ✅
Failing	1286	1280	-6 ✅
Ignored	0	0	0 ✅
Total Tests	1956	1976	20 ✅

Testing Details

Base Commit: 154b9b4
Target Commit: 7a62bed
Java Version: 17.0.16

Result Details

New passing tests: 34
New failing tests: 0
New ignored tests: 0
Passing in both: 662
Failing in both: 1280
Ignored in both: 0
PASSING in BASE but now FAILING in TARGET: 0
PASSING in BASE but now IGNORED in TARGET: 0
FAILING in BASE but now PASSING in TARGET: 0
IGNORED in BASE but now PASSING in TARGET: 0

New Tests Added

The complete list can be found in GitHub CI summary, either from Step Summary or in the Artifact.

XuechunHHH · 2025-10-01T22:10:14Z

The cross-commit report failure stems from the update of conformance test submodule. Run the conformance test locally, the failing and passing tests are exactly the same as the main branch.

partiql-spi/src/main/kotlin/org/partiql/spi/function/builtins/FnLower.kt

XuechunHHH · 2025-10-08T17:20:16Z

CHANGELOG.md

 ## [Unreleased](https://TODO.com) - YYYY-MM-DD

 ### Added
+- `UPPER`, `LOWER`, `TRIM` function support for `CHAR/VARCHAR` types


self-review: Since the length handling should also be done at planning time, add the real function support instead of only siganatures.

partiql-spi/src/main/kotlin/org/partiql/spi/function/builtins/FnConcat.kt

xd1313113 · 2025-10-08T17:32:59Z

The cross-commit report failure stems from the update of conformance test submodule. Run the conformance test locally, the failing and passing tests are exactly the same as the main branch.

You probably need a rebase

XuechunHHH · 2025-10-08T18:07:57Z

The cross-commit report failure stems from the update of conformance test submodule. Run the conformance test locally, the failing and passing tests are exactly the same as the main branch.

You probably need a rebase

Previously, our submodule partiql-tests target is https://github.com/partiql/partiql-tests/tree/c40ef9738ed812ac8322c8c63aa3cbe3e2fee18f.
In this PR, update it to https://github.com/partiql/partiql-tests/tree/67d22dcd5a7eeaaa2624be9d1bb3da6a8b9faf0a.

xd1313113 · 2025-10-08T18:18:59Z

The cross-commit report failure stems from the update of conformance test submodule. Run the conformance test locally, the failing and passing tests are exactly the same as the main branch.

You probably need a rebase

Previously, our submodule partiql-tests target is https://github.com/partiql/partiql-tests/tree/c40ef9738ed812ac8322c8c63aa3cbe3e2fee18f. In this PR, update it to https://github.com/partiql/partiql-tests/tree/67d22dcd5a7eeaaa2624be9d1bb3da6a8b9faf0a.

PLK has been updated to latest https://github.com/partiql/partiql-tests/tree/67d22dcd5a7eeaaa2624be9d1bb3da6a8b9faf0a by my last PR.
And it is interesting that you did not get a merge conflicts. If you rebase, you will get a clean conformance report.

# Conflicts: # CHANGELOG.md

partiql-planner/src/test/kotlin/org/partiql/planner/internal/typer/functions/UpperTest.kt

partiql-spi/src/main/kotlin/org/partiql/spi/function/builtins/FnLower.kt

partiql-planner/src/test/kotlin/org/partiql/planner/internal/typer/functions/TrimTest.kt

partiql-spi/src/main/kotlin/org/partiql/spi/function/builtins/FnTrim.kt

alancai98 · 2025-10-08T20:43:27Z

The cross-commit report failure stems from the update of conformance test submodule. Run the conformance test locally, the failing and passing tests are exactly the same as the main branch.

You probably need a rebase

Previously, our submodule partiql-tests target is partiql/partiql-tests@c40ef97. In this PR, update it to partiql/partiql-tests@67d22dc.

PLK has been updated to latest partiql/partiql-tests@67d22dc by my last PR. And it is interesting that you did not get a merge conflicts. If you rebase, you will get a clean conformance report.

The submodule currently in main is pointing to https://github.com/partiql/partiql-tests/tree/c40ef9738ed812ac8322c8c63aa3cbe3e2fee18f, which is not updated. It's correct in this PR https://github.com/partiql/partiql-lang-kotlin/pull/1839/files#diff-9f1f22f097a05c1bf7e176ec44837633ab6cd0b2afec6cf9743dccc4904f21e6.

In the future, I think we should generally update the conformance submodule in its own PR so we can distinguish conformance report changes more easily.

xd1313113 · 2025-10-08T21:08:03Z

The cross-commit report failure stems from the update of conformance test submodule. Run the conformance test locally, the failing and passing tests are exactly the same as the main branch.

You probably need a rebase

Previously, our submodule partiql-tests target is partiql/partiql-tests@c40ef97. In this PR, update it to partiql/partiql-tests@67d22dc.

PLK has been updated to latest partiql/partiql-tests@67d22dc by my last PR. And it is interesting that you did not get a merge conflicts. If you rebase, you will get a clean conformance report.

The submodule currently in main is pointing to https://github.com/partiql/partiql-tests/tree/c40ef9738ed812ac8322c8c63aa3cbe3e2fee18f, which is not updated. It's correct in this PR https://github.com/partiql/partiql-lang-kotlin/pull/1839/files#diff-9f1f22f097a05c1bf7e176ec44837633ab6cd0b2afec6cf9743dccc4904f21e6.

In the future, I think we should generally update the conformance submodule in its own PR so we can distinguish conformance report changes more easily.

Synced Xuechun offline. The conformance submodule was updated to latest by my PR 6792e1d,
but was reverted in John's PR yesterday accidentally. 154b9b4

It looks PR author is not aware of submodule update and may revert submodule unexpectedly as git add . will add reverted submodule automatically.

partiql-spi/src/main/kotlin/org/partiql/spi/function/builtins/FnLower.kt

partiql-spi/src/main/kotlin/org/partiql/spi/function/builtins/FnTrim.kt

partiql-spi/src/main/kotlin/org/partiql/spi/function/builtins/FnConcat.kt

partiql-planner/src/test/kotlin/org/partiql/planner/internal/typer/functions/LowerTest.kt

partiql-spi/src/main/kotlin/org/partiql/spi/function/builtins/FnConcat.kt

partiql-spi/src/main/kotlin/org/partiql/spi/function/Builtins.kt

partiql-spi/src/main/kotlin/org/partiql/spi/function/builtins/FnConcat.kt

partiql-spi/src/main/kotlin/org/partiql/spi/function/builtins/FnUpper.kt

CHANGELOG.md

partiql-planner/src/test/kotlin/org/partiql/planner/util/Utils.kt

partiql-planner/src/test/kotlin/org/partiql/planner/internal/typer/functions/TrimTest.kt

partiql-planner/src/test/kotlin/org/partiql/planner/util/Utils.kt

partiql-spi/src/main/kotlin/org/partiql/spi/function/builtins/FnUtils.kt

partiql-parser/src/main/antlr/PartiQLParser.g4

partiql-spi/src/main/kotlin/org/partiql/spi/function/builtins/FnLower.kt

CHANGELOG.md

partiql-spi/src/main/kotlin/org/partiql/spi/function/builtins/FnConcat.kt

partiql-spi/src/main/kotlin/org/partiql/spi/function/builtins/FnUtils.kt

XuechunHHH · 2025-10-13T21:18:53Z

partiql-spi/src/main/kotlin/org/partiql/spi/function/builtins/FnLike.kt

@@ -1,56 +1,100 @@
 // ktlint-disable filename
 @file:Suppress("ClassName")



Since like is predicate, already got planner tests at https://github.com/partiql/partiql-lang-kotlin/blob/ac49c001cec2e04da56630708277d75e715a8ad6/partiql-planner/src/test/kotlin/org/partiql/planner/internal/typer/predicate/OpLikeTest.kt

work around string functions support for char/varchar

1e08443

XuechunHHH requested review from alancai98 and xd1313113 October 1, 2025 22:12

alancai98 reviewed Oct 1, 2025

View reviewed changes

partiql-spi/src/main/kotlin/org/partiql/spi/function/builtins/FnLower.kt Outdated Show resolved Hide resolved

alancai98 reviewed Oct 1, 2025

View reviewed changes

partiql-spi/src/main/kotlin/org/partiql/spi/function/builtins/FnLower.kt Outdated Show resolved Hide resolved

XuechunHHH closed this Oct 6, 2025

XuechunHHH reopened this Oct 7, 2025

XuechunHHH and others added 3 commits October 7, 2025 23:17

Dynamic type resolve for upper/lower

b82d886

add trim

52cc57d

Merge branch 'main' into add--string-fn-support-on-char

58c346b

XuechunHHH changed the title ~~add: temporary work around string functions support for CHAR/VARCHAR~~ add: UPPER, LOWER and TRIM support for CHAR/VARCHAR types Oct 8, 2025

formalize concat

769b46a

XuechunHHH commented Oct 8, 2025

View reviewed changes

XuechunHHH requested review from alancai98 and lucaxchen October 8, 2025 17:25

XuechunHHH added 2 commits October 8, 2025 11:31

add trim

aea18f8

# Conflicts: # CHANGELOG.md

update CHANGELOG

6333695

lucaxchen reviewed Oct 8, 2025

View reviewed changes

update tests names

a03a903

alancai98 reviewed Oct 8, 2025

View reviewed changes

xd1313113 reviewed Oct 9, 2025

View reviewed changes

partiql-spi/src/main/kotlin/org/partiql/spi/function/builtins/FnConcat.kt Outdated Show resolved Hide resolved

xd1313113 reviewed Oct 9, 2025

View reviewed changes

partiql-spi/src/main/kotlin/org/partiql/spi/function/builtins/FnUpper.kt Outdated Show resolved Hide resolved

formalize acc. sql2023

37fe13c

update changelog

5a958c8

XuechunHHH commented Oct 13, 2025

View reviewed changes

CHANGELOG.md Outdated Show resolved Hide resolved

partiql-planner/src/test/kotlin/org/partiql/planner/util/Utils.kt Show resolved Hide resolved

XuechunHHH requested review from alancai98, lucaxchen and xd1313113 October 13, 2025 17:02

XuechunHHH self-assigned this Oct 13, 2025

lucaxchen reviewed Oct 13, 2025

View reviewed changes

alancai98 reviewed Oct 13, 2025

View reviewed changes

XuechunHHH added 2 commits October 13, 2025 12:18

update like predicate

489a0f6

update casttableptype; update javadoc; add blob(len) syntax support

290c439

XuechunHHH requested a review from alancai98 October 13, 2025 21:12

XuechunHHH commented Oct 13, 2025

View reviewed changes

alancai98 approved these changes Oct 13, 2025

View reviewed changes

XuechunHHH merged commit ddb9a95 into main Oct 13, 2025
17 checks passed

XuechunHHH deleted the add--string-fn-support-on-char branch October 13, 2025 21:39

		@@ -1,56 +1,100 @@
		// ktlint-disable filename
		@file:Suppress("ClassName")

add: UPPER, LOWER and TRIM support for CHAR/VARCHAR types #1839

add: UPPER, LOWER and TRIM support for CHAR/VARCHAR types #1839

Uh oh!

Conversation

XuechunHHH commented Oct 1, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Relevant Issues

Description

Other Information

License Information

Uh oh!

github-actions bot commented Oct 1, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

CROSS-COMMIT-REPORT-PARTIQLCORE ❌

Testing Details

Result Details

New Tests Added

Now FAILING Tests ❌

Now Passing Tests

CROSS-COMMIT-REPORT-PARTIQLEXTENDED ✅

Testing Details

Result Details

New Tests Added

Uh oh!

XuechunHHH commented Oct 1, 2025

Uh oh!

Uh oh!

Uh oh!

XuechunHHH Oct 8, 2025

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

xd1313113 commented Oct 8, 2025

Uh oh!

XuechunHHH commented Oct 8, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

xd1313113 commented Oct 8, 2025

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

alancai98 commented Oct 8, 2025 • edited by xd1313113 Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

xd1313113 commented Oct 8, 2025

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

XuechunHHH Oct 13, 2025

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

add: `UPPER`, `LOWER` and `TRIM` support for `CHAR/VARCHAR` types #1839

add: `UPPER`, `LOWER` and `TRIM` support for `CHAR/VARCHAR` types #1839

XuechunHHH commented Oct 1, 2025 •

edited

Loading

github-actions bot commented Oct 1, 2025 •

edited

Loading

XuechunHHH commented Oct 8, 2025 •

edited

Loading

alancai98 commented Oct 8, 2025 •

edited by xd1313113

Loading