Commit 06c4eaf
[Server-Side Planning] Implement projection escaping for dotted column names
Add backtick escaping for column names containing dots when sending
projections to Iceberg REST API. This distinguishes between:
- Literal dotted columns: "address.city" as a single field -> "`address.city`"
- Nested field access: address.intCol (parent.child) -> "address.intCol"
Implementation:
- Added escapeProjectedColumns() to process required schema fields
- Added escapeColumnNameIfNeeded() for recursive nested field handling
- Escaping happens in ServerSidePlannedTable before calling planScan()
- No changes to filter conversion (Iceberg's Binder handles disambiguation)
All tests passing (34 total: 22 iceberg + 12 spark)
Co-Authored-By: Claude Sonnet 4.5 <[email protected]>1 parent fb9ad0e commit 06c4eaf
File tree
1 file changed
+51
-1
lines changed- spark/src/main/scala/org/apache/spark/sql/delta/serverSidePlanning
1 file changed
+51
-1
lines changedLines changed: 51 additions & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
279 | 279 | | |
280 | 280 | | |
281 | 281 | | |
282 | | - | |
| 282 | + | |
| 283 | + | |
| 284 | + | |
| 285 | + | |
| 286 | + | |
| 287 | + | |
| 288 | + | |
| 289 | + | |
| 290 | + | |
| 291 | + | |
| 292 | + | |
| 293 | + | |
| 294 | + | |
| 295 | + | |
| 296 | + | |
| 297 | + | |
| 298 | + | |
| 299 | + | |
| 300 | + | |
| 301 | + | |
| 302 | + | |
| 303 | + | |
| 304 | + | |
| 305 | + | |
| 306 | + | |
| 307 | + | |
| 308 | + | |
| 309 | + | |
| 310 | + | |
| 311 | + | |
| 312 | + | |
| 313 | + | |
| 314 | + | |
| 315 | + | |
| 316 | + | |
| 317 | + | |
| 318 | + | |
| 319 | + | |
| 320 | + | |
| 321 | + | |
| 322 | + | |
| 323 | + | |
| 324 | + | |
| 325 | + | |
| 326 | + | |
| 327 | + | |
| 328 | + | |
| 329 | + | |
| 330 | + | |
| 331 | + | |
| 332 | + | |
283 | 333 | | |
284 | 334 | | |
285 | 335 | | |
| |||
0 commit comments