Commit 8dee476
[Server-Side Planning] Implement projection escaping for dotted column names
Add backtick escaping for column names containing dots when sending
projections to Iceberg REST API. This distinguishes between:
- Literal dotted columns: "address.city" as a single field -> "`address.city`"
- Nested field access: address.intCol (parent.child) -> "address.intCol"
Implementation:
- Added escapeProjectedColumns() to process required schema fields
- Added escapeColumnNameIfNeeded() for recursive nested field handling
- Escaping happens in ServerSidePlannedTable before calling planScan()
- No changes to filter conversion (Iceberg's Binder handles disambiguation)
All tests passing (34 total: 22 iceberg + 12 spark)
Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>1 parent fb9ad0e commit 8dee476
File tree
2 files changed
+55
-1
lines changed- iceberg/src/test/scala/org/apache/spark/sql/delta/serverSidePlanning
- spark/src/main/scala/org/apache/spark/sql/delta/serverSidePlanning
2 files changed
+55
-1
lines changedLines changed: 4 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
324 | 324 | | |
325 | 325 | | |
326 | 326 | | |
| 327 | + | |
| 328 | + | |
| 329 | + | |
| 330 | + | |
327 | 331 | | |
328 | 332 | | |
329 | 333 | | |
| |||
Lines changed: 51 additions & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
279 | 279 | | |
280 | 280 | | |
281 | 281 | | |
282 | | - | |
| 282 | + | |
| 283 | + | |
| 284 | + | |
| 285 | + | |
| 286 | + | |
| 287 | + | |
| 288 | + | |
| 289 | + | |
| 290 | + | |
| 291 | + | |
| 292 | + | |
| 293 | + | |
| 294 | + | |
| 295 | + | |
| 296 | + | |
| 297 | + | |
| 298 | + | |
| 299 | + | |
| 300 | + | |
| 301 | + | |
| 302 | + | |
| 303 | + | |
| 304 | + | |
| 305 | + | |
| 306 | + | |
| 307 | + | |
| 308 | + | |
| 309 | + | |
| 310 | + | |
| 311 | + | |
| 312 | + | |
| 313 | + | |
| 314 | + | |
| 315 | + | |
| 316 | + | |
| 317 | + | |
| 318 | + | |
| 319 | + | |
| 320 | + | |
| 321 | + | |
| 322 | + | |
| 323 | + | |
| 324 | + | |
| 325 | + | |
| 326 | + | |
| 327 | + | |
| 328 | + | |
| 329 | + | |
| 330 | + | |
| 331 | + | |
| 332 | + | |
283 | 333 | | |
284 | 334 | | |
285 | 335 | | |
| |||
0 commit comments