MERGE INTO doesn't work when using non-deterministic expressions in Pyspark #14585
Description
Apache Iceberg version
1.7.1
Query engine
Spark
Please describe the bug 🐞
When I try to use a MERGE INTO statement to write to an Iceberg table in a Glue Job that applies a non-deterministic expression (e.g:uuid) I always get [INVALID_NON_DETERMINISTIC_EXPRESSIONS] The operator expects a deterministic expression. Is this something that is addressed in newer Iceberg versions?
Willingness to contribute
- I can contribute a fix for this bug independently
- I would be willing to contribute a fix for this bug with guidance from the Iceberg community
- I cannot contribute a fix for this bug at this time