-
Notifications
You must be signed in to change notification settings - Fork 216
Open
Description
When query a table with delta.enableRowTracking = true, we meet this error:
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Caused by: java.lang.IllegalStateException: Missing base_row_id value for file 'delta-sharing:/x'
at org.apache.spark.sql.delta.DeltaParquetFileFormat.$anonfun$fileConstantMetadataExtractors$2(DeltaParquetFileFormat.scala:290)
at scala.collection.immutable.Map$EmptyMap$.getOrElse(Map.scala:110)
at org.apache.spark.sql.delta.DeltaParquetFileFormat.$anonfun$fileConstantMetadataExtractors$1(DeltaParquetFileFormat.scala:289)
at org.apache.spark.sql.execution.datasources.FileFormat$.getFileConstantMetadataColumnValue(FileFormat.scala:299)
at org.apache.spark.sql.execution.datasources.FileFormat$.$anonfun$updateMetadataInternalRow$1(FileFormat.scala:334)
at org.apache.spark.sql.execution.datasources.FileFormat$.$anonfun$updateMetadataInternalRow$1$adapted(FileFormat.scala:333)
at scala.collection.immutable.List.foreach(List.scala:431)
at org.apache.spark.sql.execution.datasources.FileFormat$.updateMetadataInMetadata
Metadata
Assignees
Labels
No labels