-
Notifications
You must be signed in to change notification settings - Fork 139
Open
Labels
Description
Please describe why this is necessary.
InCommitTimestamps (ICTs) associates a monotonically increasing timestamp with each commit. Currently, CDF only extracts the file modification timestamp of the commit. The goal is to extract ICT from a commit only if ICT is enabled.
Describe the functionality you are proposing.
In the LogReplayScanner for table_changes, you must do the following:
- Apply the InCommitTimestamp visitor to commit action
- Query the latest table_configuration. Be mindful to query a newly constructed one if metadata or protocol has been updated.
- If the latest table_configuration has ICT enabled, then set the timestamp to be the ICT. Otherwise, default to the last_modified timestamp.
Additional context
No response
Metadata
Metadata
Assignees
Labels
Type
Projects
Status
No status