Skip to content

feat: Add CDF tracing for Phase 2 of Change Data feed #1640

@OussamaSaoudi

Description

@OussamaSaoudi

Please describe why this is necessary.

While debugging issues in CDF, it is useful to know information about the query to pinpoint problems. I propose adding tracing statements to understand the metadata filtering in ChangeDataFeed.

Describe the functionality you are proposing.

Add tracing statement at the end of LogReplayScanner::into_scan_batches that logs the following:

  • The size of the remove deletion vector hashset
  • Whether cdc was found
  • file path
  • version
  • timestamp
  • Total number of rows processed
  • Total number of rows selected

Additional context

No response

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions