-
Notifications
You must be signed in to change notification settings - Fork 246
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Fix #1438 - optionally gather fields after ingest exception #1439
base: integration
Are you sure you want to change the base?
Conversation
3f22d45
to
aebd8d2
Compare
… to error records
d3a6ee4
to
9f09371
Compare
Multiple test cases were conducted using the quickstart json data:
Case 1 operated as it does today, including all the normally-ingested fields and the supplemental fields in the error table writes. The other half of the data was written to the shard table, as expected. Case 2 operated with the new behavior: adding LOAD_DATE, ORIG_FILE, and salvaged fields to the error tables along with what it previously written. Case 3 operated as expected, ingesting the data into the shard table. |
No description provided.