Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Payments: Dedupe rows on all incoming tables #2945

Closed
10 tasks
lauriemerrell opened this issue Sep 18, 2023 · 2 comments
Closed
10 tasks

Payments: Dedupe rows on all incoming tables #2945

lauriemerrell opened this issue Sep 18, 2023 · 2 comments
Assignees

Comments

@lauriemerrell
Copy link
Contributor

lauriemerrell commented Sep 18, 2023

We currently dedupe Payments micropayments data to account for the fact that the same data can be uploaded multiple times (and because we sometimes get multiple full duplicate rows). We should add the same handling on all Payments tables. ( ⚠️ Primary key to use for deduplication will vary; we should aim to dedupe down to the entry/file level in staging tables, I think.)

  • LP authorisations
  • LP customer funding sources
  • LP device transaction purchases
  • LP device transactions
  • LP micropayment adjustments
  • LP micropayment device transactions
  • LP product data
  • LP refunds
  • LP settlements
  • Elavon transactions (double check whether applicable to Elavon data)
@lauriemerrell
Copy link
Contributor Author

Transferring from offline conversation: We have discovered that the current micropayments QUALIFY probably deserves a bit more scrutiny. We are finding a fairly large number of cases where it combines rows with distinct transaction_time values, whose interpretation is unclear to us.

@lauriemerrell
Copy link
Contributor Author

This is closed in #2993 and #2994

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants