Open
Description
💡 Summary
A new, alternative solution to filtering PII out of data needs to be researched - with an emphasis on performance and minimal execution time impact.
Motivation and context
We currently have some PII filter code, however, it causes such a large impact on execution time that it's not feasible to use. We need to find a PII filter solution that doesn't have this problem (or greatly reduces it)
Implementation notes
- Research needed for PII filter techniques
- Evaluate how each technique impacts execution time
- Need to find a solution that strikes a balance between accurately redacting PII and not hurting execution time too much
Acceptance criteria
- Research alternative PII filter techniques
- Evaluate each one and measure its impact on execution time
- Once an ideal candidate is found, implement and test it
- If the new solution works well, put it into normal use