Skip to content

Feat/bulk scan cache #5687

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 19 commits into from
Closed

Feat/bulk scan cache #5687

wants to merge 19 commits into from

Conversation

AugmentedMode
Copy link
Contributor

Explanation

The bulk URL scanning functionality in PhishingController previously didn't leverage the URL scan cache that was already implemented for single URL scanning. This meant that even if a URL had been recently scanned, it would be scanned again when included in a bulk scan request, causing unnecessary API calls and increased response times.

This PR extends the caching functionality to the bulkScanUrls method, allowing it to:

  1. Check the cache for each URL before sending API requests
  2. Only scan URLs that aren't already in the cache
  3. Add newly scanned results to the cache for future use
  4. Return a combined response of both cached and newly scanned results

This optimization significantly reduces API calls and improves response times for bulk scan operations, especially when the same URLs are frequently scanned.

References

Related to #5625 (Add URL scan cache functionality)
Extends functionality from #5682 (Add bulk scan functionality)

AugmentedMode and others added 19 commits April 9, 2025 23:56
@AugmentedMode AugmentedMode self-assigned this Apr 22, 2025
@AugmentedMode AugmentedMode requested review from a team as code owners April 22, 2025 14:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant