Automatic cleaning of non-existent domains

[ygguser]

I am adding some domains to my custom list. There are a little less than 100 of them.

It also contains regular expressions.

It is known that domains may cease to exist.

In this regard, the question is: isn't there such an opportunity to automatically check domains in my list for existence and delete non-existent ones?

This way, only existing domains would remain on the list, the list would not grow, and this might have a slight effect on performance for the better.

Perhaps the developers would add this feature? :)

[Dynamic5912]

Too much overhead and resources.

You're best off using maintained list by blocklist maintainers that actually update their lists.

[ygguser]

I also use the list that comes with AGH by default.
However, what I need is not there. This is not in the other public lists that I have seen...

[Dynamic5912]

What are you blocking then?

AGH is meant for Ad, Tracker, Malware etc. blocking.

Any decent list maintainer out there will have comprehensive lists that cover these requirements.

[ygguser]

I use this to block ads. Not all addresses are included in the public lists.
A couple for example:

ads-matresh.ru
p-rumo00.kxcdn.com
adam.ozon.ru
...

[rflazaro]

I know you’re talking about your custom list.

Just sharing, below are sized-optimized lists based on active domains.

HaGeZi's Pro mini - 87,134 rules
https://github.com/hagezi/dns-blocklists?tab=readme-ov-file#promini
Size-optimised version for DNS/Browser adblockers. This list only contains domains from the Pro full that have been found on Top 1M lists in the last 12 months.

HaGeZi's TIF mini - 94,218 rules
https://github.com/hagezi/dns-blocklists?tab=readme-ov-file#tifmini
A size-optimised version of the Threat Intelligence Feeds Medium list. Designed for Adblockers that have problems with the size of the TIF Medium list.

xRuffKeyz NRD Phishing 30-days - 8,634 rules
https://github.com/xRuffKez/NRD/tree/main/lists/30-day_phishing
NRD list useful for blocking recently registered domains, many of which are associated with malicious behavior, advertisements, or unwanted tracking.

OISD Big Safe Top-N - 121,874 rules
https://github.com/cbuijs/oisd/tree/master/big
Optimized version of OISD Big blocklist. Safe list, suggested excludes removed. Domains actually used according TOP-N lists.