Adblocker on downloader client

[falkecarlsen]

When scraping, the user is typically not interested in arbitrary ads and their linked sites.

An adblocker builtin to the downloader client, maybe simply by using a hosts file with an adblocker-list appended could work.

[falkecarlsen]

Testing should take into account common - but straightforward - methods of embedding ads on a website, such as tagging these divs #ad or similar.

This testing could very much use mocking.