This repo contains the Scrapy based crawler for Baden Württemberg Connected.
The base page is https://www.bwcon.de/aus-dem-netzwerk/meldungen.
For testing purposes install all dependencies from
requirements.txt
file and run as follows:
scrapy runspider bwcon/bwcon/spiders/bwcon_de.py