Skip to content

Proxy Infrastructure to pass splash requests through the TOR network.

Notifications You must be signed in to change notification settings

DatenBergwerker/splash-tor-proxy

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

15 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

splash-tor-proxy

Proxy Infrastructure to pass local splash rendering requests through the TOR network. The goal with this setup is to obfuscate the source of requests. It is not yet configured for proxy rotation by rebuilding TOR circuits.

Requirements

Docker, Docker-Compose

Installation

Just run docker-compose -f splash-proxy-infrastructure.yml up -d to initialize the containers.

Usage

If you utilize the Python package Scrapy for your web-scraping projects, you can configure this splash service as your rendering engine for your spider requests. No additional changes are required, the spider only has to be able to make requests to localhost:8050. Please be mindful that routing via TOR is slower than non onion routing, so adjust your requests limits accordingly. Dont flood the TOR network with scraping requests.

About

Proxy Infrastructure to pass splash requests through the TOR network.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published