James Russo

James Russo

Software Engineer

Fullstack engineer who tries their best at design.
Example: this website.

Bored Hacking

1 post tagged with "proxy"

Avoiding Webscraping Throttling Using Python and Tor as a Proxy

68.calendar
July 08, 2019|
17 min read

In order to hide your IP address and to try and limit throttling when web scraping, it might be a good idea to use a proxy such as Tor. This post describes how to use Python based web scraping tools and Tor to hide yourself when scraping websites for data. However, it can also be used more broadly when using Python to make requests to hide your actual IP. I do not condone the use of this information for any illegal or illicit activity.

All tags
© 2024 James Russo. All Rights Reserved, Built with Gatsby