From 0cc07708e491976df49bbdd15f986d45eedc78fe Mon Sep 17 00:00:00 2001 From: ProxyCrawl <39630115+proxycrawl@users.noreply.github.com> Date: Tue, 12 Nov 2019 09:18:58 +0800 Subject: [PATCH] Add proxycrawl ProxyCrawl library allows to bypass captchas and blocks without using proxies which is perfect for crawling and scraping web content. --- README.md | 1 + 1 file changed, 1 insertion(+) diff --git a/README.md b/README.md index 664cd31..1595f8e 100644 --- a/README.md +++ b/README.md @@ -1175,6 +1175,7 @@ Inspired by [awesome-php](https://github.com/ziadoz/awesome-php). * [robobrowser](https://github.com/jmcarp/robobrowser) - A simple, Pythonic library for browsing the web without a standalone web browser. * [scrapy](https://scrapy.org/) - A fast high-level screen scraping and web crawling framework. * [portia](https://github.com/scrapinghub/portia) - Visual scraping for Scrapy. +* [proxycrawl](https://github.com/proxycrawl/proxycrawl-python) - Crawling library to avoid captchas, proxies and blocks. ## Web Frameworks -- GitLab