Merge requests · yujiosaka / headless-chrome-crawler

Update robots-parser to the latest version 🚀

!90 · created Jan 25, 2018 by Administrator greenkeeper
- MERGED
- 1
updated Jan 25, 2018
Update sinon to the latest version 🚀

!89 · created Jan 23, 2018 by Administrator greenkeeper
- MERGED
- 1
updated Jan 24, 2018
Update sinon to the latest version 🚀

!88 · created Jan 21, 2018 by Administrator greenkeeper
- MERGED
- 1
updated Jan 21, 2018
Update jquery to the latest version 🚀

!87 · created Jan 20, 2018 by Administrator greenkeeper
- MERGED
- 1
updated Jan 21, 2018
Update eslint to the latest version 🚀

!86 · created Jan 20, 2018 by Administrator greenkeeper
- MERGED
- 1
updated Jan 20, 2018
Bump version

!85 · created Jan 19, 2018 by yujiosaka
- MERGED
- 1
updated Jan 19, 2018
E2e test

!84 · created Jan 19, 2018 by yujiosaka
- MERGED
- 1
updated Jan 19, 2018
drop istanbul

!83 · created Jan 19, 2018 by yujiosaka
- MERGED
- 1
updated Mar 20, 2023
Reduce response object in crawler rather than hccrawler

!81 · created Jan 19, 2018 by yujiosaka
- MERGED
- 1
updated Jan 19, 2018
Update mocha to the latest version 🚀

!80 · created Jan 18, 2018 by Administrator greenkeeper
- MERGED
- 1
updated Jan 18, 2018
Update sinon to the latest version 🚀

!79 · created Jan 16, 2018 by Administrator greenkeeper
- MERGED
- 1
updated Jan 17, 2018
Elaborate cache

!78 · created Jan 14, 2018 by yujiosaka
- MERGED
- 1
updated Jan 14, 2018
follow sitemaps

!76 · created Jan 14, 2018 by yujiosaka
- MERGED
- 1
updated Jan 14, 2018
Bump version

!75 · created Jan 13, 2018 by yujiosaka
- MERGED
- 1
updated Jan 13, 2018
fix response

!74 · created Jan 13, 2018 by yujiosaka
- MERGED
- 1
updated Mar 20, 2023
Fix a bug of not following robots.txt

!73 · created Jan 13, 2018 by yujiosaka
- MERGED
- 1
updated Mar 20, 2023
Support distributed crawler

!72 · created Jan 13, 2018 by yujiosaka
- MERGED
- 1
updated Jan 13, 2018
Update sinon to the latest version 🚀

!70 · created Jan 13, 2018 by Administrator greenkeeper
- MERGED
- 1
updated Jan 13, 2018
Allow maxDepth option to be overridden

!69 · created Jan 13, 2018 by yujiosaka
- MERGED
- 1
updated Mar 20, 2023
Bump version

!68 · created Jan 12, 2018 by yujiosaka
- MERGED
- 1
updated Jan 12, 2018