Skip to content
GitLab
Projects Groups Snippets
  • /
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in / Register
  • H headless-chrome-crawler
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 29
    • Issues 29
    • List
    • Boards
    • Service Desk
    • Milestones
  • Merge requests 4
    • Merge requests 4
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Deployments
    • Deployments
    • Environments
    • Releases
  • Packages and registries
    • Packages and registries
    • Package Registry
    • Infrastructure Registry
  • Monitor
    • Monitor
    • Incidents
  • Analytics
    • Analytics
    • Value stream
    • CI/CD
    • Repository
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • yujiosaka
  • headless-chrome-crawler
  • Merge requests
  • !112

Revert "feat: support depthPriority option"

  • Review changes

  • Download
  • Email patches
  • Plain diff
Merged yujiosaka requested to merge revert-109-support_depth_first_order into master Feb 21, 2018
  • Overview 1
  • Commits 1
  • Pipelines 0
  • Changes 5

Reverts yujiosaka/headless-chrome-crawler#109

It started requesting the same urls many times when depth-first search is enabled:

Requested https://www.emin.co.jp/.
Requested https://www.emin.co.jp/blog/news/1506/.
Requested https://www.emin.co.jp/contact/.
Requested https://www.emin.co.jp/blog/lab/.
Requested https://www.emin.co.jp/team/.
Requested https://www.emin.co.jp/careers/.
Requested https://www.emin.co.jp/blog/news/1539/.
Requested https://www.emin.co.jp/blog/.
Requested https://www.emin.co.jp/blog/interview/1098/.
Requested https://www.emin.co.jp/blog/news/1527/.
Requested https://www.emin.co.jp/company/.
Requested https://www.emin.co.jp/contact/.
Requested https://www.emin.co.jp/blog/news/1506/.
Requested https://www.emin.co.jp/blog/lab/.
Requested https://www.emin.co.jp/careers/.
Requested https://www.emin.co.jp/team/.
Requested https://www.emin.co.jp/blog/news/1539/.
Requested https://www.emin.co.jp/blog/.
Requested https://www.emin.co.jp/blog/news/1527/.
Requested https://www.emin.co.jp/blog/interview/1098/.
Requested https://www.emin.co.jp/company/.
Requested https://www.emin.co.jp/contact/.
Requested https://www.emin.co.jp/blog/news/1506/.
Requested https://www.emin.co.jp/team/.
Requested https://www.emin.co.jp/blog/lab/.
Requested https://www.emin.co.jp/careers/.
Requested https://www.emin.co.jp/blog/news/1539/.
Requested https://www.emin.co.jp/blog/.
Requested https://www.emin.co.jp/blog/interview/1098/.
Requested https://www.emin.co.jp/blog/news/1527/.
Requested https://www.emin.co.jp/company/.
Requested https://www.emin.co.jp/contact/.
Requested https://www.emin.co.jp/blog/news/1506/.
Requested https://www.emin.co.jp/blog/.
Requested https://www.emin.co.jp/company/.
Requested https://www.emin.co.jp/careers/.
Requested https://www.emin.co.jp/team/.
Requested https://www.emin.co.jp/blog/interview/681/.
Requested https://www.emin.co.jp/blog/lab/.
Requested https://www.emin.co.jp/careers/.
Requested https://www.emin.co.jp/blog/news/1539/.
Requested https://www.emin.co.jp/blog/.
Requested https://www.emin.co.jp/blog/category/news/.
Requested https://www.emin.co.jp/blog/interview/1098/.
Requested https://www.emin.co.jp/blog/news/1527/.
Requested https://www.emin.co.jp/company/.
Requested https://www.emin.co.jp/en/.
Requested https://www.emin.co.jp/contact/.
Requested https://www.emin.co.jp/blog/interview/638/.
Requested https://www.emin.co.jp/blog/interview/681/?share=twitter.
Requested https://www.emin.co.jp/blog/lab/.
Requested https://www.emin.co.jp/team/.
Requested https://www.emin.co.jp/blog/category/interview/.
Requested https://www.emin.co.jp/blog/interview/681/?share=google-plus-1.
Requested https://www.emin.co.jp/blog/interview/681/?share=facebook.
Requested https://www.emin.co.jp/blog/zenclerk-lite%e6%83%85%e5%a0%b1/1004/.
Requested https://www.emin.co.jp/blog/interview/462/.
Requested https://www.emin.co.jp/blog/news/1539/?share=twitter.
Requested https://www.emin.co.jp/blog/press/101/.
Requested https://www.emin.co.jp/blog/news/1539/?share=google-plus-1.
Requested https://www.emin.co.jp/info/news/172/.
Requested https://www.emin.co.jp/blog/news/1539/?share=facebook.
Requested https://www.emin.co.jp/blog/published/1390/.
Requested https://www.emin.co.jp/blog/news/401/.
Requested https://www.emin.co.jp/blog/lab/ec-system.
Requested https://www.emin.co.jp/blog/lab/ec-business.
Requested https://www.emin.co.jp/blog/news/1539/.
Requested https://www.emin.co.jp/blog/news/1506/.
Requested https://www.emin.co.jp/blog/published/1498/.
Requested https://www.emin.co.jp/blog/category/published/.
Requested https://www.emin.co.jp/blog/news/1527/.
Requested https://www.emin.co.jp/blog/category/press/.
Requested https://www.emin.co.jp/blog/published/1451/.
Requested https://www.emin.co.jp/blog/news/1415/.
Requested https://www.emin.co.jp/blog/press/1483/.
Requested https://www.emin.co.jp/blog/published/1426/.
Requested https://www.emin.co.jp/blog/published/1382/.
Requested https://www.emin.co.jp/blog/category/report/.
Requested https://www.emin.co.jp/blog/report/1363/.
Requested https://www.emin.co.jp/blog/published/1322/.
Requested https://www.emin.co.jp/blog/news/1361/.
Requested https://www.emin.co.jp/blog/published/1218/.
Requested https://www.emin.co.jp/blog/page/2/.
Requested https://www.emin.co.jp/blog/page/7/.
Requested https://www.emin.co.jp/blog/report/1291/.
Requested https://www.emin.co.jp/blog/date/2018/.
Requested https://www.emin.co.jp/blog/page/3/.
Requested https://www.emin.co.jp/blog/date/2017/.
Requested https://www.emin.co.jp/blog/date/2016/.
Requested https://www.emin.co.jp/blog/date/2015/.
Requested https://www.emin.co.jp/blog/date/2014/.
Requested https://www.emin.co.jp/blog/interview/1098/?share=twitter.
Requested https://www.emin.co.jp/blog/category/member/.
Requested https://www.emin.co.jp/blog/category/emin-infomation/.
Requested https://www.emin.co.jp/blog/category/zenclerk-information/.
Requested https://www.emin.co.jp/blog/news/1527/?share=twitter.
Requested https://www.emin.co.jp/blog/interview/1098/?share=google-plus-1.
Requested https://www.emin.co.jp/blog/category/zenclerk-lite%e6%83%85%e5%a0%b1/.
Requested https://www.emin.co.jp/blog/interview/1098/?share=facebook.
Requested https://www.emin.co.jp/blog/news/1527/?share=facebook.
Requested https://www.emin.co.jp/blog/news/1527/?share=google-plus-1.
Requested https://www.emin.co.jp/blog/news/1172/.
Requested https://www.emin.co.jp/contact/embed/.
Requested https://www.emin.co.jp/blog/interview/638/?share=twitter.
Requested https://www.emin.co.jp/blog/interview/638/?share=google-plus-1.
Requested https://www.emin.co.jp/wp-content/themes/emin/https://www.zenclerk.com/.
Requested https://www.emin.co.jp/blog/interview/638/?share=facebook.
Assignee
Assign to
Reviewers
Request review from
Time tracking
Source branch: revert-109-support_depth_first_order