Choose a factor that affects the crawling process negatively.

  • Duplicate pages/content
  • A well-defined hierarchy of the pages
  • Content freshness