How to change crawl settings for a site audit

Last reviewed October 30, 2026

1 min read

Crawl settings decide how much of the site an audit reads and how hard it works the site’s server. Changes apply from the next crawl.

Steps

  1. Open the client’s project, go to Audit › Technical audit, click the settings button at the top and open Crawl settings.

  2. Under Limits, set the most pages to crawl (Max pages), how many clicks from the start page to follow (Max depth) and the longest the crawl can run (Max duration).

    Crawl settings: Limits, and Advanced with Parallel requests, Delay between requests and Obey robots.txt
  3. Under Advanced, set Parallel requests and Delay between requests: more requests and a shorter delay crawl faster, but put more load on the client’s site. Turn on Obey robots.txt to skip pages the site asks crawlers to leave alone.

  4. Click Save settings.

Can’t find what you need?

Search the User Guide for a how-to, or contact our support team and we’ll help.