Spidering allows you to scan many pages from a single domain at once, and view them in a combined instant scan visualization. This combined scan is useful at providing a higher level view of tag activity. Each individual page is stored as a separate scan in the spidering tab and can be viewed as part of the whole, or on it's own.
To enable spidering, first either start a new instant scan or edit the options for an existing one. To select spidering you will need to have the advanced options checkbox enabled.
Now check the "Spidering" box, and a new set of options will appear. These will allow you to choose how the spidering is done.
The first option lets you choose how many pages to scan, up to a maximum of 100. Note that since each page is run as a separate instant scan larger numbers here can take much longer to run.
The second option lets you choose what information to retain between pages. By default each page is run as a fresh scan, with the cookies, local storage and browser cache cleared each time. However you are able to choose to retain any of these elements if you would prefer.
Viewing the results
Once the scans have finished running you can view the combined results just like you would any other scan. This will show all tags from all pages on the same view, and you may want to switch to the company level filter to start to help keep things easier to read.
It's also worth noting that identical tags that show up on multiple pages will be combined into one, so don't necessarily have to worry if you see one tag with a large number of children.
Some tags also randomize script names, which may result in a different version of the same tag for each page.
If you would like to view the scan of an individual page you can select it under the settings in the Spidering tab. Click the gear next to the Instant Analysis box to view the scans setting, and then select the Spidering tab.
This tab shows a list of all pages scanned, and each can be selected to only show results from that specific page. At the bottom is an option to view all the pages at once.
This tab also shows the date the scan was performed, and allows you to download the data from the scans.