Of course, that's not everything

mebrokenheard11

Listen Mode Screaming Frog With the list crawl you can immediately determine whether all URLs were forwarded correctly after a relaunch. Important: Here, too, you should make the setting beforehand that the bot should always follow all redirects.  you should consider when relaunching, but there's a separate blog post about it including a relaunch checklist . By the way: The list mode is not limited to 500 URLs in the free version , but you can crawl an unlimited number of URLs! #6 Canonicals Regarding the canonicals, I particularly like the display options in the Screaming Frog itself on the right.

Here you can see at a glance how many URLs are canonicalized and how many do India Car Owner Phone Number List not have a canonical tag. You can also click on the individual points and then easily export them to Excel. canonical view in the Screaming Frog #7 Dan`s tip: Create or crawl an XML sitemap With the Screaming Frog you can not only easily create an XML sitemap, but also crawl a live sitemap to determine, for example, whether it contains incorrect pages. Dan Sharp, Co-Founder of Screaming Frog explains how: “An easy one we like is cleaning up XML sitemaps.



If an XML sitemap is live already, switch to list mode (Mode > List) and choose 'Download Sitemap' or 'Download Sitemap Index', and input the URL. Remember to also go to 'Configuration > Robots.txt > Settings' and untick 'Ignore robots.txt', so you can see if any URLs that are disallowed are in the XML Sitemap. The SEO Spider will then crawl the URLs directly from the live sitemap. You can then check for anything that isn't a 200 response (No responses, 3XX, 4XX, 5XX etc), and spot URLs that are blocked by robots.txt, canonicalised, or noindex and shouldn't be in there.