开发者

How do I crawl all the pages on my internal website?

开发者 https://www.devze.com 2023-01-02 11:10 出处:网络
I want to hit every 开发者_Go百科page on my internal website to see if any throw an error just from looking at them. The website does its own error logging, so I just need something to follow links.

I want to hit every 开发者_Go百科page on my internal website to see if any throw an error just from looking at them. The website does its own error logging, so I just need something to follow links.

I am running Windows XP and IIS.


Try the IIS SEO toolkit. Inspects your site for SEO related issues which includes broken links.

IIS SEO Toolkit


wget --spider <URL>

edit- just noticed you said windows:

http://gnuwin32.sourceforge.net/packages/wget.htm

0

精彩评论

暂无评论...
验证码 换一张
取 消