开发者

In robots.txt, what will Disallow: /?s block?

开发者 https://www.devze.com 2023-01-15 03:10 出处:网络
What will this line block when the search engine crawls the website? Disa开发者_Python百科llow: /?sIt will block robots from crawling any URLs (in the root (?)) that they stumble upon that contain s

What will this line block when the search engine crawls the website?

Disa开发者_Python百科llow: /?s


It will block robots from crawling any URLs (in the root (?)) that they stumble upon that contain s in their query strings.

0

精彩评论

暂无评论...
验证码 换一张
取 消