开发者

Robots.txt, disallow multilanguage URL

开发者 https://www.devze.com 2023-01-14 13:18 出处:网络
I have a public page that is not supposed be possible for users to sign into. So I have a url that there is no link to and you have to enter manually and then sign in.

I have a public page that is not supposed be possible for users to sign into. So I have a url that there is no link to and you have to enter manually and then sign in.

The url is multilanguage however, so it can be "/SV/Account/Logon" or开发者_Python百科 "/EN/Account/Logon" etc etc. Can I disable this url to be indexed for all languages?


This url might help you http://www.robotstxt.org/robotstxt.html. There will be no wildcard exclusion in your case you will have to add all the language specific login urls in robot.txt

Update

you can put Disallow: /folder/subfolder/ or Disallow: /folder/ in your robots.txt file

0

精彩评论

暂无评论...
验证码 换一张
取 消

关注公众号