开发者

robots.txt and serving images from a separate domain

开发者 https://www.devze.com 2023-04-08 05:42 出处:网络
I\'m trying to find out if a robots.txt file set on domain A will still apply to an image served from domain B, but actually displayed on domain A.

I'm trying to find out if a robots.txt file set on domain A will still apply to an image served from domain B, but actually displayed on domain A.

Example:

Somewhere on the page on www.example.com, there is an:

<img src="http://img.example.com/images/myimage.jpg" />`

In www.example.com/robots.txt, it says:

User-agent: *
Disallow: /images/

So when the spider hits www.example.com and sees the image being served from img.example.开发者_如何学Ccom, will it index it?


robots.txt only applies to the hostname it actually exists on.

0

精彩评论

暂无评论...
验证码 换一张
取 消