开发者

YQL Blacklisting

开发者 https://www.devze.com 2023-03-03 12:38 出处:网络
I\'m developing an online deck editor, Proxymang, and YQL can\'t handle th开发者_开发知识库e number of requests per second. The requests are one per Magic card, they\'re cached, and they\'re spaced ou

I'm developing an online deck editor, Proxymang, and YQL can't handle th开发者_开发知识库e number of requests per second. The requests are one per Magic card, they're cached, and they're spaced out. What should I do?

GitHub


I never resolved the problem; I eventually decided to use the Gatherer's meager API instead.

The problem seems to one of the following:

  • YQL blacklisted YelloSoft after too many requests/second
  • MagicCards.info blacklisted YQL after too many requests/second
  • MagicCards.info has a strict robots.txt which blocks HTML scraping, but not always
0

精彩评论

暂无评论...
验证码 换一张
取 消