开发者

Rails / Ruby - Real time screen scraping?

开发者 https://www.devze.com 2023-04-03 21:18 出处：网络

How is it possiable to create real time screen scraping? Like this site: www.bog.nu Here is some information about the site on english: http://casperfabricius.com/site/201开发者_StackOverflow0/11/11

相关专题：ruby ruby-on-rails ruby-on-rails-3

How is it possiable to create real time screen scraping?

Like this site: www.bog.nu

Here is some information about the site on english: http://casperfabricius.com/site/201开发者_StackOverflow0/11/11/launch-bog-nu/

I know about Mechanize. But I don´t see it should work with Cramp and Eventmachine.

I'm not sure what the question is--they'll crawl the websites they want to scrape, parse the HTML, and get the info they need.

I don't know how they've broken up the responsibilities of the app, but for example, see this example for one way you could grab info and stream it real-time. Here the info is going to an HTML5 page, but it could just as easily be stuffed in to a database and served up by a regular browser request rather than streamed.