Any solutions to capture data within a website automatically?

I want to write an application to capture data from a website, and th开发者_开发技巧e website are using ajax to retrieve data from server.

Is there any solutions that I can get those data conveniently and store into my own database ? As the data in that website is dynamic, historical data will disappear, and I want to keep track them.

Please suggest any solutions, thanks in advance !

---

Selenium RC can do this with a little bit of work.\

http://seleniumhq.org/

---

You may try IRobotSoft Web Scraper. Check demos here http://irobotsoft.com/help/ to see if it is what you want.