accessing multiple web pages at a time using c#

my project need to read multiple web pa开发者_JS百科ges at a time(eg: for a particular keyword google will display 100 pages result maximum) I tried to read that 100 pages using 'for' loop in URL.But it is showing http request exception in c#.How can i read that pages within sort period of time???

---

To do it in parallel, push the code onto the ThreadPool. It will not run 100 threads at once (but you don't want that).

---

this is really nice

http://blogs.msdn.com/somasegar/archive/2009/11/18/reactive-extensions-for-net-rx.aspx http://www.minddriven.de/?p=550

But maybe you can not use RX .

---

My guess is that you either try to access a disposed object or you don't dispose it, thus leaving too much connections open.

Post some code for more help.

---

Here is simple solution. But doing so many requests in parallel is very bad, so you have to do some mechanism to reduce number off simultaneous threads.

void QueueWorkItems()
{
    for (int i = 0; i < 10; i++)
        new Action<string>(Request).BeginInvoke("http://www.google.com/search?q=test&start=" + (i * 10), null, null);
}

void Request(string url)
{
    //Process your request
}