How can I handle a number of connections to开发者_如何学C the host at the same time?
From nutch-default.xml:
<property>
<name>fetcher.threads.fetch</name>
<value>10</value>
<description>The number of FetcherThreads the fetcher should use.
This is also determines the maximum number of requests that are
made at once (each FetcherThread handles one connection).</description>
</property>
<property>
<name>fetcher.threads.per.host</name>
<value>1</value>
<description>This number is the maximum number of threads that
should be allowed to access a host at one time.</description>
</property>
As noted above, the number of connections is at most equal to the number of threads. The first property controls the overall number of connections and the second the number of connections per host - this is the one you need to set.
精彩评论