开发者

Handling multiple connections to the host simultaneously

开发者 https://www.devze.com 2022-12-23 08:12 出处:网络
How can I handle a number of connections to开发者_如何学C the host at the same time?From nutch-default.xml:

How can I handle a number of connections to开发者_如何学C the host at the same time?


From nutch-default.xml:

<property>
  <name>fetcher.threads.fetch</name>
  <value>10</value>
  <description>The number of FetcherThreads the fetcher should use.
    This is also determines the maximum number of requests that are 
    made at once (each FetcherThread handles one connection).</description>
</property>

<property>
  <name>fetcher.threads.per.host</name>
  <value>1</value>
  <description>This number is the maximum number of threads that
    should be allowed to access a host at one time.</description>
</property>

As noted above, the number of connections is at most equal to the number of threads. The first property controls the overall number of connections and the second the number of connections per host - this is the one you need to set.

0

精彩评论

暂无评论...
验证码 换一张
取 消

关注公众号