crawler get external website search result

1. What is the best practice and library I can use to key in search textbox on external website and collect the search result?

2. How do tackle website with different search box and checkbox and collect the result?

3. Can Selenium be used to automate this?

4. Should I us开发者_如何学JAVAe Heritrix or nutch? Which one is better? I heard nutch comes with plugins. Which one has a bigger community?

---

you can use:

• The Selenium API
• HtmlUnit
• Htmlparser

etc.