How to programmatically access websites through Java? Download HTML code, save cookies, fill and send forms etc

D开发者_如何学JAVAownloading a code of website is not a problem. However using this code not always is so simple.

I was wondering if there is any package, which makes it more easy to send HTTP GET/POST requests according to specified form. This will help perform a log-in to some websites, even using SSL.

I am sure that there are hundreds of programs which make such things possible. I was wondering what would be the best practices in this scope.

---

You can use HttpUnit to programmatically examine a Web page, follow links, explore tables, work with forms, etc. See examples in the HttpUnit Cookbook.

Note: HttpUnit is meant for unit-testing, but perhaps it's OK for your purposes too.

---

You might want to use the Java HttpUnit library.

It even handles cookies and JavaScript.

---

see Http Client from apache

---

You dont use html for this. you need some kind of a webService... or show the page in a webView but still if you want something more with it either it needs to have a callback url or something which you can capture and extract from the url some params to use.

By the way i see android in the tags. is this actually an android question or its more general? i can't really tell what exactly are you looking for here.

---

I found Selenium from Selenium AndroidDriver, but I didn't tested it yet.