Consider this piece of code:
<tr>
<td valign=top class="tim_new"><a href="/stocks/company_in开发者_运维知识库fo/pricechart.php?sc_did=MI42" class="tim_new">3M India</a></td>
<td class="tim_new" valign=top><a href='/stocks/marketstats/indcomp.php?optex=NSE&indcode=Diversified' class=tim>Diversified</a></td>
I want to write a piece of code using HTMLAgility pack which would extract the link in the first line.
using System;
using System.Collections.Generic;
using System.Linq;
using System.Text;
using HtmlAgilityPack;
namespace WebScraper
{
class Program
{
static void Main(string[] args)
{
HtmlDocument doc = new HtmlDocument();
doc.LoadHtml("http://theurl.com");
try
{
var links = doc.DocumentNode.SelectNodes("//td[@class=\"tim_new\"]");
}
catch (Exception ex)
{
Console.WriteLine(ex.Message);
Console.WriteLine(ex.StackTrace);
Console.ReadKey();
}
}
}
}
When I try to insert a foreach(var link in links)
statement/loop inside the try block, a runtime error is thrown.
The code doc.LoadHtml("http://theurl.com");
will not work. The parameter to LoadHtml should be a string containing HTML, not a URL. You must first fetch the HTML document before trying to parse it.
Once you have the document loaded, for this specific example you can use this:
IEnumerable<string> links = doc.DocumentNode
.SelectNodes("//a[@class='tim_new']")
.Select(n => n.Attributes["href"].Value);
精彩评论