开发者

python parsing url after string

开发者 https://www.devze.com 2022-12-21 08:33 出处:网络
I want to extract a string from a url (link). That string is in a <h3></h3> tag. link = http://www.test.com/page.html

I want to extract a string from a url (link). That string is in a <h3></h3> tag.

 link = http://www.test.com/page.html

 Content of link: <h3>Te开发者_开发知识库xt here</h3>

What would be an elegant way to first get the content/sourcecode of page.html and then exctract the link? Thanks!


I'd recommend Beatiful Soup. That's a nice parser for botched HTML pages (for the most cases you don't have to worry about the page not being well-formed).


import urllib2
url="http://www.test.com/page.html"
page=urllib2.urlopen(url)
data=page.read()
for item in data.split("</h3>"):
    if "<h3>" in item:
         print item.split("<h3>")[1]


You can use URLLib2 to retrieve the content of the URL:

http://docs.python.org/library/urllib2.html

You could then use the HTML parser in the Python libraries to find the right content:

http://docs.python.org/library/htmlparser.html


Provided the text you want is the only <h3>-wrapped text on the page, try:

from urllib2 import urlopen
from re import search
text = search(r'(?<=<h3>).+?(?=</h3>)', urlopen(link).read()).group(0)

If there are multiple <h3>-wrapped strings you can either put more details into the pattern or use re.finditer()/re.findall()

0

精彩评论

暂无评论...
验证码 换一张
取 消