When you're iterating over hundreds of lines in a file, what is the most (and least) efficient way to run regular expressions in Python?
Specifically, is the following bad form?
for line in file:
data = re.search('(\d+\.\d+)\|(-\d+\.\d+)\|(.*?)\|(.*?)\|(\d+:\d+\s+\w+)\sTO\s(.*?)',line)
one = data.group(1)
two = data.group(2)
three = data.group(3)
fou开发者_如何学Gor = data.group(4)
five = data.group(5)
six = data.group(6)
# do the magic...
If you're just using this same regex over and over again, you don't need to compile it directly. http://docs.python.org/release/2.6.5/library/re.html#re.compile
The compiled versions of the most recent patterns passed to re.match(), re.search() or re.compile() are cached, so programs that use only a few regular expressions at a time needn’t worry about compiling regular expressions.
However, I would very much recommend not doing the assignments below that as you are. Try something like this:
for line in file:
data = re.search('(\d+\.\d+)\|(-\d+\.\d+)\|(.*?)\|(.*?)\|(\d+:\d+\s+\w+)\sTO\s(.*?)',line)
groups = data.groups()
# do the magic...
MatchObject.groups()
returns a tuple of all the groups in the match, with groups that don't participate in the match being assigned the value passed to groups()
(said value defaults to None
).
Save the regex before the loop.
rx = re.compile( '(\d+\.\d+)\|(-\d+\.\d+)\|(.*?)\|(.*?)\|(\d+:\d+\s+\w+)\sTO\s(.*?)' )
for line in file:
data = re.search(rx,line)
one = data.group(1)
two = data.group(2)
three = data.group(3)
four = data.group(4)
five = data.group(5)
six = data.group(6)
Unless the speed is an issue then you might want to just go with what you are comfortable reading, and which works.
精彩评论