I have a pretty long piece of XML that I want to parse. I want to remove everything except for the subclass-code and city. So that I am left with something like the example below.
EXAMPLE
TEST SUBCLASS|MIAMI
CODE
<?xml version="1.0" standalone="no"?>
<web-export>
<run-date>06/01/2010
<pub-code>TEST
<ad-type>TEST
<cat-code>Real Estate</cat-code>
<class-code>TEST</class-code>
<subclass-code>TEST SUBCLASS</subclass-code>
<placement-description></placement-description>
<position-description>Town House</position-description>
<subclass3-code></subclass3-code>
<subclass4-code></subclass4-code>
<ad-number>0000284708-01</ad-number>
<start-date>05/28/2010</start-date>
<end-date>06/09/2010</end-date>
<line-count>6</line-count>
<run-count>13</run-count>
<customer-type>Private Party</customer-type>
<account-number>100099237</account-number>
<account-name>DOE, JOHN</account-name>
<addr-1>207 CLARENCE STREET</addr-1>
<addr-2> </addr-2>
<city>MIAMI</city>
<state>FL</state>
<postal-code>02910</postal-code>
<country>USA</country>
<phone-number>4014612880</phone-number>
<fax-number></fax-number>
<url-addr> </url-addr>
<email-addr>noemail@ttest.com</email-addr>
<pay-flag>N</pay-flag>
<ad-description>DEANESTATES2BEDS2BATHSAPPLIANCED</ad-description>
<order-source>Import</order-source>
<order-status>Live</order-status>
<payor-acct>100099237</payor-acct>
<agency-flag>N</agency-flag>
<rate-note></rate-note>
<ad-content> MIAMI/Dean Estates: 2
beds, 2 baths. Applianced. Central air. Carpets. Laundry. 2 decks. Pool. Parking. Close to everything.No smoking. No utilities. $1275 mo. 401-578-1501. </ad-content>
</ad-type>
</pub-code>
</run-date>
</web-export>
PERL
So what I want to do is open an existing file read the contents then use regular expressions to eliminate the unnecessary XML tags.
open(READFILE, "FILENAME");
while(<READFILE>)
{
$_ =~ s/<\?xml version="(.*)" standalone="(.*)"\?>\n.*//g;
$_ =~ s/<subclass-code>//g;
$_ =~ s/<\/subclass-code>\n.*/|/g;
$_ =~ s/(.*)PJ RER Houses /PJ RER Houses/g;
$_ =~ s/\G //g;
$_ =~ s/<city>//g;
$_ =~ s/<\/city>\n.*//g;
$_ =~ s/<(\/?)web-export>(.*)\n.*//g;
$_ =~ s/<(\/?)run-date>(.*)\n.*//g;
$_ =~ s/<(\/?)pub-code>(.*)\n.*//g;
$_ =~ s/<(\/?)ad-type>(.*)\n.*//g;
$_ =~ s/<(\/?)cat-code>(.*)<(\/?)cat-code>\n.*//g;
$_ =~ s/<(\/?)class-code>(.*)<(\/?)class-code>\n.*//g;
$_ =~ s/<(\/?)placement-description>(.*)<(\/?)placement-description>\n.*//g;
$_ =~ s/<(\/?)position-description>(.*)<(\/?)position-description>\n.*//g;
$_ =~ s/<(\/?)subclass3-code>(.*)<(\/?)subclass3-code>\n.*//g;
$_ =~ s/<(\/?)subclass4-code>(.*)<(\/?)subclass4-code>\n.*//g;
$_ =~ s/<(\/?)ad-number>(.*)<(\/?)ad-number>\n.*//g;
$_ =~ s/<(\/?)start-date>(.*)<(\/?)start-date>\n.*//g;
$_ =~ s/<(\/?)end-date>(.*)<(\/?)end-date>\n.*//g;
$_ =~ s/<(\/?)line-count>(.*)<(\/?)line-count>\n.*//g;
$_ =~ s/<(\/?)run-count>(.*)<(\/?)run-count>\n.*//g;
$_ =~ s/<(\/?)customer-type>(.*)<(\/?)customer-type>\n.*//g;
$_ =~ s/<(\/?)account-number>(.*)<(\/?)account-number>\n.*//g;
$_ =~ s/<(\/?)account-name>(.*)<(\/?)account-name>\n.*//g;
$_ =~ s/<(\/?)addr-1>(.*)<(\/?)addr-1>\n.*//g;
$_ =~ s/<(\/?)addr-2>(.*)<(\/?)addr-2>\n.*//g;
$_ =~ s/<(\/?)state>(.*)<(\/?)state>\n.*//g;
$_ =~ s/<(\/?)postal-code>(.*)<(\/?)postal-code>\n.*//g;
$_ =~ s/<(\/?)country>(.*)<(\/?)country>\n.*//g;
$_ =~ s/<(\/?)phone-number>(.*)<(\/?)phone-number>\n.*//g;
$_ =~ s/<(\/?)fax-number>(.*)<(\/?)fax-number>\n.*//g;
$_ =~ s/<(\/?)url-addr>(.*)<(\/?)url-addr>\n.*//g;
$_ =~ s/<(\/?)email-addr>(.*)<(\/?)email-addr>\n.*//g;
$_ =~ s/<(\/?)pay-flag>(.*)<(\/?)pay-flag>\n.*//g;
$_ =~ s/<(\/?)ad-description>(.*)<(\/?)ad-description>\n.*//g;
$_ =~ s/<(\/?)order-source>(.*)<开发者_开发技巧;(\/?)order-source>\n.*//g;
$_ =~ s/<(\/?)order-status>(.*)<(\/?)order-status>\n.*//g;
$_ =~ s/<(\/?)payor-acct>(.*)<(\/?)payor-acct>\n.*//g;
$_ =~ s/<(\/?)agency-flag>(.*)<(\/?)agency-flag>\n.*//g;
$_ =~ s/<(\/?)rate-note>(.*)<(\/?)rate-note>\n.*//g;
$_ =~ s/<ad-content>(.*)\n.*//g;
$_ =~ s/\t(.*)\n.*//g;
$_ =~ s/<\/ad-content>(.*)\n.*//g;
}
close( READFILE1 );
Is there an easier way of doing this? I don't want to use any modules. I know that it might make this easier but the file I am reading has a lot of data in it.
This is horrible (sorry). Regular expressions are not necessarily faster even if you have a lot of data.
Why not use XSLT?
Your stylesheet would basically look like this (if you have only one subclass-code and city element):
<?xml version="1.0" encoding="UTF-8"?>
<xsl:stylesheet version="1.0" xmlns:xsl="http://www.w3.org/1999/XSL/Transform">
<xsl:output method="text" />
<xsl:template match="/">
<xsl:apply-templates select="//subclass-code|//city" />
</xsl:template>
<xsl:template match="subclass-code">
<xsl:value-of select="." /><xsl:text> | </xsl:text>
</xsl:template>
<xsl:template match="city">
<xsl:value-of select="." /><xsl:text> </xsl:text>
</xsl:template>
</xsl:stylesheet>
(Updated the code to work with multiple elements. Might not be the best solution ;))
Why wouldn't you use libraries if someone has already written efficient (and dare I say feature-rich) module like XML::Twig to parse XML?
use XML::Twig;
die "Usage: give-me-the-elements.pl <xml_file>\n" unless ($ARGV[0]);
my $twig = XML::Twig->new( twig_handlers =>
{ 'subclass-code' => sub { print->text, "|"; },
'city' => sub { print $_->text, "\n"; },
},
pretty_print => 'indented');
$twig->parsefile($ARGV[0]);
$twig->purge;
If you need a general XML parsing method, don't use regex. If you just need what you said (remove everything except for the subclass-code and city) and if you are sure that those two tags will appear with no "strange" things inside (xml entities, CDATA sections) and that those tags will not appear inside other CDATA fragments, etc, you can simply do:
$/ = undef; # slurp mode
open(READFILE, "FILENAME");
$t = <READFILE>;
close READFILE;
$t =~ s#^.*<subclass-code>(.*?)</subclass-code>.*<city>(.*?)</city>.*$#$1 - $2#s;
# in case the tags could appear in distinct order - uncomment the following
# $t =~ s#^.*<city>(.*?)</city>.*<subclass-code>(.*?)</subclass-code>.*$#$2 - $1#s;
print $t;
Edit: A little more (ahem) powerful, following poster's requirements:
while( $t =~ m#<pub-code>([^<\s]*).*?<subclass-code>(.*?)</subclass-code>.*?<city>(.*?)</city>#sg) {
print "$1 : $2 | $3 \n";
}
But please stop here and don't go further, this way leads to hell...
The easy way of doing this would be to use XML::Simple in conjunction with a dumper (I like XXX, most use Data::Dumper. This will load the XML into a perl data structure where you can cherry pick the attributes you want (or don't want if you prefer to just explicitly delete).
Using the toolset I just suggested you can see a running example of what you want:
use strict;
use warnings;
use XML::Simple;
my $data = XML::Simple::parse_fh( \*DATA );
my $sub = $data->{'run-date'}{'pub-code'}{'ad-type'};
foreach my $k ( keys %$sub ) {
delete $sub->{$k}
unless $k =~ /subclass-code|city/
;
}
use XXX;
XXX $data;
Pay attention to what the other posters said, it is highly recommended to stay away from regex when parsing markup languages.
However, a pure perl way of accomplishing what you want without any modules and assuming the aforementioned tags do exist is:
my $reg_subclass = '\<city\>';
my $reg_city = '\<subclass\d*\-code\>';
open my $in, "input file";
open my $out, '>' ,"output file";
while ( my $line = <$in> ) {
if ( $line =~ /$reg_subclass|$reg_city/ ) {
print $out $line;
}
}
close $in;
close $out;
I'm not an expert on what Perl supports, but generically, I think you want to use XPath here. (This might be what the Twig library above uses, I'm not sure).
Pseudo-Perl example (please excuse the crudeness; it's been a while since I really used Perl extensively):
$subclassExpr = "/web-export/subclass-code/text()";
$cityExpr = "/web-export/city/text()";
$domObject = xml_dom_parse( $xml_doc );
$subClass = xpath_evaluate( $domObject, $subclassExpr );
$subClass = xpath_evaluate( $domObject, $cityExpr );
![Interactive visualization of a graph in python [closed]](https://www.devze.com/res/2023/04-10/09/92d32fe8c0d22fb96bd6f6e8b7d1f457.gif)
加载中,请稍侯......
精彩评论