开发者

Importing a large amount of XML data into Google App Engine

开发者 https://www.devze.com 2023-02-12 12:45 出处:网络
I have a reasonably large amount of XML data (about 200MB) that I want to import into an App Engine datastore.

I have a reasonably large amount of XML data (about 200MB) that I want to import into an App Engine datastore.

So far I've tried creating the models and using the cElementTree parser to load the entities, but it is taking a long time.

I also have concerns about how well the datastore will handle this much data, and if there is a better way.

So my questions are, what is the fastest way of pa开发者_如何学JAVArsing XML into App Engine, and is there a better backend that will handle storing several hundred thousand entities / records.


I would go with the Bulk Loader that supports reading data from an XML source.
Regarding the size of the XML, Datastore will have no problem at all to handle such amount of data.

0

精彩评论

暂无评论...
验证码 换一张
取 消

关注公众号