开发者

Handling large numbers of objects

开发者 https://www.devze.com 2023-03-20 16:21 出处:网络
We need to migrate some data to a new system and the only way to do it is to use the pr开发者_如何学编程ovided webservices. Can someone provide some advice on how to do this? Should i preload eg. 1000

We need to migrate some data to a new system and the only way to do it is to use the pr开发者_如何学编程ovided webservices. Can someone provide some advice on how to do this? Should i preload eg. 1000 objects in a list then clear it to avoid out of memory exception?


If the only thing you have got for the data migration is a web service; yes you will have to load them all and do necessary processing/migration (doing batch wise is better if your web service supports).


Divide the Migration Process in two 1)Export Load all your data in a XML File by defining a xml schema which will be suitable for your WebService input. 2)Import get the Data from the XML use your webservice based upon your requirement.


Can you call the Webservice for every single Object? Or is it neccessary to send all of them at once?
If you can send single Objects, you can send the Object to the Webservice and afterwards Dispose it.
The Problem with the real big XML are that the parsers can't read them to infinite. If you really have to send all Items at once please consider using XOP for the transport.

But I think the only soultion is a single processing of the objects (or a huge ammount of memory;-)

0

精彩评论

暂无评论...
验证码 换一张
取 消

关注公众号