Theres a few dozen sqlite files i need to process and they are taking a few minutes each. Is there a way to copy or load the db into memo开发者_运维知识库ry? IO (specifically reads as no writes are being code) is the bottleneck taking up 70% of the time.
Is there a short/quick solution i can use? Note: It will finish in <40minutes so if it isnt a quick solution it may not be worth the bother.
Ok, this is a "way out there" idea, and with 40 min overhead may not be worth a shot.
This doc may be of help.Basically, you copy an on-disk DB to a memory one, similar to a Python example here, then dump it back to disk. Instead of many small writes, you'll be doing a couple large ones.
Again, some testing will be needed to check your specific situation and whether it will help.
精彩评论