Virtual Table - How to prevent Out of Memory with huge XML files?
Posted: Tue 26 Jun 2007 20:26
How do i prevent an out of memory error when loading (a rather large) XML file?
Devart Forums
Discussion forums for open issues and questions concerning database tools, data access components and developer tools from Devart
https://forums.devart.com/
Virtual Table - How to prevent Out of Memory with huge XML files?
Page 1 of 1
Posted: Wed 27 Jun 2007 07:58
Please specify what is the size of the file you try to load, and how much memory do you have.
Posted: Wed 27 Jun 2007 12:17
1Gb RAM, 300 Gb disk space free on C (swap drive), 369 Mb XML data file ...
I know it's large, I was wondering if some kind of "paging" would be possible ...
I know it's large, I was wondering if some kind of "paging" would be possible ...
Posted: Wed 27 Jun 2007 16:22
No, the LoadFromFile method does not support paging mode, and we do not plan to implement it in the near future, but we will investigate possibility to optimize memory usage when loading data from xml files.
Posted: Thu 28 Jun 2007 01:22
OK sounds good.
I suspect the file to be growing in the future even more.
Would it be an idea to add something like a LIMIT?
For example 0,1000 for the first 1000 etc (like SQL LIMIT)?
Oh wait, I guess that would be close to paging then
I suspect the file to be growing in the future even more.
Would it be an idea to add something like a LIMIT?
For example 0,1000 for the first 1000 etc (like SQL LIMIT)?
Oh wait, I guess that would be close to paging then
Posted: Mon 02 Jul 2007 07:03
Thank you for suggestion. We will consider possibilty to add this feature in one of the nearest builds.