Strange memory behavior during bulk insert process
-
- Posts: 5
- Joined: Sat 30 Sep 2006 14:46
Strange memory behavior during bulk insert process
Hi!
We've got your answer about bulk insert with transactions and it work very funny.
But there is a strange memory behavior during this insert. We have a trace output line before ExecuteArray(int BulkDeep) command exactly. So we can see that memory usage growing up VERY awfull in the moment of executing.
For example we have a 1Mb file consited of 4000 records. I want to put these 4000 records into database with one array. And in the moment of executing we have memory usage about 600-1100Mb.
How can you explain this behaviour and what should I do for escape from this fail.
Thanks!
We've got your answer about bulk insert with transactions and it work very funny.
But there is a strange memory behavior during this insert. We have a trace output line before ExecuteArray(int BulkDeep) command exactly. So we can see that memory usage growing up VERY awfull in the moment of executing.
For example we have a 1Mb file consited of 4000 records. I want to put these 4000 records into database with one array. And in the moment of executing we have memory usage about 600-1100Mb.
How can you explain this behaviour and what should I do for escape from this fail.
Thanks!
-
- Posts: 5
- Joined: Sat 30 Sep 2006 14:46
Ok, that's work and there was no memory peak at the moment of executing, we have stable line of memory usage at the Task Manager (near the 100Mb value) and there was no any memory leak.
But after about 1.5-2 hours of work we have an outOfMemoryException without any memory problem in fact.
Bulk array is about 4000 depth. Memory usage is stable about 500Mb (all processes combined) and the server has more than 4Gb of RAM
This problem disappeared after setting bulk array depth in 100 value (stable memory usage line near 30Mb), but it was detected at 500 bulk array depth (stable memory usage line near the 40 Mb value).
I see there was a similar problem with oraDirect here - http://crlab.com/forums/viewtopic.php?t ... utofmemory but there was no any public answer for this stuff.
Help us, please.
But after about 1.5-2 hours of work we have an outOfMemoryException without any memory problem in fact.
Bulk array is about 4000 depth. Memory usage is stable about 500Mb (all processes combined) and the server has more than 4Gb of RAM
This problem disappeared after setting bulk array depth in 100 value (stable memory usage line near 30Mb), but it was detected at 500 bulk array depth (stable memory usage line near the 40 Mb value).
I see there was a similar problem with oraDirect here - http://crlab.com/forums/viewtopic.php?t ... utofmemory but there was no any public answer for this stuff.
Help us, please.
-
- Posts: 5
- Joined: Sat 30 Sep 2006 14:46