Import data, batch size
Posted: Wed 02 Dec 2015 13:23
Hello.
We use DML arrays for import of data to Oracle DB. We limit array size to 2000 when calling ExecuteArray. No matter how many columns target table has nor what size of them it is. Just to avoid Out of Memory exception. We want to improve performance of our code. So constant 2000 should be replaced by some precalculated value. We can calculate/estimate table's row length. Then multiplied by row count we get "batch size". Can you advice some hint/recommendation? Which value or how to calculate ...
Another thing is Oracle "packet-size" which is then used for communication client to server. If such value exists we could use it to justify batch size to by multiple. Just to optimize communication. Is there such an value? Can be retrieved from OracleConnection?
Regards,
Petr.
We use DML arrays for import of data to Oracle DB. We limit array size to 2000 when calling ExecuteArray. No matter how many columns target table has nor what size of them it is. Just to avoid Out of Memory exception. We want to improve performance of our code. So constant 2000 should be replaced by some precalculated value. We can calculate/estimate table's row length. Then multiplied by row count we get "batch size". Can you advice some hint/recommendation? Which value or how to calculate ...
Another thing is Oracle "packet-size" which is then used for communication client to server. If such value exists we could use it to justify batch size to by multiple. Just to optimize communication. Is there such an value? Can be retrieved from OracleConnection?
Regards,
Petr.