TOraLoader speed

Discussion of open issues, suggestions and bugs regarding ODAC (Oracle Data Access Components) for Delphi, C++Builder, Lazarus (and FPC)
Post Reply
jdredd
Posts: 42
Joined: Wed 25 Mar 2009 21:14

TOraLoader speed

Post by jdredd » Mon 15 Apr 2013 06:29

Using Delphi 7, ODAC 8.0.2 (will be getting new license soon for latest)
With Oracle 10g.

Trying to see if can get the speed even more. I have a file I am loading into memory.
1.22 million rows, 15 columns, ~160mb big and then sending it up.

Takes about 36 minutes to go through the tOraLoader and thinking this could be faster.
I am connecting to the server on the network.

I am using Direct Mode on the tOraSession.

The OraLoader is set to LoadMode = imDML

I am not sure exactly what imDML is vs imDirect, only thing I know is it won't
run in imDirect mode. The Help doesn't say much on this.

AlexP
Devart Team
Posts: 5530
Joined: Tue 10 Aug 2010 11:35

Re: TOraLoader speed

Post by AlexP » Wed 17 Apr 2013 12:25

Hello,

Data insertion speed depends on many factors, such as network speed, field types, presence of constraints and triggers in a table. You can try disabling all constraints before data insert, start transaction (rollback on error), and check the data insert speed once more. If this doesn't help, please send us the script for creating the table.

jdredd
Posts: 42
Joined: Wed 25 Mar 2009 21:14

Re: TOraLoader speed

Post by jdredd » Thu 18 Apr 2013 19:58

Greetings AlexP,

Network Speed shouldn't be to big of an issue but will look into it.
Table it self is pretty dumb, no triggers or anything.
Its 62 fields, mostly just small number and small varchar
1.5gb total of data, i think ~7 million rows, (most are null values)

Server side, we have multiple oracle servers that are pretty robust setups,
and more than me using them, but everyone else is linux based and possibly
on the direct server itself.

Now the disabling all constraints / tranasctions /rollback on error , part, not
sure what you mean on that? If that is something I toggle on the session/ora objects
or what.

AlexP
Devart Team
Posts: 5530
Joined: Tue 10 Aug 2010 11:35

Re: TOraLoader speed

Post by AlexP » Fri 19 Apr 2013 12:13

hello,

Besides triggers in tables, there are also Check constraints that can slow down insertion due to checks implemented in them as well; and indexes that also slow down data insertion. Try disabling them and check data insertion speed again using TOraLoader. Loading data in transactions will allow rollback all changes in case of an unpredictable error

Post Reply