Does PgSqlLoader time out?

Does PgSqlLoader time out?

Postby TonyV » Wed 25 Jul 2012 13:03

We've recently made some changes to our code that are intended to speed up our loading of data. It's a complicated process involving transmission of data over the wire using XMPP from our server software to the machine where Postgres is installed. This process was taking a minimum of 4.5 hours + to download 2.5 million rows of data, often taking longer. This is much too long. Also, the disk ended up being so busy that the machine was totally unusable while the download was happening.

We started using PgSqlLoader to make use of the COPY command and this has reduced the download time and disk activity on the machine. While disk activity is still somewhat high, the machine is now usable.

We've been seeing some timeout error occurring in our code during the download process. We've set the timeout value to 0 everywhere there was one, however, there is no time out setting in the PgSqlLoader class. I suspect that the timeout errors are coming from this class.

Is there any way that we can set a time out on the COPY operation?

Tony
TonyV
 
Posts: 74
Joined: Wed 25 May 2011 15:03

Re: Does PgSqlLoader time out?

Postby Shalex » Fri 27 Jul 2012 11:37

Please set the "Default Command Timeout=0;" connection string parameter to determine the CommandTimeout property of all PgSqlCommands that will be created on this connection (via PgSqlLoader as well): http://www.devart.com/dotconnect/postgresql/docs/?Devart.Data.PostgreSql~Devart.Data.PostgreSql.PgSqlConnection~ConnectionString.html. Notify us about the results.
Shalex
Devart Team
 
Posts: 7654
Joined: Thu 14 Aug 2008 12:44


Return to dotConnect for PostgreSQL