SQL Server 2008 to Sqlite3 via SSIS

Discussion of open issues, suggestions and bugs regarding ADO.NET provider for SQLite
Post Reply
dwango121
Posts: 3
Joined: Wed 14 Oct 2009 17:29

SQL Server 2008 to Sqlite3 via SSIS

Post by dwango121 » Wed 14 Oct 2009 17:36

Hello everyone,

I need to export 328,000 rows from a SQL Server 2008 table into Sqlite 3.

I am using SSIS along with the free dotConnect ADO.net driver to achieve this but performance is not very good at the mo.

Can anyone suggest any hints that might make performance better?

Thanks in advance,
Al

dwango121
Posts: 3
Joined: Wed 14 Oct 2009 17:29

Update

Post by dwango121 » Thu 15 Oct 2009 09:39

I have installed and setup msdtc and told SSIS to use transactions but cannot get this to work and the package keeps erroring with various ADO.net errors.

I have increased the SSIS buffer size to it's maximum and instead of transfering 4,000 records at a time it's now transferring 40,000 records but the package is still taking the same amount of time to process them.

From my results last night it's processing around 10,000 records a minute so it is taking around 35mins approx to transfer the full 328,000 rows.

Any help/advice on how to increase the performance of this would be greatfully recieved.

Thanks,
Al

AndreyR
Devart Team
Posts: 2919
Joined: Mon 07 Jul 2008 13:16

Post by AndreyR » Fri 16 Oct 2009 13:20

Thank you for the report, we are investigating the situation.
I will let you know about the results.

Post Reply