Schema Comparison on 40,000 Tables

Discussion of open issues, suggestions and bugs regarding database management and administration tools for MySQL
Post Reply
bot403
Posts: 3
Joined: Sat 20 Apr 2019 19:17

Schema Comparison on 40,000 Tables

Post by bot403 » Sat 20 Apr 2019 19:21

I have a customer with 39,000 tables in his database and I need to use the comparison and synchronization feature. I am able to compare perfectly well, but it takes a few hours just to do the schema compare and a few hours more to do the data compare.

I can use mydumper on the database and dump it in several minutes so the DB server itself is not slow and since mydumper also enumerates the entire structure we know that the schema (and data) can be discovered and retrieved quickly. So it seems like its more a DBForge issue.

Is there any way to speed up the compare?

alexa

Re: Schema Comparison on 40,000 Tables

Post by alexa » Tue 23 Apr 2019 09:32

Could you please let us know if you are working with the remote server or local one?

Also, please specify what versions of the server and dbForge you are using?

bot403
Posts: 3
Joined: Sat 20 Apr 2019 19:17

Re: Schema Comparison on 40,000 Tables

Post by bot403 » Sat 27 Apr 2019 14:32

The 2 servers I am comparing are remote. Ping shows about 21ms to each DB server.

I am using dbForge Studio 2019 version 8.1.22 Professional.

"select version()" shows the servers are both running 5.7.22-0ubuntu0.16.04.1-log

bot403
Posts: 3
Joined: Sat 20 Apr 2019 19:17

Re: Schema Comparison on 40,000 Tables

Post by bot403 » Sat 08 Jun 2019 19:54

Bump - no ideas on why this takes hours and hours?

alexa

Re: Schema Comparison on 40,000 Tables

Post by alexa » Wed 19 Jun 2019 11:36

This can be caused by the following:
1. Remote access to the servers.
2. Quite a large database.
3. Quite many relations and large size of the tables.

Post Reply