Extracting MailChimp ListMemberTags takes a long time with no results

Discussion of issues, suggestions and bugs of Devart SSIS Data Flow Components, our product line for building SSIS-based ETL solutions, performing data access to popular cloud applications and databases.
Post Reply
KevinSeerup
Posts: 1
Joined: Thu 27 Feb 2020 00:17

Extracting MailChimp ListMemberTags takes a long time with no results

Post by KevinSeerup » Thu 27 Feb 2020 02:48

I have an SSIS Data Flow Task designed to read the MailChimp ListMemberTags table and write to a local SQL Server table. My Data Flow tasks doing the same with ListMembers and ListMergeFields run with no issue but this task stays with the wheel spinning (when I execute via Visual Studio) on the Source component and takes an hour or so and returns no records.

We have multiple Email Lists and each has Merge Fields defined which is where I am assuming the Members' Merge field data would be held.

What am I missing?

Shalex
Site Admin
Posts: 9129
Joined: Thu 14 Aug 2008 12:44

Re: Extracting MailChimp ListMemberTags takes a long time with no results

Post by Shalex » Fri 06 Mar 2020 20:26

KevinSeerup wrote:
Thu 27 Feb 2020 02:48
this task stays with the wheel spinning (when I execute via Visual Studio) on the Source component and takes an hour or so and returns no records
1. Did you manually stop the task execution? Or was it finished by Visual Studio?

2. Please open the Progress tab in the package designer after the task execution. Are there any errors or warnings? Specify them if any.

Shalex
Site Admin
Posts: 9129
Joined: Thu 14 Aug 2008 12:44

Re: Extracting MailChimp ListMemberTags takes a long time with no results

Post by Shalex » Fri 03 Apr 2020 19:59

https://mailchimp.com/developer/referen ... mber-tags/

Lists -> ListMembers -> ListMemberTags

Tags are read with a triple level of nesting, i.e. to read tags we read all Lists, then for each of them, we read its ListMembers and then for each ListMember we read its ListMemberTags. Therefore, a big number of Lists and ListMembers results in many API calls.

You can increase performance by specifying ListId and EmailHash (or only ListId) in the WHERE clause.

Post Reply