Increase speed of upload customer match user list

[Tai Nguyen]

Hi guys,

Our company is building a system to allow user to upload their user list (customer match). 

We want to use python language for this task. Currently, we start with sample on Github (https://github.com/googleads/google-ads-python/blob/main/examples/remarketing/add_customer_match_user_list.py).

Here are what we know.

1. We can create 100,000 user in one request (AddOfflineUserDataJobOperationsRequest)

2. We can submit multiple request for one job (OfflineUserDataJob)

3. We cannot create 2 jobs with same user_list resource at same time(CONCURRENT_MODIFICATION may occur). Submitting sequentially is fine.

4. We cannot submit 2 request with same user_list resource at same time(CONCURRENT_MODIFICATION may occur). Submitting sequentially is fine.

5. Each time we run a job, mutate operations count increases 1 (with basic level, we have limit of 15,000 operations/day)

6. We only upload file (csv) in UI (according to other forum threads)

7. We have tested to submit request (with 100k user) sequentially (one by one) in an hour. The maximum number of request is sent is about 150. Thus, total user is submited in hour is about 15 milions.

Here are documents that we reference:

- https://developers.google.com/google-ads/api/docs/access-levels

- https://developers.google.com/google-ads/api/docs/best-practices/quotas

- https://developers.google.com/google-ads/api/docs/remarketing/audience-types/customer-match#customer_match_considerations

Now, we need to know:

1. We asumme to allow to submit up to 100,000,000 users per hour. In other words, the system should submit 1000 request/hours. Multiple thread is not a choice because of CONCURRENT_MODIFICATION error.

Increase from 150 to 1000 request per hours seems impossible job. Is there any way to speed up process of submit request?

2. Is there any limit of total number AddOfflineUserDataJobOperationsRequest of an OfflineUserDataJob?

3. Is there any limit of total of number of users per user list?

4. Are there any other rate limit (such as concurrent OfflineUserDataJob per account) should we care about?

Thank you for your support!

[Google Ads API Forum Advisor]

Hi Tai,

Thanks for reaching out. Please see my replies to your questions below:

1. We asumme to allow to submit up to 100,000,000 users per hour. In other words, the system should submit 1000 request/hours. Multiple thread is not a choice because of CONCURRENT_MODIFICATION error.
Increase from 150 to 1000 request per hours seems impossible job. Is there any way to speed up process of submit request?

• Queueing this many OfflineUserDataJob requests with 100,000 operations is not feasible. We currently do not have any advice/workarounds for speeding up this OfflineUserDataJobs

2. Is there any limit of total number AddOfflineUserDataJobOperationsRequest of an OfflineUserDataJob?

• There is a limit of 100,000 AddOfflineUserDataJobOperationsRequest per OfflineUserDataJob

3. Is there any limit of total of number of users per user list?

• As this limit is a general product limit, we recommend reaching out to the Help Center for this information.

4. Are there any other rate limit (such as concurrent OfflineUserDataJob per account) should we care about?

• Aside from general rate limits, if you are using the UserDataService for any jobs, it's worth noting that the UserDataService has a limit of 10 operations and 100 user IDs per request. Although it is part of the migration guide, this guide has more useful information on Customer Match.

Regards,
Matt
Google Ads API Team


Reminder: Share your feedback about the Google Ads (AdWords) API! Take the 2021 Google Ads API and AdWords API Annual Survey
 

Matt Google Ads API Team

ref:_00D1U1174p._5004Q2R9PlY:ref