How to Upload millions of customer data without getting into exceptions?

[Paid Media]

Hi

We have a requirement to upload more than 100 million customers to the audience/segment. Each customer can have up to 10 PII fields (3 Phone numbers, 3 Emails, 3 Device Ids, addresses). We are trying to use asynchronous way via AddOfflineUserDataJobOperationsRequest API for this purpose.

It doc https://developers.google.com/google-ads/api/docs/remarketing/audience-types/customer-match#customer_match_considerations it is mentioned that we can submit up to 1 Lakh user identifier in one API call. That means in one API call I will be able to upload only 10K customers because each customer is having 10 user identifiers. So to upload 100 million customers, I need to make 10K API calls and then poll for the status of 10K API calls. Polling for 10K API calls is overhead here.

But as these asynchronous API calls are trying to upload customers to the same audience, it's highly likely that I will get into the CONCURRENT_MODIFICATION exception.

Therefore could you please suggest a better way to upload more than 100 million customer data without getting into such errors and avoiding overhead?

[Google Ads API Forum Advisor]

Hi,

Thank you for posting your concern.

Please note that there is an update for the customer list in Google Ads API that the maximum number of user_identifers set in a UserData object will be reduced from 100,000 to 20 and this update will be applied to OfflineUserDataJobService.AddOfflineUserDataOperations and
UserDataService.UploadUserDataRequest as according to this blog.

With this, allow me to raise your concern to the team on how you can upload 100 million customers to the audience/segment with the current update. We will revert back to you with any updates about this.

Regards,

Ernie John Blanca Tacata Google Ads API Team

ref:_00D1U1174p._5004Q2VQUUg:ref

[Ngon Nguyen]

Vào 8:01, Th 2, 31 thg 1, 2022 'Google Ads API Forum Advisor' via Google Ads API and AdWords API Forum <adwor...@googlegroups.com> đã viết:

--
--
=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~
Also find us on our blog:
https://googleadsdeveloper.blogspot.com/
=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~
 
You received this message because you are subscribed to the Google
Groups "AdWords API and Google Ads API Forum" group.
To post to this group, send email to adwor...@googlegroups.com
To unsubscribe from this group, send email to
adwords-api...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/adwords-api?hl=en
---
You received this message because you are subscribed to the Google Groups "Google Ads API and AdWords API Forum" group.
To unsubscribe from this group and stop receiving emails from it, send an email to adwords-api...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/adwords-api/VxdL0000000000000000000000000000000000000000000000R6JUT300hYtKoflrQWKJhNkp4njAug%40sfdc.net.

[Google Ads API Forum Advisor]

Hi,

Based on the feedback received from our team, you are still allowed to upload up to 100,000 operations per request; it's just that a given operation needs to represent a single individual. As for uploading at that scale, all we can say is it's going to take a while to get through, at up to 100,000 per request until they get to their 100 million total.

I hope this helps.

Best regards,

Peter Laurence Napa Oliquino Google Ads API Team

ref:_00D1U1174p._5004Q2VQUUg:ref