JOB_ALREADY_STARTED error while invoking 'offlineUserDataJobs:run' API

[Rajesh Jangam]

Hello,

I have observed recently that a bunch of my offline user data jobs return a JOB_ALREADY_STARTED error as a response to the "offlineUserDataJobs:run" api.

Also, my code isn't even trying to 'add' any new operations.

I've double checked that there are no parallel or competing threads/processes which are trying to run the same job. So why would a job be already started?

I've shared some examples below. I'd appreciate any help on this issue.

Regards,

Rajesh

campaigns-reserved-od2501-c5a2xl-ri-172-31-208-45/1739914521-431f2225-d549-4c0b-9cc1-414c418c13b3.log:{"container_id":"077e7fc15107","host":"172.31.208.45","hostname":"campaigns-reserved-od2501-c5a2xl-ri-172-31-208-45","log_file":"syndication","log_level":"ERROR","message":"Syndications::AudienceSync: handle_distribute users failed for destination=de193846-3e6a-405b-b226-bf8f2ca164d1, error_code=400, error=Request contains an invalid argument., result_body=#<Hashie::Mash error=#<Hashie::Mash code=400 details=[#<Hashie::Mash @type=\"type.googleapis.com/google.ads.googleads.v17.errors.GoogleAdsFailure\" errors=[#<Hashie::Mash errorCode=#<Hashie::Mash offlineUserDataJobError=\"JOB_ALREADY_STARTED\"> message=\"Once the upload job is started, new operations cannot be added.\">] requestId=\"FMSkci1wFG8nC9EPZadXfA\">] message=\"Request contains an invalid argument.\" status=\"INVALID_ARGUMENT\">>","request_id":"53b62252-135a-4657-86f7-9fdcb67c6ec0","source_type":"fluent","tag":"campaign_execution/bsft_syndication_worker","timestamp":"2025-02-18T21:31:26.940Z"}

campaigns-reserved-od2501-c5a2xl-ri-172-31-218-90/1739913384-d7f5758c-f5ff-4e38-944f-98a80a305d3e.log:{"container_id":"328e2beaccc9","host":"172.31.218.90","hostname":"campaigns-reserved-od2501-c5a2xl-ri-172-31-218-90","log_file":"syndication","log_level":"ERROR","message":"Syndications::AudienceSync: handle_distribute users failed for destination=523a5059-0c2a-49b2-8575-8d69b393712d, error_code=400, error=Request contains an invalid argument., result_body=#<Hashie::Mash error=#<Hashie::Mash code=400 details=[#<Hashie::Mash @type=\"type.googleapis.com/google.ads.googleads.v17.errors.GoogleAdsFailure\" errors=[#<Hashie::Mash errorCode=#<Hashie::Mash offlineUserDataJobError=\"JOB_ALREADY_STARTED\"> message=\"Once the upload job is started, new operations cannot be added.\">] requestId=\"03lQLdFfh42pW_N9vwAPHA\">] message=\"Request contains an invalid argument.\" status=\"INVALID_ARGUMENT\">>","request_id":"63c1eabd-f909-4ea0-bd5f-8cd30bc811ae","source_type":"fluent","tag":"campaign_execution/bsft_syndication_aggregation_worker","timestamp":"2025-02-18T21:15:32.497Z"}

campaigns-reserved-od2501-c5a2xl-ri-172-31-218-90/1739913384-d7f5758c-f5ff-4e38-944f-98a80a305d3e.log:{"container_id":"328e2beaccc9","host":"172.31.218.90","hostname":"campaigns-reserved-od2501-c5a2xl-ri-172-31-218-90","log_file":"syndication","log_level":"ERROR","message":"Syndications::AudienceSync: handle_distribute users failed for destination=9eb854c6-09f8-4f1c-aba3-9257354c5019, error_code=400, error=Request contains an invalid argument., result_body=#<Hashie::Mash error=#<Hashie::Mash code=400 details=[#<Hashie::Mash @type=\"type.googleapis.com/google.ads.googleads.v17.errors.GoogleAdsFailure\" errors=[#<Hashie::Mash errorCode=#<Hashie::Mash offlineUserDataJobError=\"JOB_ALREADY_STARTED\"> message=\"Once the upload job is started, new operations cannot be added.\">] requestId=\"XzLhGW8TekIVWLrNm5IfKw\">] message=\"Request contains an invalid argument.\" status=\"INVALID_ARGUMENT\">>","request_id":"dcf7bf2e-b4ff-491d-9ac1-bd82e23fbee8","source_type":"fluent","tag":"campaign_execution/bsft_syndication_aggregation_worker","timestamp":"2025-02-18T21:15:32.650Z"}

campaigns-reserved-od2501-c5a2xl-ri-172-31-218-90/1739913384-d7f5758c-f5ff-4e38-944f-98a80a305d3e.log:{"container_id":"328e2beaccc9","host":"172.31.218.90","hostname":"campaigns-reserved-od2501-c5a2xl-ri-172-31-218-90","log_file":"syndication","log_level":"ERROR","message":"Syndications::AudienceSync: handle_distribute users failed for destination=779d833f-2862-4d27-a064-267479006dae, error_code=400, error=Request contains an invalid argument., result_body=#<Hashie::Mash error=#<Hashie::Mash code=400 details=[#<Hashie::Mash @type=\"type.googleapis.com/google.ads.googleads.v17.errors.GoogleAdsFailure\" errors=[#<Hashie::Mash errorCode=#<Hashie::Mash offlineUserDataJobError=\"JOB_ALREADY_STARTED\"> message=\"Once the upload job is started, new operations cannot be added.\">] requestId=\"hNg9PqwOddEA1dklhX-HzA\">] message=\"Request contains an invalid argument.\" status=\"INVALID_ARGUMENT\">>","request_id":"f457c7ef-f3c0-4d34-beb4-87e1599d526e","source_type":"fluent","tag":"campaign_execution/bsft_syndication_aggregation_worker","timestamp":"2025-02-18T21:15:32.694Z"}

campaigns-reserved-od2501-c5a2xl-ri-172-31-218-90/1739913384-d7f5758c-f5ff-4e38-944f-98a80a305d3e.log:{"container_id":"328e2beaccc9","host":"172.31.218.90","hostname":"campaigns-reserved-od2501-c5a2xl-ri-172-31-218-90","log_file":"syndication","log_level":"ERROR","message":"Syndications::AudienceSync: handle_distribute users failed for destination=54d69d8f-f1bf-42c9-abc1-7a67058059a7, error_code=400, error=Request contains an invalid argument., result_body=#<Hashie::Mash error=#<Hashie::Mash code=400 details=[#<Hashie::Mash @type=\"type.googleapis.com/google.ads.googleads.v17.errors.GoogleAdsFailure\" errors=[#<Hashie::Mash errorCode=#<Hashie::Mash offlineUserDataJobError=\"JOB_ALREADY_STARTED\"> message=\"Once the upload job is started, new operations cannot be added.\">] requestId=\"mK4FUSu-hCoq6a9Kl0DQjw\">] message=\"Request contains an invalid argument.\" status=\"INVALID_ARGUMENT\">>","request_id":"264dd96a-f859-4ad2-b45d-a6e9f5a0c56d","source_type":"fluent","tag":"campaign_execution/bsft_syndication_aggregation_worker","timestamp":"2025-02-18T21:15:32.808Z"}

campaigns-reserved-od2501-c5a2xl-ri-172-31-218-90/1739915185-bbecf6da-439f-4c62-9322-d85e7dd4a455.log:{"container_id":"328e2beaccc9","host":"172.31.218.90","hostname":"campaigns-reserved-od2501-c5a2xl-ri-172-31-218-90","log_file":"syndication","log_level":"ERROR","message":"Syndications::AudienceSync: handle_distribute users failed for destination=2f4aba00-b2c4-4ae2-a4e4-e1e72dbb5807, error_code=400, error=Request contains an invalid argument., result_body=#<Hashie::Mash error=#<Hashie::Mash code=400 details=[#<Hashie::Mash @type=\"type.googleapis.com/google.ads.googleads.v17.errors.GoogleAdsFailure\" errors=[#<Hashie::Mash errorCode=#<Hashie::Mash offlineUserDataJobError=\"JOB_ALREADY_STARTED\"> message=\"Once the upload job is started, new operations cannot be added.\">] requestId=\"OSPq7fsKdMTwpwABTKW8Qg\">] message=\"Request contains an invalid argument.\" status=\"INVALID_ARGUMENT\">>","request_id":"dcf7bf2e-b4ff-491d-9ac1-bd82e23fbee8","source_type":"fluent","tag":"campaign_execution/bsft_syndication_aggregation_worker","timestamp":"2025-02-18T21:45:40.616Z"}

campaigns-reserved-od2501-c5a2xl-ri-172-31-218-90/1739915185-bbecf6da-439f-4c62-9322-d85e7dd4a455.log:{"container_id":"328e2beaccc9","host":"172.31.218.90","hostname":"campaigns-reserved-od2501-c5a2xl-ri-172-31-218-90","log_file":"syndication","log_level":"ERROR","message":"Syndications::AudienceSync: handle_distribute users failed for destination=735ca80a-27d6-4530-b6ef-82dd60db0559, error_code=400, error=Request contains an invalid argument., result_body=#<Hashie::Mash error=#<Hashie::Mash code=400 details=[#<Hashie::Mash @type=\"type.googleapis.com/google.ads.googleads.v17.errors.GoogleAdsFailure\" errors=[#<Hashie::Mash errorCode=#<Hashie::Mash offlineUserDataJobError=\"JOB_ALREADY_STARTED\"> message=\"Once the upload job is started, new operations cannot be added.\">] requestId=\"9HlLZTP1R_h5glHnhlcjtA\">] message=\"Request contains an invalid argument.\" status=\"INVALID_ARGUMENT\">>","request_id":"79b6ff77-a1de-46aa-983b-70358eb0ba84","source_type":"fluent","tag":"campaign_execution/bsft_syndication_aggregation_worker","timestamp":"2025-02-18T21:45:40.775Z"}

campaigns-reserved-od2501-c5a2xl-ri-172-31-218-90/1739912182-35df79b4-45a1-477c-b47e-b26c3a132c6b.log:{"container_id":"328e2beaccc9","host":"172.31.218.90","hostname":"campaigns-reserved-od2501-c5a2xl-ri-172-31-218-90","log_file":"syndication","log_level":"ERROR","message":"Syndications::AudienceSync: handle_distribute users failed for destination=9f488eab-ebec-4d9c-a11b-f811f6753bdf, error_code=400, error=Request contains an invalid argument., result_body=#<Hashie::Mash error=#<Hashie::Mash code=400 details=[#<Hashie::Mash @type=\"type.googleapis.com/google.ads.googleads.v17.errors.GoogleAdsFailure\" errors=[#<Hashie::Mash errorCode=#<Hashie::Mash offlineUserDataJobError=\"JOB_ALREADY_STARTED\"> message=\"Once the upload job is started, new operations cannot be added.\">] requestId=\"iHVgkD81SIatA9YtNhYt-Q\">] message=\"Request contains an invalid argument.\" status=\"INVALID_ARGUMENT\">>","request_id":"95c24d22-2da7-4be4-9611-f156851ae190","source_type":"fluent","tag":"campaign_execution/bsft_syndication_aggregation_worker","timestamp":"2025-02-18T20:55:40.353Z"}

campaigns-reserved-od2501-c5a2xl-ri-172-31-218-90/1739911278-2a518a57-3f2a-451a-b4d8-7a18d863b4f4.log:{"container_id":"328e2beaccc9","host":"172.31.218.90","hostname":"campaigns-reserved-od2501-c5a2xl-ri-172-31-218-90","log_file":"syndication","log_level":"ERROR","message":"Syndications::AudienceSync: handle_distribute users failed for destination=56155761-7f22-4b68-80d2-18105d1043c6, error_code=400, error=Request contains an invalid argument., result_body=#<Hashie::Mash error=#<Hashie::Mash code=400 details=[#<Hashie::Mash @type=\"type.googleapis.com/google.ads.googleads.v17.errors.GoogleAdsFailure\" errors=[#<Hashie::Mash errorCode=#<Hashie::Mash offlineUserDataJobError=\"JOB_ALREADY_STARTED\"> message=\"Once the upload job is started, new operations cannot be added.\">] requestId=\"rcOn6ME1nAKKllEU1SlfLg\">] message=\"Request contains an invalid argument.\" status=\"INVALID_ARGUMENT\">>","request_id":"6ce33392-7615-4e6e-af05-6d4a244be080","source_type":"fluent","tag":"campaign_execution/bsft_syndication_aggregation_worker","timestamp":"2025-02-18T20:40:33.409Z"}

campaigns-reserved-od2501-c5a2xl-ri-172-31-218-90/1739911882-00aa10f3-3fa4-4d27-b9b7-7dda46c929fc.log:{"container_id":"328e2beaccc9","host":"172.31.218.90","hostname":"campaigns-reserved-od2501-c5a2xl-ri-172-31-218-90","log_file":"syndication","log_level":"ERROR","message":"Syndications::AudienceSync: handle_distribute users failed for destination=dd4c5e73-e5de-4018-8c84-c6a67777f55d, error_code=400, error=Request contains an invalid argument., result_body=#<Hashie::Mash error=#<Hashie::Mash code=400 details=[#<Hashie::Mash @type=\"type.googleapis.com/google.ads.googleads.v17.errors.GoogleAdsFailure\" errors=[#<Hashie::Mash errorCode=#<Hashie::Mash offlineUserDataJobError=\"JOB_ALREADY_STARTED\"> message=\"Once the upload job is started, new operations cannot be added.\">] requestId=\"25FHtbzgp_jUrPYkojzikw\">] message=\"Request contains an invalid argument.\" status=\"INVALID_ARGUMENT\">>","request_id":"95c24d22-2da7-4be4-9611-f156851ae190","source_type":"fluent","tag":"campaign_execution/bsft_syndication_aggregation_worker","timestamp":"2025-02-18T20:50:20.162Z"}

campaigns-reserved-od2501-c5a2xl-ri-172-31-218-90/1739911882-00aa10f3-3fa4-4d27-b9b7-7dda46c929fc.log:{"container_id":"328e2beaccc9","host":"172.31.218.90","hostname":"campaigns-reserved-od2501-c5a2xl-ri-172-31-218-90","log_file":"syndication","log_level":"ERROR","message":"Syndications::AudienceSync: handle_distribute users failed for destination=9644a544-22c4-4c18-9cee-fa135e901680, error_code=400, error=Request contains an invalid argument., result_body=#<Hashie::Mash error=#<Hashie::Mash code=400 details=[#<Hashie::Mash @type=\"type.googleapis.com/google.ads.googleads.v17.errors.GoogleAdsFailure\" errors=[#<Hashie::Mash errorCode=#<Hashie::Mash offlineUserDataJobError=\"JOB_ALREADY_STARTED\"> message=\"Once the upload job is started, new operations cannot be added.\">] requestId=\"EdGplhEq5MH6fCC7zpdgww\">] message=\"Request contains an invalid argument.\" status=\"INVALID_ARGUMENT\">>","request_id":"e96d2f78-66d4-4b47-9f43-7e7dbf8253e8","source_type":"fluent","tag":"campaign_execution/bsft_syndication_aggregation_worker","timestamp":"2025-02-18T20:50:20.269Z"}

campaigns-reserved-od2501-c5a2xl-ri-172-31-218-90/1739911882-00aa10f3-3fa4-4d27-b9b7-7dda46c929fc.log:{"container_id":"328e2beaccc9","host":"172.31.218.90","hostname":"campaigns-reserved-od2501-c5a2xl-ri-172-31-218-90","log_file":"syndication","log_level":"ERROR","message":"Syndications::AudienceSync: handle_distribute users failed for destination=c46aa02b-0b4d-4ce9-a68f-ba50abf72636, error_code=400, error=Request contains an invalid argument., result_body=#<Hashie::Mash error=#<Hashie::Mash code=400 details=[#<Hashie::Mash @type=\"type.googleapis.com/google.ads.googleads.v17.errors.GoogleAdsFailure\" errors=[#<Hashie::Mash errorCode=#<Hashie::Mash offlineUserDataJobError=\"JOB_ALREADY_STARTED\"> message=\"Once the upload job is started, new operations cannot be added.\">] requestId=\"lYDMFtkDy1zLykn0GA8BPQ\">] message=\"Request contains an invalid argument.\" status=\"INVALID_ARGUMENT\">>","request_id":"63c1eabd-f909-4ea0-bd5f-8cd30bc811ae","source_type":"fluent","tag":"campaign_execution/bsft_syndication_aggregation_worker","timestamp":"2025-02-18T20:50:20.640Z"}

campaigns-reserved-od2501-c5a2xl-ri-172-31-218-90/1739911882-00aa10f3-3fa4-4d27-b9b7-7dda46c929fc.log:{"container_id":"328e2beaccc9","host":"172.31.218.90","hostname":"campaigns-reserved-od2501-c5a2xl-ri-172-31-218-90","log_file":"syndication","log_level":"ERROR","message":"Syndications::AudienceSync: handle_distribute users failed for destination=cdb4f202-7036-44d5-9f69-924a2a280eef, error_code=400, error=Request contains an invalid argument., result_body=#<Hashie::Mash error=#<Hashie::Mash code=400 details=[#<Hashie::Mash @type=\"type.googleapis.com/google.ads.googleads.v17.errors.GoogleAdsFailure\" errors=[#<Hashie::Mash errorCode=#<Hashie::Mash offlineUserDataJobError=\"JOB_ALREADY_STARTED\"> message=\"Once the upload job is started, new operations cannot be added.\">] requestId=\"HkaLnj-Gx__oDtWrkz5V3w\">] message=\"Request contains an invalid argument.\" status=\"INVALID_ARGUMENT\">>","request_id":"dcf7bf2e-b4ff-491d-9ac1-bd82e23fbee8","source_type":"fluent","tag":"campaign_execution/bsft_syndication_aggregation_worker","timestamp":"2025-02-18T20:50:20.663Z"}

campaigns-reserved-od2501-c5a2xl-ri-172-31-218-90/1739911882-00aa10f3-3fa4-4d27-b9b7-7dda46c929fc.log:{"container_id":"328e2beaccc9","host":"172.31.218.90","hostname":"campaigns-reserved-od2501-c5a2xl-ri-172-31-218-90","log_file":"syndication","log_level":"ERROR","message":"Syndications::AudienceSync: handle_distribute users failed for destination=08f56f3e-c432-4901-a759-77d4d75f42d5, error_code=400, error=Request contains an invalid argument., result_body=#<Hashie::Mash error=#<Hashie::Mash code=400 details=[#<Hashie::Mash @type=\"type.googleapis.com/google.ads.googleads.v17.errors.GoogleAdsFailure\" errors=[#<Hashie::Mash errorCode=#<Hashie::Mash offlineUserDataJobError=\"JOB_ALREADY_STARTED\"> message=\"Once the upload job is started, new operations cannot be added.\">] requestId=\"hc_KwKHUb-VO3572ukTk8w\">] message=\"Request contains an invalid argument.\" status=\"INVALID_ARGUMENT\">>","request_id":"7e6e6999-9c69-4118-bbd8-10cb7509d443","source_type":"fluent","tag":"campaign_execution/bsft_syndication_aggregation_worker","timestamp":"2025-02-18T20:50:21.418Z"}

campaigns-reserved-od2501-c5a2xl-ri-172-31-218-90/1739911882-00aa10f3-3fa4-4d27-b9b7-7dda46c929fc.log:{"container_id":"328e2beaccc9","host":"172.31.218.90","hostname":"campaigns-reserved-od2501-c5a2xl-ri-172-31-218-90","log_file":"syndication","log_level":"ERROR","message":"Syndications::AudienceSync: handle_distribute users failed for destination=cceb5ce6-dc77-4432-b549-8ed1dc1f8ef0, error_code=400, error=Request contains an invalid argument., result_body=#<Hashie::Mash error=#<Hashie::Mash code=400 details=[#<Hashie::Mash @type=\"type.googleapis.com/google.ads.googleads.v17.errors.GoogleAdsFailure\" errors=[#<Hashie::Mash errorCode=#<Hashie::Mash offlineUserDataJobError=\"JOB_ALREADY_STARTED\"> message=\"Once the upload job is started, new operations cannot be added.\">] requestId=\"Dp8ocxBvEgF13qQFF7ZBtw\">] message=\"Request contains an invalid argument.\" status=\"INVALID_ARGUMENT\">>","request_id":"79b6ff77-a1de-46aa-983b-70358eb0ba84","source_type":"fluent","tag":"campaign_execution/bsft_syndication_aggregation_worker","timestamp":"2025-02-18T20:50:41.832Z"}

[Google Ads API and AdWords API Forum]

Hi,

Thank you for reaching out to the Google Ads API support team.

From the provided information, I understand that you are getting JOB_ALREADY_STARTED error. I would recommend that you fetch the offline_user_data_job.status using offline_user_data_job resource to know the status of the job.

Hope this helps. If you have any more queries, please feel free to get back to us.

Thanks,



{{{Case.RecordType}}} Team
Feedback
How was our support today?

               
[{{{Sender.CurrentUserTime__c}}}] This message is in relation to case "{{{Case.Thread_Id}}}" (ADR-{{{Case.CaseNumber}}})

​​​​​​​

[Rajesh Jangam]

Thanks for your reply. We shall add that check.

But wanted to check if there is a possibility that the job may automatically getting triggered by the Google Ads system internally without an explicit `run` API call triggered externally.

Regards,

Rajesh

[Google Ads API and AdWords API Forum]

Hi,

I would like to inform you that the Google Ads API doesn't have the functionality that automatically triggers an API call. Please note that someone from your website/application needs to make or trigger an API call to send new and updated data to your Google Ads account.