Issue with Instant BQML Pipeline Execution – Table Matching Error

[Krithika Ramesh]

Dear Google Cloud Community,

I am experiencing an issue with the Instant BQML pipeline that I ran in the morning. The pipeline was connected to a new GCP project and its corresponding BigQuery dataset. In the morning, the pipeline executed successfully without any errors.

However, when I attempted to run the same pipeline in the afternoon, it failed with the following error:

Execution failed: WorkerException: genaipoc-396111:analytics_468436852.events_20* does not match any table

This error suggests that the referenced table does not exist or cannot be matched, even though the configuration and setup were unchanged between the two runs.

Could you please assist in identifying the root cause of this issue? Any guidance on resolving it would be greatly appreciated.

Regards,

Krithika R

[Instant BQML and Vertex Users]

Hi Krithika,

Thanks for reaching out about the issue you're facing with your Instant BQML pipeline. The error message "Execution failed: WorkerException: genaipoc-396111:analytics_468436852.events_20* does not match any table" indicates that the pipeline cannot find the expected table in your BigQuery dataset.

Here's a possible explanation and some troubleshooting steps:

Possible Cause:

Instant BQML can be configured to work with both the Daily and Streaming exports from GA4. If your BigQuery link is newly set up, it's possible that only the Streaming export table (events_intraday_) exists within the first 24 hours. The Daily export table (events_) might not be available yet, causing the pipeline to fail.

Troubleshooting Steps:

1. Verify Table Existence in BigQuery:

   • Go to your BigQuery dataset (analytics_468436852 in your case) in the genaipoc-396111 project.
   • Check if both events_ and events_intraday_ tables exist. If only events_intraday_ is present, the Daily export might still be processing.

2. Allow Time for Daily Export:

   • If the Daily export table is missing, allow up to 24 hours for the initial data to be processed and the table to be created.
   • Once the events_ table is available, try running your pipeline again.

3. Check Export Configuration:

   • Double-check your GA4 export configuration to ensure both Daily and Streaming exports are enabled for the linked BigQuery dataset (depending on your Instant BQML configuration).

If the issue persists after 24 hours or if you've confirmed that both tables exist, please provide the following information so we can investigate further:

• Screenshots: If possible, share screenshots of your GA4 export settings and the BigQuery dataset.

We'll do our best to help you resolve this issue and get your pipeline running smoothly.

[Shwetha Muthukumar]

Dear Google Cloud Community,

As you mentioned above , all these possibilities have been ruled out in our case. We are using the same project ID for "GA4 Bigquery Export" and "CRMint". I am facing this error while creating "Bigquery Links. Attaching the Screenshot below. How to resolve this issue.

--
You received this message because you are subscribed to the Google Groups "Instant BQML and Vertex Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to instant-bqml-verte...@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/instant-bqml-vertex-users/73bc214a-38c9-4902-a89c-8bd11c9e479fn%40googlegroups.com.

[Shwetha Muthukumar]

Hi, 

While I'm accessing the Bigquery Link Im facing the above error (attached screenshot) while when another person who has access to my GA4 accesses this same Bigquery Link it's not showing any error message. what is the reason behind this ?

Thanks 

Shwetha 

[Shwetha Muthukumar]

Also, my dataset is empty. I am not being exported with the events_20* or events_intraday_20* data. The dataset is empty and is providing the the error message
Execution failed: WorkerException: genaipoc-396111:analytics_468436852.events_20* does not match any table

[Instant BQML and Vertex Users]

Thanks for the additional information and screenshots.

Based on the screenshots, it appears that your GA4 BigQuery export is linked to project number 54258470539, which corresponds to project ID "ibqml-011524." This explains why the data isn't landing in the "genaipoc-396111" project, leading to the "table does not exist" error.

To resolve this, I recommend the following:

1. Verify BigQuery Export Link:

   • Double-check your GA4 property settings to confirm that the BigQuery export link is correctly pointing to the "ibqml-011524" project and the intended dataset within that project.

2. Update Instant BQML Configuration:

   • Refill the Instant BQML configuration form, ensuring that you use the correct project ID ("ibqml-011524") and dataset name where your GA4 data is being exported. This will align the pipeline with the actual location of your data.

Once you've updated the configuration, try running the pipeline again. It should now be able to locate the tables correctly in the "ibqml-011524" project.