iBQML - Infinite Loop

[Kadirhan Gözükoca]

Hi,

When I want to use pipelines that I have used twice in the past for one of our brands again, it takes much longer than expected to work and is never completed. This situation naturally reflects on the brand as a cost.

There is no customization in the pipelines we use, we use ibqml's ready-made purchase propensity and training pipelines.

In addition, we observed a problem as follows; under normal conditions, as the pipelines work, countless logs are written to the Logs tab, but currently there are no logs written. Can you support us?

Best Regards,

--

Kadirhan Gözükoca Data Analytics Executive Esentepe Mahallesi Kore Şehitleri Caddesi No: 19 Zincirlikuyu / İstanbul T. +90 212 705 5200 M. +90 5437670194 www.semtr.com

Bu e-posta ve ekleri gönderilen kişi veya kurum ile gönderildiği kişi veya kuruma ait özel, gizli veya yasak bilgiler içeriyor olabilir. İletinin yetkili muhatabı değilseniz e-posta içeriğinde yer alan gizli bilgileri ve kişisel verileri yetkisiz olarak elinizde bulundurmuş ve işlemiş kabul edileceğinizden iletiyi saklamayınız, kopyalamayınız, kullanmayınız veya iletmeyiniz. Lütfen iletiyi sistemlerinizden tamamen siliniz ve göndereni uyarınız. SEM bu iletinin ve iletinin içeriğinde yer alan bilgi ve kişisel verilerin doğruluğu, bütünlüğü, iletilmesi ve benzeri hususlar konusunda garanti vermemektedir. İleti içeriğinde yer alan kişisel verilerin yetkisiz kullanımı ve işlenmesi sonucu SEM'in her türlü zararı talep ve tazmin hakkı saklıdır.

[Instant BQML and Vertex Users]

Hi Kadirhan,

Thanks for reaching out about the issues you're experiencing with your Instant BQML pipelines. I'm sorry for the inconvenience this is causing.

To ensure you're running the latest version of CRMint on App Engine, please redeploy the app using the following command in Google Cloud Shell: bash <(curl -Ls https://raw.githubusercontent.com/instant-bqml/crmint/master/scripts/install.sh) master --bundle

Troubleshooting Steps:

1. Upgrade CRMint: After upgrading to the latest version, if your pipeline hangs for an extended period (BigQuery ML training jobs usually take less than 2 hours), you can reset the pipelines.

2. Reset Pipelines: Go to the "Settings" tab in CRMint and click the "Reset" button in the "Reset Pipelines" area. This will also show you if any jobs are currently running.

3. Retrigger Training: After resetting, you can restart the training process by clicking the "Run Pipeline" button.

4. Enable Scheduled Runs: Even better, enable the "Run on Schedule" toggle to ensure your model is retrained regularly (the default is 1 week).

Monitoring Progress:

• BigQuery Job History: You can monitor the training progress directly in BigQuery. Open the Job History, go to "Project History," and filter by Job ID "BQScriptExecutor." You should see a job with a green circle arrow indicating that it's in progress.
• Expected Training Time: Training should typically finish within 2 hours at most.

Let us know if you require additional support.

[Kadirhan Gözükoca]

Hi,

After receiving guidance from the product teams, we downloaded the latest version of the pipelines and uploaded them to the CRMint panel for use. However, in the Training step, the tool stops working and no error or success log is displayed.

Best Regards,

[Instant BQML and Vertex Users]

Hi Kadirhan,

Thanks for reaching out about the issue you're experiencing with your Instant BQML training pipeline.

It appears there's an error in the BigQuery machine learning training portion of the pipeline, indicated by the red X symbol next to the Purchase Propensity job. Since there aren't any logs available in the CRMint Logs tab, we can go directly to BigQuery to investigate the job history.

To help us troubleshoot this further, could you please follow these steps and share the error message you encounter:

1. Manually Start Training Pipeline: Initiate the Training Pipeline in CRMint.
2. Open BigQuery Job History: In BigQuery, navigate to the Job History section.
3. Go to Project History: Within Job History, select the "Project History" tab.
4. Identify Failed Job: Look for the job that failed, indicated by a red exclamation mark.
5. View Job in Editor: Click the three vertical dots in the Actions column next to the failed job and select "View Job in Editor."
6. Share Error Message: In the Query Results area of the job editor, you'll see the error message. Please copy and paste that error message into your reply to this email.

Once we have the error message, we can provide more specific guidance on how to resolve the issue.

Thanks for your cooperation!

[Kadirhan Gözükoca]

Hi Again,

We completed the steps you mentioned one by one. We received the error shown in the screenshot. However, there no problem with the location.

Additionally, when I try to run the query manually, I don't get any errors. I think we have a bug in CRMinit.

Best Regards,

Esentepe Mahallesi Kore Şehitleri Caddesi No: 19 Zincirlikuyu / İstanbul T. +90 212 705 5200 www.semtr.com

[Instant BQML and Vertex Users]

Hi there,

Thanks for sharing. We're escalating to engineering to investigate further.

[Instant BQML and Vertex Users]

Hi Kadirhan,

Our engineering team investigated the issue and determined that the "analytics_185899447" dataset is not currently located within your project.

Could you please confirm if the GA4 BigQuery export has been successfully completed and if the data is available in your BigQuery environment?

This would explain the dataset not found error.

[Kadirhan Gözükoca]

Hi,

Have you had a chance to look into the issue I mentioned in my previous email?

Best Regards,

Konaklar Mah. Selvili Sk. Sabancı Center Kule 2 No: 2 İç Kapi No: 17 Beşiktaş / İstanbul T. +90 212 705 5200 www.semtr.com

[Instant BQML and Vertex Users]

Hi Kadirhan,

Our engineering team investigated the issue and determined that the "analytics_185899447" dataset is not currently located within your project.

Could you please confirm if the GA4 BigQuery export has been successfully completed and if the data is available in your BigQuery environment?

This would explain the dataset not found error.

[Kadirhan Gözükoca]

Hi,

I am sure it is the right project. I have also run previous iBQML pipelines using the same dataset. I am sending the screenshots below.

Best Regards,

--
You received this message because you are subscribed to the Google Groups "Instant BQML and Vertex Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to instant-bqml-verte...@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/instant-bqml-vertex-users/ce21bb90-b44f-4f6d-951c-ad7fea6d4ea5n%40googlegroups.com.