Models training fails

[Mohamad Mazaz]

Hi guys,

I get this error after creating the model :

-------------------------

{

  "insertId": "******",

  "jsonPayload": {

    "serviceContext": {

      "service": "recommendationengine.googleapis.com"

    },

    "message": "INSUFFICIENT_TRAINING_DATA Recommendation model recommende_recommende_1613478291864 cannot be trained because of insufficient data.",

    "status": {

      "code": 9,

      "message": "Recommendation model recommende_recommende_1613478291864 cannot be trained because of insufficient data.",

      "@type": "type.googleapis.com/google.rpc.Status"

    },

    "@type": "type.googleapis.com/google.cloud.retail.logging.ErrorLog",

    "context": {

      "reportLocation": {

        "functionName": "google.cloud.recommendationengine.v1alpha.RecommendationModelService.CreateRecommendationModel"

      }

    }

  },

  "resource": {

    "type": "consumed_api",

    "labels": {

      "version": "",

      "service": "recommendationengine.googleapis.com",

      "location": "global",

      "credential_id": "",

      "method": "google.cloud.recommendationengine.v1alpha.RecommendationModelService.CreateRecommendationModel",

      "project_id": "*****"

    }

  },

  "timestamp": "2021-02-16T12:34:52.869035308Z",

  "severity": "ERROR",

  "logName": "projects/****/logs/recommendations-api-log",

  "receiveTimestamp": "2021-02-16T12:34:53.870909132Z"

}
-------------------------

For the data requirements I got this before creating the model ( a screenshot):

 

However, when I tried to create the model I got an error that at least you need 100 catalog item. So I added more products from my store( around 1000 ) then I was able to create the model. it started tuning and training. after half an hour I get the error that I posted above.

I am attaching a screenshot from the models UI too :

As you can see I get "Error" in date state column for both models Recommended for you and Others you may like.

I'm not sure what part of data is insufficient ?

Here is a screenshot of data ingestion for the user events:

I got stuck now and not sure what to do. could you please help out with that?

Thanks.
Best regards,
Mohamad

[Patrick Hess]

Hi Mohammad,

Does your data have more than 100 unique visitor ids? We don't have this stat explicitly computed but we check it when training.

Sometimes we noticed our customer set all visitors to the same id.

Cheers,

Patrick

--
You received this message because you are subscribed to the Google Groups "cloud-recommendations-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cloud-recommendatio...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/cloud-recommendations-users/797565e9-c5be-4cff-8d1e-4bc0dae81b77n%40googlegroups.com.

[Mohamad Mazaz]

Hi Patrick,

Thanks for your prompt reply.

The data has less than 100 unique visitor ids as it wasn't explicitly mentioned anywhere in the docs. I was reading at this link:

https://cloud.google.com/retail/recommendations-ai/docs/create-models?&_ga=2.155166328.-1964508007.1602578054#import-reqs 

Here is a screenshot:

I will upload more data to meet this requirement. Just a suggestion if the error message could be more specific it would be great.

Regards,

Mohamad

[Patrick Hess]

Mohammed,

Thanks for the feedback! Yeah agreed, we are working on making the 100 visitors an explicit data point. For now will just add to documentation.

Cheers,

Patrick

To view this discussion on the web visit https://groups.google.com/d/msgid/cloud-recommendations-users/c9601bef-6c54-44a3-80aa-291382e8c845n%40googlegroups.com.

[Mohamad Mazaz]

Hi Patrick,

No problem :) .

I've added user events for more than 100 visitors but I still get the same error. Do you think I'm missing something else?

Thanks.

Regards,

Mohamad

[Patrick Hess]

Hi Mohamad,

I think if the visitors were artificially added it might not work - what we need is a bunch of visitors with realistic sequences of events that we can construct training data from.

Also make sure these visitors are in the type that you need for model (e.g. if CTR model - it has to be in detail page views, if CVR in detail page views and add to cart etc)

Generally, achieving model training with synthetic data is tricky.

Cheers,
Patrick

To view this discussion on the web visit https://groups.google.com/d/msgid/cloud-recommendations-users/dd927922-bf9e-4a37-8130-b02c67e33ee2n%40googlegroups.com.