i have questions about the AutoML Table model architecture logs
32 views
Skip to first unread message
민태홍
Feb 19, 2022, 2:10:12 PM2/19/22
to cloud-nl-discuss
hi this is tae hong Min
i have 2 questions about the AutoML table model architecture log
what is the mean about "Skip connections type"?
i have 2 questions about the AutoML table model architecture log
what is the mean about "Skip connections type"?
is this for the "Cross layer"? or something else??
could you explain about this??
and second question.
could you explain about this??
and second question.
my model consists of 25 ensemble models.
my guess is that my model needs an output layer that receives the outputs of other models (ensemble models).
but i don't find this information in the architecture logs
this is the architecture logs
{
insertId: "qng63yfp56h6k"
jsonPayload: {
modelParameters: [
0: {
hyperparameters: {
Dropout rate: 0.625
Embedding numerical embedding: "True"
Enable L1: "False"
Enable L2: "False"
Enable batchNorm: "True"
Enable embedding L1: "False"
Enable embedding L2: "False"
Enable layerNorm: "False"
Hidden layer size: 64
Model type: "nn"
Normalize numerical column: "True"
Number of cross layers: "3"
Number of hidden layers: "4"
Skip connections type: "concat"
}
}
1: {
hyperparameters: {
Dropout rate: 0.375
Embedding numerical embedding: "True"
Enable L1: "False"
Enable L2: "False"
Enable batchNorm: "False"
Enable embedding L1: "False"
Enable embedding L2: "False"
Enable layerNorm: "False"
Hidden layer size: 16
Model type: "nn"
Normalize numerical column: "True"
Number of cross layers: "1"
Number of hidden layers: "3"
Skip connections type: "concat"
}
}
2: {
hyperparameters: {
Dropout rate: 0.625
Embedding numerical embedding: "True"
Enable L1: "False"
Enable L2: "False"
Enable batchNorm: "True"
Enable embedding L1: "False"
Enable embedding L2: "False"
Enable layerNorm: "False"
Hidden layer size: 64
Model type: "nn"
Normalize numerical column: "True"
Number of cross layers: "3"
Number of hidden layers: "4"
Skip connections type: "concat"
}
}
3: {
hyperparameters: {
Dropout rate: 0.625
Embedding numerical embedding: "True"
Enable L1: "False"
Enable L2: "False"
Enable batchNorm: "True"
Enable embedding L1: "False"
Enable embedding L2: "False"
Enable layerNorm: "False"
Hidden layer size: 256
Model type: "nn"
Normalize numerical column: "True"
Number of cross layers: "4"
Number of hidden layers: "4"
Skip connections type: "concat"
}
}
4: {
hyperparameters: {
Dropout rate: 0.375
Embedding numerical embedding: "True"
Enable L1: "False"
Enable L2: "False"
Enable batchNorm: "False"
Enable embedding L1: "False"
Enable embedding L2: "False"
Enable layerNorm: "False"
Hidden layer size: 16
Model type: "nn"
Normalize numerical column: "True"
Number of cross layers: "1"
Number of hidden layers: "3"
Skip connections type: "concat"
}
}
5: {
hyperparameters: {
Dropout rate: 0.625
Embedding numerical embedding: "True"
Enable L1: "False"
Enable L2: "False"
Enable batchNorm: "True"
Enable embedding L1: "False"
Enable embedding L2: "False"
Enable layerNorm: "False"
Hidden layer size: 256
Model type: "nn"
Normalize numerical column: "True"
Number of cross layers: "4"
Number of hidden layers: "4"
Skip connections type: "concat"
}
}
6: {
hyperparameters: {
Dropout rate: 0.625
Embedding numerical embedding: "True"
Enable L1: "False"
Enable L2: "False"
Enable batchNorm: "True"
Enable embedding L1: "False"
Enable embedding L2: "False"
Enable layerNorm: "False"
Hidden layer size: 64
Model type: "nn"
Normalize numerical column: "True"
Number of cross layers: "3"
Number of hidden layers: "4"
Skip connections type: "concat"
}
}
7: {
hyperparameters: {
Dropout rate: 0.625
Embedding numerical embedding: "True"
Enable L1: "False"
Enable L2: "False"
Enable batchNorm: "True"
Enable embedding L1: "False"
Enable embedding L2: "False"
Enable layerNorm: "False"
Hidden layer size: 64
Model type: "nn"
Normalize numerical column: "True"
Number of cross layers: "3"
Number of hidden layers: "4"
Skip connections type: "concat"
}
}
8: {
hyperparameters: {
Dropout rate: 0.625
Embedding numerical embedding: "True"
Enable L1: "False"
Enable L2: "False"
Enable batchNorm: "True"
Enable embedding L1: "False"
Enable embedding L2: "False"
Enable layerNorm: "False"
Hidden layer size: 256
Model type: "nn"
Normalize numerical column: "True"
Number of cross layers: "4"
Number of hidden layers: "4"
Skip connections type: "concat"
}
}
9: {
hyperparameters: {
Dropout rate: 0.75
Embedding numerical embedding: "True"
Enable L1: "False"
Enable L2: "False"
Enable batchNorm: "False"
Enable embedding L1: "False"
Enable embedding L2: "False"
Enable layerNorm: "False"
Hidden layer size: 1024
Model type: "nn"
Normalize numerical column: "True"
Number of cross layers: "3"
Number of hidden layers: "2"
Skip connections type: "concat"
}
}
10: {
hyperparameters: {
Dropout rate: 0.75
Embedding numerical embedding: "True"
Enable L1: "False"
Enable L2: "False"
Enable batchNorm: "False"
Enable embedding L1: "False"
Enable embedding L2: "False"
Enable layerNorm: "False"
Hidden layer size: 1024
Model type: "nn"
Normalize numerical column: "True"
Number of cross layers: "3"
Number of hidden layers: "2"
Skip connections type: "concat"
}
}
11: {
hyperparameters: {
Dropout rate: 0.125
Embedding numerical embedding: "True"
Enable L1: "False"
Enable L2: "False"
Enable batchNorm: "True"
Enable embedding L1: "False"
Enable embedding L2: "False"
Enable layerNorm: "False"
Hidden layer size: 1024
Model type: "nn"
Normalize numerical column: "True"
Number of cross layers: "1"
Number of hidden layers: "1"
Skip connections type: "concat"
}
}
12: {
hyperparameters: {
Dropout rate: 0.125
Embedding numerical embedding: "True"
Enable L1: "False"
Enable L2: "False"
Enable batchNorm: "True"
Enable embedding L1: "False"
Enable embedding L2: "False"
Enable layerNorm: "False"
Hidden layer size: 1024
Model type: "nn"
Normalize numerical column: "True"
Number of cross layers: "1"
Number of hidden layers: "1"
Skip connections type: "concat"
}
}
13: {
hyperparameters: {
Dropout rate: 0.75
Embedding numerical embedding: "True"
Enable L1: "False"
Enable L2: "False"
Enable batchNorm: "False"
Enable embedding L1: "False"
Enable embedding L2: "False"
Enable layerNorm: "False"
Hidden layer size: 1024
Model type: "nn"
Normalize numerical column: "True"
Number of cross layers: "3"
Number of hidden layers: "2"
Skip connections type: "concat"
}
}
14: {
hyperparameters: {
Dropout rate: 0.375
Embedding numerical embedding: "True"
Enable L1: "False"
Enable L2: "False"
Enable batchNorm: "False"
Enable embedding L1: "False"
Enable embedding L2: "False"
Enable layerNorm: "False"
Hidden layer size: 16
Model type: "nn"
Normalize numerical column: "True"
Number of cross layers: "1"
Number of hidden layers: "3"
Skip connections type: "concat"
}
}
15: {
hyperparameters: {
Dropout rate: 0.625
Embedding numerical embedding: "True"
Enable L1: "False"
Enable L2: "False"
Enable batchNorm: "True"
Enable embedding L1: "False"
Enable embedding L2: "False"
Enable layerNorm: "False"
Hidden layer size: 256
Model type: "nn"
Normalize numerical column: "True"
Number of cross layers: "4"
Number of hidden layers: "4"
Skip connections type: "concat"
}
}
16: {
hyperparameters: {
Dropout rate: 0.375
Embedding numerical embedding: "True"
Enable L1: "False"
Enable L2: "False"
Enable batchNorm: "False"
Enable embedding L1: "False"
Enable embedding L2: "False"
Enable layerNorm: "False"
Hidden layer size: 16
Model type: "nn"
Normalize numerical column: "True"
Number of cross layers: "1"
Number of hidden layers: "3"
Skip connections type: "concat"
}
}
17: {
hyperparameters: {
Dropout rate: 0.125
Embedding numerical embedding: "True"
Enable L1: "False"
Enable L2: "False"
Enable batchNorm: "True"
Enable embedding L1: "False"
Enable embedding L2: "False"
Enable layerNorm: "False"
Hidden layer size: 1024
Model type: "nn"
Normalize numerical column: "True"
Number of cross layers: "1"
Number of hidden layers: "1"
Skip connections type: "concat"
}
}
18: {
hyperparameters: {
Dropout rate: 0.375
Embedding numerical embedding: "True"
Enable L1: "False"
Enable L2: "False"
Enable batchNorm: "False"
Enable embedding L1: "False"
Enable embedding L2: "False"
Enable layerNorm: "False"
Hidden layer size: 16
Model type: "nn"
Normalize numerical column: "True"
Number of cross layers: "1"
Number of hidden layers: "3"
Skip connections type: "concat"
}
}
19: {
hyperparameters: {
Dropout rate: 0.75
Embedding numerical embedding: "True"
Enable L1: "False"
Enable L2: "False"
Enable batchNorm: "False"
Enable embedding L1: "False"
Enable embedding L2: "False"
Enable layerNorm: "False"
Hidden layer size: 1024
Model type: "nn"
Normalize numerical column: "True"
Number of cross layers: "3"
Number of hidden layers: "2"
Skip connections type: "concat"
}
}
20: {
hyperparameters: {
Dropout rate: 0.625
Embedding numerical embedding: "True"
Enable L1: "False"
Enable L2: "False"
Enable batchNorm: "True"
Enable embedding L1: "False"
Enable embedding L2: "False"
Enable layerNorm: "False"
Hidden layer size: 64
Model type: "nn"
Normalize numerical column: "True"
Number of cross layers: "3"
Number of hidden layers: "4"
Skip connections type: "concat"
}
}
21: {
hyperparameters: {
Dropout rate: 0.125
Embedding numerical embedding: "True"
Enable L1: "False"
Enable L2: "False"
Enable batchNorm: "True"
Enable embedding L1: "False"
Enable embedding L2: "False"
Enable layerNorm: "False"
Hidden layer size: 1024
Model type: "nn"
Normalize numerical column: "True"
Number of cross layers: "1"
Number of hidden layers: "1"
Skip connections type: "concat"
}
}
22: {
hyperparameters: {
Dropout rate: 0.625
Embedding numerical embedding: "True"
Enable L1: "False"
Enable L2: "False"
Enable batchNorm: "True"
Enable embedding L1: "False"
Enable embedding L2: "False"
Enable layerNorm: "False"
Hidden layer size: 256
Model type: "nn"
Normalize numerical column: "True"
Number of cross layers: "4"
Number of hidden layers: "4"
Skip connections type: "concat"
}
}
23: {
hyperparameters: {
Dropout rate: 0.75
Embedding numerical embedding: "True"
Enable L1: "False"
Enable L2: "False"
Enable batchNorm: "False"
Enable embedding L1: "False"
Enable embedding L2: "False"
Enable layerNorm: "False"
Hidden layer size: 1024
Model type: "nn"
Normalize numerical column: "True"
Number of cross layers: "3"
Number of hidden layers: "2"
Skip connections type: "concat"
}
}
24: {
hyperparameters: {
Dropout rate: 0.125
Embedding numerical embedding: "True"
Enable L1: "False"
Enable L2: "False"
Enable batchNorm: "True"
Enable embedding L1: "False"
Enable embedding L2: "False"
Enable layerNorm: "False"
Hidden layer size: 1024
Model type: "nn"
Normalize numerical column: "True"
Number of cross layers: "1"
Number of hidden layers: "1"
Skip connections type: "concat"
}
}
]
}
labels: {
log_type: "automl_tables"
}
logName: "projects/aicc-340200/logs/automl.googleapis.com%2Fmodel"
receiveTimestamp: "2022-02-09T11:19:20.225350966Z"
resource: {
labels: {
job_id: "TBL4720649819763245056"
project_id: "aicc-340200"
region: "us-central1"
}
type: "cloudml_job"
}
severity: "INFO"
timestamp: "2022-02-09T11:19:20.225350966Z"
}
thank you
Mohammad I (Cloud Platform Support)
Feb 21, 2022, 6:03:43 PM2/21/22
to cloud-nl-discuss
This document has indicated that the hyperparameter data provided in the logs differ for each type of model. Skip connections type (dense, disable, concat, or slice_or_padding) seems to be part of Feedforward neural network models.
Please note that Google Groups forum is meant for general discussion of the platform, not specific technical issues. You can find more info about Community Support Overview on Google Groups here.
In case If you have any technical queries or think your issue is related to code, you can post at the Stack Overflow or Server Fault and a community of developers will assist you.
In case there are any technical issues or you would like to request any feature regarding Google Cloud Platform you can report it at the Public Issues by selecting the right component here. If you need to select any project specific information please select the private component of the Public Issue so that the information is not visible to the public. After that a Google Cloud Platform support agent would assist you.
Reply all
Reply to author
Forward
0 new messages