Problem Finetuning RESNET 101 in DeepLab-Context2-master/

72 views
Skip to first unread message

Daile Osorio

unread,
Sep 8, 2017, 3:48:44 PM9/8/17
to Caffe Users
Hi, I need help,
When I am doing finetune on RESNET 101 net by using the caffe DeepLab-Context2-master, I have the following problem

F0908 11:35:26.208102 12153 blob.cpp:163] Check failed: data_ 
*** Check failure stack trace: ***
    @     0x7ff439d265cd  google::LogMessage::Fail()
    @     0x7ff439d28433  google::LogMessage::SendToLog()
    @     0x7ff439d2615b  google::LogMessage::Flush()
    @     0x7ff439d28e1e  google::LogMessageFatal::~LogMessageFatal()
    @     0x7ff43a0ccb8b  caffe::Blob<>::mutable_cpu_data()
    @     0x7ff43a2080d7  caffe::BatchNormLayer<>::Forward_cpu()
    @     0x7ff43a29e003  caffe::Net<>::ForwardFromTo()
    @     0x7ff43a29e277  caffe::Net<>::ForwardPrefilled()
    @     0x7ff43a0e4d95  caffe::Solver<>::Step()
    @     0x7ff43a0e5809  caffe::Solver<>::Solve()
    @           0x40abbb  train()
    @           0x407010  main
    @     0x7ff438fb4830  __libc_start_main
    @           0x4076c9  _start
    @              (nil)  (unknown)
Aborted (core dumped)

I don't understand why this, The solver is correctly initialized and the net is correctly nitialized. You can see below the inicializations:

I0908 11:35:25.841939 12153 net.cpp:283] Network initialization done.
I0908 11:35:25.845626 12153 solver.cpp:60] Solver scaffolding done.
I0908 11:35:25.846796 12153 caffe.cpp:129] Finetuning from /home/dosorio/Proyectos/RESNET101/model/resnet101/DEEPLABV2-RESNET101_train_iter_20000.caffemodel
I0908 11:35:26.133589 12153 net.cpp:816] Ignoring source layer fc1_voc12_c0
I0908 11:35:26.133613 12153 net.cpp:816] Ignoring source layer fc1_voc12_c1
I0908 11:35:26.133617 12153 net.cpp:816] Ignoring source layer fc1_voc12_c2
I0908 11:35:26.133621 12153 net.cpp:816] Ignoring source layer fc1_voc12_c3
I0908 11:35:26.133625 12153 net.cpp:816] Ignoring source layer fc1_voc12
I0908 11:35:26.133631 12153 net.cpp:816] Ignoring source layer fc1_voc12_fc1_voc12_0_split
I0908 11:35:26.133638 12153 net.cpp:816] Ignoring source layer fc1_voc12_res05_c0
I0908 11:35:26.133653 12153 net.cpp:816] Ignoring source layer fc1_voc12_res05_c1
I0908 11:35:26.133673 12153 net.cpp:816] Ignoring source layer fc1_voc12_res05_c2
I0908 11:35:26.133677 12153 net.cpp:816] Ignoring source layer fc1_voc12_res05_c3
I0908 11:35:26.133682 12153 net.cpp:816] Ignoring source layer fc1_voc12_res05
I0908 11:35:26.133685 12153 net.cpp:816] Ignoring source layer fc1_voc12_res05_fc1_voc12_res05_0_split
I0908 11:35:26.133699 12153 net.cpp:816] Ignoring source layer fc1_voc12_res075_c0
I0908 11:35:26.133704 12153 net.cpp:816] Ignoring source layer fc1_voc12_res075_c1
I0908 11:35:26.133708 12153 net.cpp:816] Ignoring source layer fc1_voc12_res075_c2
I0908 11:35:26.133713 12153 net.cpp:816] Ignoring source layer fc1_voc12_res075_c3
I0908 11:35:26.133716 12153 net.cpp:816] Ignoring source layer fc1_voc12_res075
I0908 11:35:26.133725 12153 net.cpp:816] Ignoring source layer fc1_voc12_res05_interp
I0908 11:35:26.133730 12153 net.cpp:816] Ignoring source layer fc1_voc12_res075_interp
I0908 11:35:26.133733 12153 net.cpp:816] Ignoring source layer fc1_voc12_res075_interp_fc1_voc12_res075_interp_0_split
I0908 11:35:26.140349 12153 caffe.cpp:219] Starting Optimization
I0908 11:35:26.140362 12153 solver.cpp:280] Solving resnet101
I0908 11:35:26.140364 12153 solver.cpp:281] Learning Rate Policy: poly
F0908 11:35:26.208102 12153 blob.cpp:163] Check failed: data_ 
*** Check failure stack trace: ***
    @     0x7ff439d265cd  google::LogMessage::Fail()
    @     0x7ff439d28433  google::LogMessage::SendToLog()
    @     0x7ff439d2615b  google::LogMessage::Flush()
    @     0x7ff439d28e1e  google::LogMessageFatal::~LogMessageFatal()
    @     0x7ff43a0ccb8b  caffe::Blob<>::mutable_cpu_data()
    @     0x7ff43a2080d7  caffe::BatchNormLayer<>::Forward_cpu()
    @     0x7ff43a29e003  caffe::Net<>::ForwardFromTo()
    @     0x7ff43a29e277  caffe::Net<>::ForwardPrefilled()
    @     0x7ff43a0e4d95  caffe::Solver<>::Step()
    @     0x7ff43a0e5809  caffe::Solver<>::Solve()
    @           0x40abbb  train()
    @           0x407010  main
    @     0x7ff438fb4830  __libc_start_main
    @           0x4076c9  _start
    @              (nil)  (unknown)
Aborted (core dumped)


Someone can help me Please??

thank

RUI QIU

unread,
Nov 22, 2017, 6:48:49 AM11/22/17
to Caffe Users
I met the same error when finetuning Resnet, do you solve your problem?

I1122 19:32:53.774205  7789 caffe.cpp:220] Starting Optimization
I1122 19:32:53.774210  7789 solver.cpp:279] Solving
I1122 19:32:53.774212  7789 solver.cpp:280] Learning Rate Policy: step
F1122 19:32:53.795428  7789 blob.cpp:121] Check failed: data_
*** Check failure stack trace: ***
    @     0x7fc0f2c5bea4  (unknown)
    @     0x7fc0f2c5bdeb  (unknown)
    @     0x7fc0f2c5b7bf  (unknown)
    @     0x7fc0f2c5ea35  (unknown)
    @     0x7fc0f3411b8b  caffe::Blob<>::mutable_gpu_data()
    @     0x7fc0f345c7d4  caffe::BatchNormLayer<>::Forward_gpu()
    @     0x7fc0f32bb562  caffe::Net<>::ForwardFromTo()
    @     0x7fc0f32bb677  caffe::Net<>::Forward()
    @     0x7fc0f32d84da  caffe::Solver<>::Step()
    @     0x7fc0f32d91f9  caffe::Solver<>::Solve()
    @           0x4094de  train()
    @           0x405c77  main
    @     0x7fc0f1ee3a40  (unknown)
    @           0x406449  _start
    @              (nil)  (unknown)

Reply all
Reply to author
Forward
0 new messages