make runtest: seg fault with no further information

148 views
Skip to first unread message

Loukas Bampis

unread,
Oct 17, 2017, 1:54:25 PM10/17/17
to Caffe Users
Hello 

### Issue summary

I have a problem with deploying the "make runtest" command. I have successfully (at least I think I have) installed the library but I am getting a seg fault during the running test command. Actually, the fault occurs right after the compilation of the last test executable, during the beginning of the first test (.build_release/tools/caffe). In addition, no other information is posted, so I cannot troubleshoot the error. Do you have any idea about the cause of this seg fault? Or anything that I can try in order to extract any other useful information? Here is the output of my installation procedure:

noah@mbp_ws:~ /code/caffe_original/caffe$ make clean
noah@mbp_ws
:~ /code/caffe_original/caffe$ make -j8


PROTOC src
/caffe/proto/caffe.proto
CXX src
/caffe/parallel.cpp
CXX src
/caffe/layer.cpp
CXX src
/caffe/net.cpp
CXX src
/caffe/solvers/nesterov_solver.cpp
CXX src
/caffe/solvers/rmsprop_solver.cpp
CXX src
/caffe/solvers/sgd_solver.cpp
CXX src
/caffe/solvers/adadelta_solver.cpp
CXX src
/caffe/solvers/adam_solver.cpp
CXX src
/caffe/solvers/adagrad_solver.cpp
CXX src
/caffe/data_transformer.cpp
CXX src
/caffe/util/upgrade_proto.cpp
CXX src
/caffe/util/benchmark.cpp
CXX src
/caffe/util/hdf5.cpp
CXX src
/caffe/util/cudnn.cpp
CXX src
/caffe/util/db.cpp
CXX src
/caffe/util/math_functions.cpp
CXX src
/caffe/util/blocking_queue.cpp
CXX src
/caffe/util/io.cpp
CXX src
/caffe/util/insert_splits.cpp
CXX src
/caffe/util/db_leveldb.cpp
CXX src
/caffe/util/im2col.cpp
CXX src
/caffe/util/signal_handler.cpp
CXX src
/caffe/util/db_lmdb.cpp
CXX src
/caffe/syncedmem.cpp
CXX src
/caffe/blob.cpp
CXX src
/caffe/common.cpp
CXX src
/caffe/internal_thread.cpp
CXX src
/caffe/layer_factory.cpp
CXX src
/caffe/solver.cpp
CXX src
/caffe/layers/cudnn_sigmoid_layer.cpp
CXX src
/caffe/layers/cudnn_relu_layer.cpp
CXX src
/caffe/layers/conv_layer.cpp
CXX src
/caffe/layers/reduction_layer.cpp
CXX src
/caffe/layers/lrn_layer.cpp
CXX src
/caffe/layers/prelu_layer.cpp
CXX src
/caffe/layers/threshold_layer.cpp
CXX src
/caffe/layers/mvn_layer.cpp
CXX src
/caffe/layers/cudnn_lrn_layer.cpp
CXX src
/caffe/layers/eltwise_layer.cpp
CXX src
/caffe/layers/silence_layer.cpp
CXX src
/caffe/layers/contrastive_loss_layer.cpp
CXX src
/caffe/layers/exp_layer.cpp
CXX src
/caffe/layers/multinomial_logistic_loss_layer.cpp
CXX src
/caffe/layers/hinge_loss_layer.cpp
CXX src
/caffe/layers/crop_layer.cpp
CXX src
/caffe/layers/elu_layer.cpp
CXX src
/caffe/layers/batch_norm_layer.cpp
CXX src
/caffe/layers/base_conv_layer.cpp
CXX src
/caffe/layers/sigmoid_cross_entropy_loss_layer.cpp
CXX src
/caffe/layers/hdf5_output_layer.cpp
CXX src
/caffe/layers/softmax_loss_layer.cpp
CXX src
/caffe/layers/cudnn_conv_layer.cpp
CXX src
/caffe/layers/hdf5_data_layer.cpp
CXX src
/caffe/layers/pooling_layer.cpp
CXX src
/caffe/layers/parameter_layer.cpp
CXX src
/caffe/layers/dropout_layer.cpp
CXX src
/caffe/layers/base_data_layer.cpp
CXX src
/caffe/layers/concat_layer.cpp
CXX src
/caffe/layers/im2col_layer.cpp
CXX src
/caffe/layers/data_layer.cpp
CXX src
/caffe/layers/reshape_layer.cpp
CXX src
/caffe/layers/slice_layer.cpp
CXX src
/caffe/layers/neuron_layer.cpp
CXX src
/caffe/layers/image_data_layer.cpp
CXX src
/caffe/layers/cudnn_lcn_layer.cpp
CXX src
/caffe/layers/memory_data_layer.cpp
CXX src
/caffe/layers/inner_product_layer.cpp
CXX src
/caffe/layers/bias_layer.cpp
CXX src
/caffe/layers/loss_layer.cpp
CXX src
/caffe/layers/recurrent_layer.cpp
CXX src
/caffe/layers/tanh_layer.cpp
CXX src
/caffe/layers/softmax_layer.cpp
CXX src
/caffe/layers/split_layer.cpp
CXX src
/caffe/layers/rnn_layer.cpp
CXX src
/caffe/layers/sigmoid_layer.cpp
CXX src
/caffe/layers/argmax_layer.cpp
CXX src
/caffe/layers/deconv_layer.cpp
CXX src
/caffe/layers/euclidean_loss_layer.cpp
CXX src
/caffe/layers/accuracy_layer.cpp
CXX src
/caffe/layers/spp_layer.cpp
CXX src
/caffe/layers/embed_layer.cpp
CXX src
/caffe/layers/scale_layer.cpp
CXX src
/caffe/layers/bnll_layer.cpp
CXX src
/caffe/layers/cudnn_pooling_layer.cpp
CXX src
/caffe/layers/infogain_loss_layer.cpp
CXX src
/caffe/layers/flatten_layer.cpp
CXX src
/caffe/layers/filter_layer.cpp
CXX src
/caffe/layers/absval_layer.cpp
CXX src
/caffe/layers/dummy_data_layer.cpp
CXX src
/caffe/layers/lstm_unit_layer.cpp
CXX src
/caffe/layers/log_layer.cpp
CXX src
/caffe/layers/cudnn_softmax_layer.cpp
CXX src
/caffe/layers/relu_layer.cpp
CXX src
/caffe/layers/input_layer.cpp
CXX src
/caffe/layers/cudnn_tanh_layer.cpp
CXX src
/caffe/layers/tile_layer.cpp
CXX src
/caffe/layers/batch_reindex_layer.cpp
CXX src
/caffe/layers/window_data_layer.cpp
CXX src
/caffe/layers/lstm_layer.cpp
CXX src
/caffe/layers/power_layer.cpp
NVCC src
/caffe/solvers/nesterov_solver.cu
NVCC src
/caffe/solvers/adam_solver.cu
NVCC src
/caffe/solvers/adagrad_solver.cu
NVCC src
/caffe/solvers/adadelta_solver.cu
NVCC src
/caffe/solvers/sgd_solver.cu
NVCC src
/caffe/solvers/rmsprop_solver.cu
NVCC src
/caffe/util/im2col.cu
NVCC src
/caffe/util/math_functions.cu
NVCC src
/caffe/layers/bias_layer.cu
NVCC src
/caffe/layers/lrn_layer.cu
NVCC src
/caffe/layers/hdf5_data_layer.cu
NVCC src
/caffe/layers/hdf5_output_layer.cu
NVCC src
/caffe/layers/log_layer.cu
NVCC src
/caffe/layers/exp_layer.cu
NVCC src
/caffe/layers/sigmoid_cross_entropy_loss_layer.cu
NVCC src
/caffe/layers/contrastive_loss_layer.cu
NVCC src
/caffe/layers/batch_norm_layer.cu
NVCC src
/caffe/layers/scale_layer.cu
NVCC src
/caffe/layers/prelu_layer.cu
NVCC src
/caffe/layers/dropout_layer.cu
NVCC src
/caffe/layers/sigmoid_layer.cu
NVCC src
/caffe/layers/recurrent_layer.cu
NVCC src
/caffe/layers/embed_layer.cu
NVCC src
/caffe/layers/accuracy_layer.cu
NVCC src
/caffe/layers/bnll_layer.cu
NVCC src
/caffe/layers/relu_layer.cu
NVCC src
/caffe/layers/im2col_layer.cu
NVCC src
/caffe/layers/cudnn_tanh_layer.cu
NVCC src
/caffe/layers/elu_layer.cu
NVCC src
/caffe/layers/tile_layer.cu
NVCC src
/caffe/layers/cudnn_conv_layer.cu
NVCC src
/caffe/layers/cudnn_lcn_layer.cu
NVCC src
/caffe/layers/batch_reindex_layer.cu
NVCC src
/caffe/layers/eltwise_layer.cu
NVCC src
/caffe/layers/cudnn_relu_layer.cu
NVCC src
/caffe/layers/conv_layer.cu
NVCC src
/caffe/layers/reduction_layer.cu
NVCC src
/caffe/layers/absval_layer.cu
NVCC src
/caffe/layers/deconv_layer.cu
NVCC src
/caffe/layers/inner_product_layer.cu
NVCC src
/caffe/layers/crop_layer.cu
NVCC src
/caffe/layers/softmax_loss_layer.cu
NVCC src
/caffe/layers/pooling_layer.cu
NVCC src
/caffe/layers/filter_layer.cu
NVCC src
/caffe/layers/cudnn_softmax_layer.cu
NVCC src
/caffe/layers/tanh_layer.cu
NVCC src
/caffe/layers/base_data_layer.cu
NVCC src
/caffe/layers/concat_layer.cu
NVCC src
/caffe/layers/lstm_unit_layer.cu
NVCC src
/caffe/layers/cudnn_pooling_layer.cu
NVCC src
/caffe/layers/mvn_layer.cu
NVCC src
/caffe/layers/slice_layer.cu
NVCC src
/caffe/layers/silence_layer.cu
NVCC src
/caffe/layers/cudnn_lrn_layer.cu
NVCC src
/caffe/layers/euclidean_loss_layer.cu
NVCC src
/caffe/layers/threshold_layer.cu
NVCC src
/caffe/layers/cudnn_sigmoid_layer.cu
NVCC src
/caffe/layers/split_layer.cu
NVCC src
/caffe/layers/power_layer.cu
NVCC src
/caffe/layers/softmax_layer.cu
CXX tools
/upgrade_solver_proto_text.cpp
CXX tools
/test_net.cpp
CXX tools
/upgrade_net_proto_text.cpp
CXX tools
/upgrade_net_proto_binary.cpp
CXX tools
/finetune_net.cpp
CXX tools
/extract_features.cpp
CXX tools
/caffe.cpp
CXX tools
/compute_image_mean.cpp
CXX tools
/train_net.cpp
CXX tools
/device_query.cpp
CXX tools
/net_speed_benchmark.cpp
CXX tools
/convert_imageset.cpp
CXX examples
/siamese/convert_mnist_siamese_data.cpp
CXX examples
/mnist/convert_mnist_data.cpp
CXX examples
/cifar10/convert_cifar_data.cpp
CXX examples
/cpp_classification/classification.cpp
CXX
.build_release/src/caffe/proto/caffe.pb.cc
AR
-o .build_release/lib/libcaffe.a
LD
-o .build_release/lib/libcaffe.so.1.0.0
CXX
/LD -o .build_release/tools/upgrade_solver_proto_text.bin
CXX
/LD -o .build_release/tools/test_net.bin
CXX
/LD -o .build_release/tools/upgrade_net_proto_text.bin
CXX
/LD -o .build_release/tools/upgrade_net_proto_binary.bin
CXX
/LD -o .build_release/tools/finetune_net.bin
CXX
/LD -o .build_release/tools/extract_features.bin
CXX
/LD -o .build_release/tools/caffe.bin
CXX
/LD -o .build_release/tools/compute_image_mean.bin
CXX
/LD -o .build_release/tools/train_net.bin
CXX
/LD -o .build_release/tools/device_query.bin
CXX
/LD -o .build_release/tools/net_speed_benchmark.bin
CXX
/LD -o .build_release/tools/convert_imageset.bin
CXX
/LD -o .build_release/examples/siamese/convert_mnist_siamese_data.bin
CXX
/LD -o .build_release/examples/mnist/convert_mnist_data.bin
CXX
/LD -o .build_release/examples/cifar10/convert_cifar_data.bin
CXX
/LD -o .build_release/examples/cpp_classification/classification.bin


noah@mbp_ws
:~/code/caffe_original/caffe$ make runtest -j8


CXX src
/caffe/test/test_math_functions.cpp
CXX src
/caffe/test/test_image_data_layer.cpp
CXX src
/caffe/test/test_rnn_layer.cpp
CXX src
/caffe/test/test_batch_norm_layer.cpp
CXX src
/caffe/test/test_util_blas.cpp
CXX src
/caffe/test/test_contrastive_loss_layer.cpp
CXX src
/caffe/test/test_io.cpp
CXX src
/caffe/test/test_argmax_layer.cpp
CXX src
/caffe/test/test_data_transformer.cpp
CXX src
/caffe/test/test_lstm_layer.cpp
CXX src
/caffe/test/test_batch_reindex_layer.cpp
CXX src
/caffe/test/test_tile_layer.cpp
CXX src
/caffe/test/test_dummy_data_layer.cpp
CXX src
/caffe/test/test_blob.cpp
CXX src
/caffe/test/test_softmax_with_loss_layer.cpp
CXX src
/caffe/test/test_sigmoid_cross_entropy_loss_layer.cpp
CXX src
/caffe/test/test_protobuf.cpp
CXX src
/caffe/test/test_accuracy_layer.cpp
CXX src
/caffe/test/test_im2col_layer.cpp
CXX src
/caffe/test/test_lrn_layer.cpp
CXX src
/caffe/test/test_net.cpp
CXX src
/caffe/test/test_mvn_layer.cpp
CXX src
/caffe/test/test_neuron_layer.cpp
CXX src
/caffe/test/test_euclidean_loss_layer.cpp
CXX src
/caffe/test/test_bias_layer.cpp
CXX src
/caffe/test/test_reduction_layer.cpp
CXX src
/caffe/test/test_solver_factory.cpp
CXX src
/caffe/test/test_memory_data_layer.cpp
CXX src
/caffe/test/test_stochastic_pooling.cpp
CXX src
/caffe/test/test_crop_layer.cpp
CXX src
/caffe/test/test_threshold_layer.cpp
CXX src
/caffe/test/test_solver.cpp
CXX src
/caffe/test/test_upgrade_proto.cpp
CXX src
/caffe/test/test_scale_layer.cpp
CXX src
/caffe/test/test_reshape_layer.cpp
CXX src
/caffe/test/test_maxpool_dropout_layers.cpp
CXX src
/caffe/test/test_gradient_based_solver.cpp
CXX src
/caffe/test/test_concat_layer.cpp
CXX src
/caffe/test/test_flatten_layer.cpp
CXX src
/caffe/test/test_multinomial_logistic_loss_layer.cpp
CXX src
/caffe/test/test_layer_factory.cpp
CXX src
/caffe/test/test_syncedmem.cpp
CXX src
/caffe/test/test_spp_layer.cpp
CXX src
/caffe/test/test_pooling_layer.cpp
CXX src
/caffe/test/test_eltwise_layer.cpp
CXX src
/caffe/test/test_slice_layer.cpp
CXX src
/caffe/test/test_infogain_loss_layer.cpp
CXX src
/caffe/test/test_filler.cpp
CXX src
/caffe/test/test_data_layer.cpp
CXX src
/caffe/test/test_db.cpp
CXX src
/caffe/test/test_softmax_layer.cpp
CXX src
/caffe/test/test_inner_product_layer.cpp
CXX src
/caffe/test/test_tanh_layer.cpp
CXX src
/caffe/test/test_common.cpp
CXX src
/caffe/test/test_benchmark.cpp
CXX src
/caffe/test/test_deconvolution_layer.cpp
CXX src
/caffe/test/test_hinge_loss_layer.cpp
CXX src
/caffe/test/test_hdf5_output_layer.cpp
CXX src
/caffe/test/test_split_layer.cpp
CXX src
/caffe/test/test_power_layer.cpp
CXX src
/caffe/test/test_internal_thread.cpp
CXX src
/caffe/test/test_platform.cpp
CXX src
/caffe/test/test_filter_layer.cpp
CXX src
/caffe/test/test_hdf5data_layer.cpp
CXX src
/caffe/test/test_convolution_layer.cpp
CXX src
/caffe/test/test_random_number_generator.cpp
CXX src
/caffe/test/test_embed_layer.cpp
NVCC src
/caffe/test/test_im2col_kernel.cu
CXX src
/gtest/gtest-all.cpp
CXX
/LD -o .build_release/test/test_all.testbin src/caffe/test/test_caffe_main.cpp
.build_release/tools/caffe
make
: *** [runtest] Segmentation fault (core dumped)


Thank you!

### Steps to reproduce

Here is the Makefile.config file


## Refer to http://caffe.berkeleyvision.org/installation.html
# Contributions simplifying and improving our build system are welcome!
# cuDNN acceleration switch (uncomment to build with cuDNN).
USE_CUDNN := 0
# CPU-only switch (uncomment to build without GPU support).
# CPU_ONLY := 0
USE_OPENCV := 1
OPENCV_VERSION := 3
# To customize your choice of compiler, uncomment and set the following.
# N.B. the default for Linux is g++ and the default for OSX is clang++
# CUSTOM_CXX := g++
# CUDA directory contains bin/ and lib/ directories that we need.
CUDA_DIR := /usr/local/cuda
# On Ubuntu 14.04, if cuda tools are installed via
# "sudo apt-get install nvidia-cuda-toolkit" then use this instead:
# CUDA_DIR := /usr
# CUDA architecture setting: going with all of them.
# For CUDA < 6.0, comment the *_50 lines for compatibility.
#CUDA_ARCH := -gencode arch=compute_30,code=sm_30 \
#        -gencode arch=compute_50,code=sm_50 \
#        -gencode arch=compute_50,code=compute_50 \
# -gencode=arch=compute_61,code=sm_61
CUDA_ARCH :=  -gencode arch=compute_30,code=sm_30 \
                -gencode arch=compute_35,code=sm_35 \
                -gencode arch=compute_50,code=sm_50 \
                -gencode arch=compute_52,code=sm_52 \
                -gencode arch=compute_60,code=sm_60 \
                -gencode arch=compute_61,code=sm_61 \
                -gencode arch=compute_61,code=compute_61 
# BLAS choice:
# atlas for ATLAS (default)
# mkl for MKL
# open for OpenBlas
BLAS := open
# Custom (MKL/ATLAS/OpenBLAS) include and lib directories.
# Leave commented to accept the defaults for your choice of BLAS
# (which should work)!
# BLAS_INCLUDE := /path/to/your/blas
# BLAS_LIB := /path/to/your/blas
# Homebrew puts openblas in a directory that is not on the standard search path
# BLAS_INCLUDE := $(shell brew --prefix openblas)/include
# BLAS_LIB := $(shell brew --prefix openblas)/lib
# This is required only if you will compile the matlab interface.
# MATLAB directory should contain the mex binary in /bin.
# MATLAB_DIR := /usr/local
MATLAB_DIR := /usr/local/MATLAB/R2017a
# NOTE: this is required only if you will compile the python interface.
# We need to be able to find Python.h and numpy/arrayobject.h.
# PYTHON_INCLUDE := /usr/include/python2.7 \
/usr/lib/python2.7/dist-packages/numpy/core/include
# Anaconda Python distribution is quite popular. Include path:
# Verify anaconda location, sometimes it's in root.
ANACONDA_HOME := /home/noah/code/libraries/Anaconda3
PYTHON_INCLUDE := $(ANACONDA_HOME)/include \
# $(ANACONDA_HOME)/include/python2.7 \
# $(ANACONDA_HOME)/lib/python2.7/site-packages/numpy/core/include
# We need to be able to find libpythonX.X.so or .dylib.
# PYTHON_LIB := /usr/lib
PYTHON_LIB := $(ANACONDA_HOME)/lib
# Homebrew installs numpy in a non standard path (keg only)
# PYTHON_INCLUDE += $(dir $(shell python -c 'import numpy.core; print(numpy.core.__file__)'))/include
# PYTHON_LIB += $(shell brew --prefix numpy)/lib
# Uncomment to support layers written in Python (will link against Python libs)
WITH_PYTHON_LAYER := 1
# Whatever else you find you need goes here.
INCLUDE_DIRS := $(PYTHON_INCLUDE) /usr/local/include
LIBRARY_DIRS := $(PYTHON_LIB) /usr/local/lib /usr/lib
# If Homebrew is installed at a non standard location (for example your home directory) and you use it for general dependencies
# INCLUDE_DIRS += $(shell brew --prefix)/include
# LIBRARY_DIRS += $(shell brew --prefix)/lib
# Uncomment to use `pkg-config` to specify OpenCV library paths.
# (Usually not necessary -- OpenCV libraries are normally installed in one of the above $LIBRARY_DIRS.)
USE_PKG_CONFIG := 1
# N.B. both build and distribute dirs are cleared on `make clean`
BUILD_DIR := build
DISTRIBUTE_DIR := distribute
# Uncomment for debugging. Does not work on OSX due to https://github.com/BVLC/caffe/issues/171
# DEBUG := 1
# The ID of the GPU that 'make runtest' will use to run unit tests.
TEST_GPUID := 0
# enable pretty build (comment to see full commands)
Q ?= @


### Your system configuration
Operating system: Ubuntu 14.04
Compiler: gcc version 4.8.4
CUDA version (if applicable): CUDA 8
CUDNN version (if applicable): CUDNN 6
GPU: Titan Xp
BLAS: OpenBlas
Python or MATLAB version (for pycaffe and matcaffe respectively): Anaconda3-4.3
Opecv: 3.3

Reply all
Reply to author
Forward
0 new messages