You are using the LD_LIBRARY_PATH from Anaconda, if you don't use it, you won't have those errors.
But if you use the system LD_LIBRARY_PATH, you will probably have errors related to libhdf5_hl.so.9, you can solve those errors with the following instructions:
Go to the libraries directory:
cd /usr/lib/x86_64-linux-gnu
Link the system version of HDF5 from 7 to 9:
sudo ln -s libhdf5.so.7 libhdf5.so.9
sudo ln -s libhdf5_hl.so.7 libhdf5_hl.so.9
Update the "Dynamic Linker":
sudo ldconfig
By the way, I wrote a guide to install almost everything in Ubuntu 14.04 (from there I copied the above instructions), it's waiting for the pull request, but you can read it here:
https://github.com/tiangolo/caffe/blob/ubuntu-tutorial-b/docs/install_apt2.md