Step by step tutorial on Compiling libnetconf & netopeer on Ubuntu

[Repenno Kame]

thanks for all the help, now it is my turn to give back to the community.

This  was tested on Ubuntu 12.04LTS 32-bits and 13.10 64-bits. But certainly your mileage may vary.

[Radek Krejčí]

Hi,
I very appreciate this work, Thank you!

I'm going to check your tutorial and try to make it easier for users to
use libnetconf and Netopeer. For example, make doc in step 7.1 is no
more needed.

Regards,
Radek Krejci

Dne 13.12.2013 15:52, Repenno Kame napsal(a):

> thanks for all the help, now it is my turn to give back to the community.
>
> This was tested on Ubuntu 12.04LTS 32-bits and 13.10 64-bits. But
> certainly your mileage may vary.

> --
> You received this message because you are subscribed to the Google
> Groups "libnetconf" group.
> To unsubscribe from this group and stop receiving emails from it, send
> an email to libnetconf+...@googlegroups.com.
> Visit this group at http://groups.google.com/group/libnetconf.
> For more options, visit https://groups.google.com/groups/opt_out.

[Gary Highberger]

On Friday, December 13, 2013 9:52:23 AM UTC-5, Repenno Kame wrote:
> thanks for all the help, now it is my turn to give back to the community.
>
> This  was tested on Ubuntu 12.04LTS 32-bits and 13.10 64-bits. But certainly your mileage may vary.

I'll let everyone know how Repenno's recipe works on 64 bit 14.04.
Thanks,
Gary

[Gary Highberger]

Hi Everybody,
The recipe worked fairly well. My comments and then a few questions follow:
Step Number:

1. okay
2. okay except I believe the necessary lib name is libxslt-dev. I didn't get far enough to hit the "cannot remove 'libtoolT'" error
   
3. okay except I believe the necessary lib name is libssh2-1-dev
4. okay except I believe the necessary lib name is libdbus-1-dev
5. okay
6. okay
7. okay
1. server-sl builds okay, multi-lever server make fails because compiler cannot find libnetconf_tls.h
2. okay
8. I couldn't find step 8
9. Not evaluated

The reason the multi-level server make failed is because the compiler couldn't find libnetconf_tls.h.

 gary@gary-VirtualBox:~/netopeer/server$ make
gcc -Wall -Wextra -O3 -pthread -I/usr/include/dbus-1.0 -I/usr/lib/x86_64-linux-gnu/dbus-1.0/include   -I/usr/local/include    -I/usr/include/libxml2 -DBINDIR=\"/usr/local/bin\" -DCFG_DIR=\"//etc/netopeer\" -DMODULES_CFG_DIR=\"//etc/netopeer/modules.conf.d//\" -DVERSION=\"0.6.0\" -fPIC -c src/netconf-server-transapi.c -o .obj/src/netconf-server-transapi.o
src/netconf-server-transapi.c:64:28: fatal error: libnetconf_tls.h: No such file or directory
 #include <libnetconf_tls.h>
                            ^
compilation terminated.
make: *** [.obj/src/netconf-server-transapi.o] Error 1

Questions:

1. Should libnetconf_tls be in the /usr/local/include folder (please see red text above)? 
2. Why didn't executing "make install" in step 6 copy libnetconf_tls into the /usr/local/include folder?
3. Should I just copy libnetconf_tls into the /usr/local/include folder?

Thanks in advance for the help Everybody!

[Radek Krejčí]

Hi Gary,
thanks for this testing. Here are some notes and answers to your questions.

Note to step 9 - this is needed for server-sl, but netopeer-server currently control its own sshd instance according to ietf-netconf-server configuration. By default, the server listens on port 830 for SSH and if (configure's) --enable-tls was used also on 6513 for TLS.

Answers:

1) libnetconf_tls.h is expected to be placed in some system include directory (typically in /usr/local/include/ or /usr/include/)
2) because --enable-tls option of libnetconf's configure was not used
3) no, it is expected to be done automatically according to 2)

There was a bug in netopeer-server. libnetconf_tls.h was required even if --enble-tls was not used with netopeer's configure. Current master is fixed - Gary, thanks for the report. Please pull the netopeer git and run make.

Note to TLS transport - it is available only in netopeer-server (not in server-sl) and if you want to use it, libnetconf's and netopeer-server's configure scripts must be run with --enable-tls option. For more information, see http://libnetconf.googlecode.com/git/doc/doxygen/html/d4/d76/transport.html, for netopeer-server I'm preparing some howto, but it is not available yet.

Best regards,
Radek

Dne 29.5.2014 20:02, Gary Highberger napsal(a):

--

You received this message because you are subscribed to the Google Groups "libnetconf" group.
To unsubscribe from this group and stop receiving emails from it, send an email to libnetconf+...@googlegroups.com.
Visit this group at http://groups.google.com/group/libnetconf.

For more options, visit https://groups.google.com/d/optout.

[Gary Highberger]

Hi Radek,

You're welcome for my testing. My pleasure to be sure. libnetconf and netopeer have been configured, made, and installed without error. My lab notes are attached.

My tests and development steps are to:

1. Test the multi-level server and cli
2. Add my own (very simple) Yang model to the multi-level server
3. Test my own Yang model with the cli
   

I will upload lab notes, Yang model, and source code as they become available. 

I have three questions.

• Will I be using TransAPI for doing step 2 above?
• Where is TransAPI?
  
• Where is the TransAPI documentation?

Many thanks Radek and all,

Gary

[Radek Krejčí]

Hi Gary,

Dne 30.5.2014 16:18, Gary Highberger napsal(a):

My tests and development steps are to:

1. Test the multi-level server and cli
2. Add my own (very simple) Yang model to the multi-level server
3. Test my own Yang model with the cli
   

I will upload lab notes, Yang model, and source code as they become available. 

I have three questions.

• Will I be using TransAPI for doing step 2 above?

It depends - if you are satisfied just with manipulating the configuration data, you don't need transAPI module. It is required if you want to apply (changed) configuration data to something (app, device,...). Anyway, I recommend to use netopeer-manager to manage netopeer-server's modules (example is for the first case when you want just to manipulate configuration data, so there is no transapi module):

$ pyang -f yin my-own-model.yang -o my-own-model.yin
(# netopeer-manager add --help)
# netopeer-manager add --name someName --model /absolut-or-relative/path/my-own-model.yin --datastore /absolute-or-relative/path/myDatastore.xml

This will create ${sysconfdir}/netopeer/modules.conf.d/someName.xml file (it can be created manually, but I recomend to use netopeer-manager) describing the module for netopeer-server. Also startup configuration of the netopeer-server (try get-config on startup datastore) is changed to enable this new part of the netopeer-server. Since now, you should be able to manipulate with configuration data described by your data model.

• Where is TransAPI?
  

What exactly do you mean? TransAPI is part of libnetconf, which is also used by netopeer-server. Check http://libnetconf.googlecode.com/git/doc/doxygen/html/d9/d25/transapi.html

• Where is the TransAPI documentation?

alread mentioned above, tutorial can be found at http://libnetconf.googlecode.com/git/doc/doxygen/html/d3/df0/transapi_tutorial.html. In following weeks I want to integrate some generic transAPI modules (Linux system, iptables, network interfaces,...) into the netopeer-server so there will be more source codes to show how it can be used.

Regards,
Radek

[Radek Krejčí]

Hi Gary,
I have some question to the notes you enclosed.

1) In 1. it installs libxml2 package - is there any libxml2-dev package on Ubuntu or does this package include header files? Because it is strange for me, that in 9. you are a forcing configure to start with CPPFLAGS set to -I/usr/local/include/libxml2, which probably means, that these header files were installed not from the package, but from the source codes using make install. Be careful with this, since the header files can have different version than binaries installed from libxml2 package. I also don't understand why are you specifying CPPFLAGS for cli and you don't do that for servers.

2) why do you need -lncurses in cli? I know, that Rapeno used it, but, can you try it without -lncurses? netopeer-cli requires only libreadline, not ncurses.

3) in 3. you don't use --with-group option - just note that this way, only members of the root group are able to connect to the netopeer-server.

Regards,
Radek

Dne 30.5.2014 16:18, Gary Highberger napsal(a):

Hi Radek,

[Gary Highberger]

Hi Radek,
Please see my in-line responses below. I fixed up my procedure and uploaded it. The CLI connects to server-sl and everything seem to be basically working. The MG-Soft NETCONF browser also connects to server-sl. I'll do  through testing tomorrow and report my results on netopeer.
Thanks for the help,
Gary

On Monday, June 2, 2014 4:30:33 AM UTC-4, Radek Krejčí wrote:

Hi Gary,
I have some question to the notes you enclosed.

1) In 1. it installs libxml2 package - is there any libxml2-dev package on Ubuntu No. I messed this up or does this package include header files? Because it is strange for me, that in 9. you are a forcing configure to start with CPPFLAGS set to -I/usr/local/include/libxml2, which probably means, that these header files were installed not from the package, but from the source codes using make install. Be careful with this, since the header files can have different version than binaries installed from libxml2 package. I also don't understand why are you specifying CPPFLAGS for cli and you don't do that for servers. I mistakenly and blindly copied steps from the previous procedure.

2) why do you need -lncurses in cli? I know, that Rapeno used it, but, can you try it without -lncurses? netopeer-cli requires only libreadline, not ncurses. I tried without and the CLI connects to server-sl just fine.

3) in 3. you don't use --with-group option - just note that this way, only members of the root group are able to connect to the netopeer-server. OK

Regards,
Radek

[dassan...@gmail.com]

On Friday, December 13, 2013 at 8:22:23 PM UTC+5:30, Repenno Kame wrote:
> thanks for all the help, now it is my turn to give back to the community.
>
> This  was tested on Ubuntu 12.04LTS 32-bits and 13.10 64-bits. But certainly your mileage may vary.

Hi All,

I went through this mail chain... & its really very helpful...

But I am facing an issue while installing the multi level netopeer server. I have installed all prerequisites as per the list given here, as well I followed this link
https://wiki.opendaylight.org/view/OpenDaylight_Controller:Config:Examples:Netconf:Manual_netopeer_installation

Issue what I am facing is this..

[netopeer/server]./configure --sysconfdir=/etc

configure: generating validation files...
/home/sanjidas/Downloads/netopeer/server/config/ietf-netconf-server.yang:5: error: module "ietf-yang-types" not found in search path
/home/sanjidas/Downloads/netopeer/server/config/ietf-netconf-server.yang:8: error: module "ietf-inet-types" not found in search path
Command 'pyang -p /home/sanjidas/Downloads/netopeer/server/config/ -f yin /home/sanjidas/Downloads/netopeer/server/config/ietf-netconf-server.yang' failed (1)
configure: error: Generating validation files for ietf-netconf-server failed.

It would be a great favor if you can kindly gimme some pointer on how to resolve this.

I downloaded the netopeer server from this link
git clone https://code.google.com/p/netopeer/

thanks in advance

regards,
Sanjib

[Michal Vasko]

Hi Sanjib,

the problem is that pyang cannot find those two models even though they are installed with it. The simplest way of resolving this is to export an environment variable "YANG_MODPATH" (man pyang, in the switch "-p" description) with the path to the directory with the standard modules (on my machine "/usr/share/yang/modules/"). The problem is that pyang should be able to find these right after installation (it does so on OpenSUSE). Let us, please, know how did you install pyang and where are the basic modules, which will likely be the same path. Thanks.

Regards,
Michal

[Sanjib Das]

Hi Michal,

thanks for your reply...

well I could resolve it myself... (through some shortcut method), I copied those files locally in the server/config directory. 

I am now seeing a new issue with 'make' command... not sure whether this is a bug or something I am missing..

[server]make

gcc -Wall -Wextra -O3 -pthread -DNP_SSH -I/usr/local/include    -DRCSID=\""built from git 6a562199e317cfda664c"\" -I/usr/include/libxml2 -DBINDIR=\"/usr/local/bin\" -DCFG_DIR=\"//etc/netopeer\" -DMODULES_CFG_DIR=\"//etc/netopeer/modules.conf.d//\" -DVERSION=\"0.7.0\" -fPIC -c src/server.c -o .obj/src/server.o

src/server.c: In function ‘data_thread’:

src/server.c:292:17: error: ‘BASE_READ_BUFFER_SIZE’ undeclared (first use in this function)

src/server.c:292:17: note: each undeclared identifier is reported only once for each function it appears in

make: *** [.obj/src/server.o] Error 1

If at all I need to declare this marco, what would be the reasonable size for this buffer?

thanks,

Sanjib

[Sanjib Das]

Hi Michal,

I installed the pyang from this link "https://code.google.com/p/pyang/"

Looks like I could figure out the mistake what I did during installation...

I dint provide this "prefix" path (python setup.py install --prefix=/usr/local)

Thats because I was following the steps as per this link "https://wiki.opendaylight.org/view/OpenDaylight_Controller:Config:Examples:Netconf:Manual_netopeer_installation"

thanks,

Sanjib

[Michal Vasko]

Hi Sanjib,

this is my bad, please pull netopeer, configure and compile it again.

Regards,
Michal

[Sanjib Das]

Hi Michal,

I will do tonight.. Will update you on this...
Thanks for all your help...

Regards,
Sanjib

[Sanjib Das]

Hi Michal,

I started installing everything newly (unfortunately my VM got crashed & I had to do it again)...

All pre-requisites I installed, but I am seeing a different issue this time at a very initial level of netopeer server installtion..

netopeer/server# ./configure --sysconfdir=/etc

configure: error: "lnctool not found!"

It would be a great favor if you could comment on this... I dint get much info through google search for this particular issue

thanks,

Sanjib

[Michal Vasko]

Hi Sanjib,

the problem is that you installed libnetconf in some non-standard path and it cannot be find in PATH directories. Just add the bin directory with lnctool to PATH and it should work.

Regards,
Michal

[Sanjib Das]

Hi Michal,

I could resolve this with an additional package installation (https://code.google.com/p/libnetconf/source/browse/lnctool/lnctool.in?spec=svnbb158d7fc4dbbd46b52b45b763f4004d9c6250cf&r=bb158d7fc4dbbd46b52b45b763f4004d9c6250cf). 

I was following the instruction manual for the installation & I dint find any explicit path given there...

Generally default paths work for any software installation..I as presuming the same here as well..

I am facing new errors/issues now... let me see how far I can resolve them :)

But thanks a lot for your guidance...

regards,

Sanjib

--
You received this message because you are subscribed to a topic in the Google Groups "libnetconf" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/libnetconf/sVaj8tYYZC0/unsubscribe.
To unsubscribe from this group and all its topics, send an email to libnetconf+...@googlegroups.com.

[Radek Krejčí]

Hi,

Dne 21.4.2015 v 07:27 Sanjib Das napsal(a):

> Hi Michal,
>
> I could resolve this with an additional package installation (https://code.google.com/p/libnetconf/source/browse/lnctool/lnctool.in?spec=svnbb158d7fc4dbbd46b52b45b763f4004d9c6250cf&r=bb158d7fc4dbbd46b52b45b763f4004d9c6250cf).

additional package? It is part of libnetconf and libnetconf is requirement for netopeer. If it cannot find lnctool, it likely cannot find either libnetconf, right?

Radek

[Sanjib Das]

Hi Redek,

I already had libnetconf installed... on top of this I had to apply that package

I am following instructions as per this link

https://wiki.opendaylight.org/view/OpenDaylight_Controller:Config:Examples:Netconf:Manual_netopeer_installation

thanks,
Sanjib

[Radek Krejčí]

ok, here are some notes to the howto (it is already a little bit obsolete), all notes apply to the netopeer master branch.

30 - libssh2 is currently still needed by libnetconf (for client side), but we are workin on its replacement by libssh which is currently required by netopeer-server

40 - libdbus (D-Bus) is not required

70 - when you pull netopeer, you get 3 directories - server-sl was removed

71 - libevent is not required

90 - don't touch sshd config, ssh server is integrated in netopeer-server

100 - problem can occur in main server, but there is netopeer-configurator tool that can help you to set access rights to the data. However, solution described in howto should still work (but you should prefere the netopeer-configurator way).

ad lnctool - then something is wrong. lnctool is a tool from libnetconf. What do you mean by "apply that package"? When you run make install in the libnetconf directory (as described in the referred howto), lnctool should be installed together with the library itself (by default into the /usr/local/bin/). If not, it is bug and we should solve it. Can you please check it?

The lnctool "package" you link to is just an obsolete version of lnctool from 2013 (part of libnetconf in 2013!), so installing it and using it together with the current libnetconf/netopeer is not a good idea. It simply will not work.

Regards,
Radek

Dne 21.4.2015 v 07:42 Sanjib Das napsal(a):

--

You received this message because you are subscribed to the Google Groups "libnetconf" group.

To unsubscribe from this group and stop receiving emails from it, send an email to libnetconf+...@googlegroups.com.

[Sanjib Das]

Hi Radek,

thanks for this updated "howto list"...

well, by "apply that package"? I meant, doing (./configure, make & make install).

Anyway since this is not recommended, I wont bring this part anymore in our discussion....

I have again initiated this process (netopeer installation)...I will update you about this..

Please note, I encountered these issues during my 2nd attempt of netopeer installation, during first attempt I dint face these issues at all.

Today again I am doing it for the 3rd time... I will let you know the end result...

thanks,

Sanjib

[Sanjib Das]

Hi Radek,

just wanted to confirm one thing... the opendayligh howto list (the one which I shared with you) doesn't talk about pyang installation as pre-requisite...

However, I have another link where I see this needs to be installed...

It will be great if you can kindly comment on this...

http://seguesoft.com/how-to-set-up-netopeer-server-to-use-with-netconfc

thanks,

Sanjib

[Sanjib Das]

Hi Radek,

I am still seeing the same issue

[server]./configure --sysconfdir=/etc

checking for pkg-config... /usr/bin/pkg-config

checking for roff2html... no

checking for distro... 

configure: WARNING: Unsupported Linux distro "", only RHEL and SUSE are fully supported.

checking pkg-config is at least version 0.9.0... yes

checking for LIBNETCONF... yes

checking for uname... yes

checking for host architecture... i686

checking for pyang... yes

checking for lnctool... no

configure: error: "lnctool not found!"

thanks,

Sanjib

[Sanjib Das]

I am using lubuntu 12.04 OS

[Michal Vasko]

Hi Sanjib,

first and foremost, refer to the README in the netopeer/server directory, not outdated tutorials scattered on the web. There you can find all the requirements. If you have all the software mentioned there, you should be able to install netopeer. I will try it myself on Ubuntu and try to resolve any issues I'll encounter.

Regards,
Michal

[Michal Vasko]

Hi Sanjib,

where did you install libnetconf, with some prefix or the default one (/usr/local/)?

Regards,
Michal

[Sanjib Das]

Default path...

[Michal Vasko]

Can you please post the output of these 2 commands?

which lnctool
echo $PATH

Thanks

[Sanjib Das]

root@sanjidas-VirtualBox:~# which lnctool

root@sanjidas-VirtualBox:~# 

root@sanjidas-VirtualBox:~# echo $PATH

/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games

which lnctool  doesn't give anything...

I checked the README in netopeer/server , whatever I installed are superset of README contents...

thanks,

Sanjib

[Michal Vasko]

Hi Sanjib,

first I'd suggest you install pyang (from github, must be installed from the source, since version 1.5.0 is required, just follow README). Then you need to install libssh 0.6.4. Unfortunately, there is no RPM available (only 0.6.3), so until it won't be made, you need to compile and install it from the source. In this step I encountered Ubuntu 14.04 bug with GCC and G++ compilers and I needed to skip libssh examples compilation. However, in Ubuntu 12.04 you should be fine.

Once you do this, install libnetconf again, from the master branch. Afterwards the command "which lnctool" should output the path to lnctool (default "/usr/local/bin/lnctool). If it does not, something is wrong, because PATH should include /usr/local/bin/, meaning shell should find your installed lnctool. If it does not, then you must manually add the directory with lnctool to PATH, I cannot do anything more.

Having done all this, configure, compilation and installation of netopeer should not produce any warnings nor errors, I have just tried it.

Regards,
Michal

[Sanjib Das]

Hi Michal/Radek,

At last I could complete the installation.... But I am facing issue in running the server

I do see this error log (attached complete log file)

netopeer-server[1954]: Netopeer server successfully initialized.

netopeer-server: symbol lookup error: netopeer-server: undefined symbol: ssh_set_log_level

Is there anything I am still missing?

I tried to run even without -v option, but same result I got...

thanks,

Sanjib

[Sanjib Das]

This seems to library linking issue... 

thanks,

Sanjib

[Sanjib Das]

Hi Mishal/Radek,

Need one help...

My netopeer server was working fine with netopeer cli. I then tried to configure & make make-install for 'transAPI'. Except 'turing' build failed for other two directories (cfginterfaces  cfgsystem). 

After that I stopped there & I was able to run my netopeer server & could execute 'get-conf' for turing-machine & also I could edit it to 'turing-machine123'. 

I rebooted my xwindows & strated seeing the issue..

Even though I did 'make clean' inside all 3 folder of transAPI, issue is still there... please help me in resolving this

I have attached the server console logs..

thanks,

Sanjib

[Sanjib Das]

Sorry... I attached wrong file... doing it again

[Sanjib Das]

Guys... I would resolve it myself...

thanks,

Sanjib

[Sanjib Das]

Sorry I meant... I could resolve this...typo :)

[Sanjib Das]

Hi experts,

one query, do we need to always provide the config in XML format?  I was trying to copy a .yang config file...But I get this error

libnetconf ERROR: xmlReadMemory failed (src/messages.c:3045)

copy-config: creating an rpc request failed.

However, with XML format I am able to get this done successfully...

thanks in advance

regards,

Sanjib

[Radek Krejčí]

libnetconf currently works only with YIN format of the data models. Configuration data are accepted only as XML.

Radek

Dne 23.4.2015 v 15:25 Sanjib Das napsal(a):