Interested in XIA project, need access to join meetup on hangout.

62 views
Skip to first unread message

Himanshu Bhadani

unread,
Feb 8, 2019, 1:59:35 AM2/8/19
to Linux XIA
Hello Moderators,

I'm Himanshu Bhadani, pursuing 5 year Intt. M.Tech in mathematics and computing from Indian Institute of Technology(ISM), Dhanbad, India, and currently in 4th year of my course work.
I've gone through the idea of XIA project and wanna contribute in the project and further extend my participation in Google Summer of Code 2019.
I went through the idealist of GSOC-2019. This year XIA is majorly focusing on Gatekeeper project for GSOC. So, i tried to setup gatekeeper project on my local but facing issue in configuration of network adapter.

sudo dependencies/dpdk/usertools/dpdk-devbind.py --bind=uio_pci_generic enp131s0f0
(mine is eno1)

ifconfig
eno1: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500
inet 172.17.19.21 netmask 255.255.252.0 broadcast 172.17.19.255
inet6 fe80::64e3:be1b:2f3c:c316 prefixlen 64 scopeid 0x20<link>
ether 94:57:a5:da:7c:07 txqueuelen 1000 (Ethernet)
RX packets 21501 bytes 21282794 (21.2 MB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 13046 bytes 1364243 (1.3 MB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0

lo: flags=73<UP,LOOPBACK,RUNNING> mtu 65536
inet 127.0.0.1 netmask 255.0.0.0
inet6 ::1 prefixlen 128 scopeid 0x10<host>
loop txqueuelen 1000 (Local Loopback)
RX packets 1497 bytes 267329 (267.3 KB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 1497 bytes 267329 (267.3 KB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0

Please help me in setting up the project and also give me access to XIA meet on hangout so that i can join the it.

hangout_id:- himanshub...@gmail.com

I've strong background of C/C++ Programming, Operating System, Computer Networks, Cryptography and Number Theory. So, also suggest me the way and external material to get familiar with gatekeeper project faster.

Thanks in advance.

Regards,
Himanshu

Cody Doucette

unread,
Feb 10, 2019, 4:27:09 PM2/10/19
to Himanshu Bhadani, Linux XIA
Hi Himanshu,

It's likely that your computer's network adapter is not compatible with the DPDK software that allows packets to be received in user space, and therefore you won't be able to use your computer to run Gatekeeper. If you like, you can create a virtual machine using KVM and run Gatekeeper on the guest:


This could be a good exercise but is not strictly necessary.

To join our meetups, you can find Hangouts links on our calendar:


Best,
Cody

--
You received this message because you are subscribed to the Google Groups "Linux XIA" group.
To unsubscribe from this group and stop receiving emails from it, send an email to linux-xia+...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Himanshu Bhadani

unread,
Feb 12, 2019, 2:55:30 PM2/12/19
to Linux XIA
Hey Cody,

I tried to setup virtual machine using KVM but ended with corrupting the settings of Network Manager.

After restoring the net access settings from PC, i tried to bind my eno1 and wno1 adapter but got some error and that error made my wlan adapter invisible from ifconfig.

Attaching recent logs of terminal:-

bhadani@pcinpc:~/projects/AltraMayor/gatekeeper$ make -j4
  CC main/main.o
  CC config/static.o
  CC config/dynamic.o
  CC cps/main.o
  CC cps/kni.o
  CC cps/elf.o
  CC ggu/main.o
  CC gk/main.o
  CC gk/fib.o
  CC gt/main.o
  CC lls/main.o
  CC lls/cache.o
  CC lls/arp.o
  CC lls/nd.o
  CC sol/main.o
  CC lib/mailbox.o
  CC lib/net.o
  CC lib/flow.o
  CC lib/ipip.o
gcc -o lib/luajit-ffi-cdata.o -c -m64 -pthread  -march=native -DRTE_MACHINE_CPUFLAG_SSE -DRTE_MACHINE_CPUFLAG_SSE2 -DRTE_MACHINE_CPUFLAG_SSE3 -DRTE_MACHINE_CPUFLAG_SSSE3 -DRTE_MACHINE_CPUFLAG_SSE4_1 -DRTE_MACHINE_CPUFLAG_SSE4_2 -DRTE_MACHINE_CPUFLAG_AES -DRTE_MACHINE_CPUFLAG_PCLMULQDQ -DRTE_MACHINE_CPUFLAG_AVX -DRTE_MACHINE_CPUFLAG_RDRAND -DRTE_MACHINE_CPUFLAG_FSGSBASE -DRTE_MACHINE_CPUFLAG_F16C -DRTE_MACHINE_CPUFLAG_AVX2  -I/home/bhadani/projects/AltraMayor/gatekeeper/build/include -I/home/bhadani/projects/AltraMayor/gatekeeper/dependencies/dpdk/x86_64-native-linuxapp-gcc/include -include /home/bhadani/projects/AltraMayor/gatekeeper/dependencies/dpdk/x86_64-native-linuxapp-gcc/include/rte_config.h -D_GNU_SOURCE -W -Wall -Wstrict-prototypes -Wmissing-prototypes -Wmissing-declarations -Wold-style-definition -Wpointer-arith -Wcast-align -Wnested-externs -Wcast-qual -Wformat-nonliteral -Wformat-security -Wundef -Wwrite-strings -Wdeprecated -Werror -Wimplicit-fallthrough=2 -Wno-format-truncation -I/home/bhadani/projects/AltraMayor/gatekeeper//include -I/usr/local/include/luajit-2.0/ -O3 -g -Wfatal-errors -DALLOW_EXPERIMENTAL_API -Wno-error=undef -Wno-undef \
-Wno-cast-qual /home/bhadani/projects/AltraMayor/gatekeeper/lib/luajit-ffi-cdata.c
  CC lib/launch.o
  CC lib/lpm.o
  CC lib/l2.o
  CC lib/acl.o
  CC lib/varip.o
  CC lib/ratelimit.o
  CC lib/memblock.o
  CC lib/log_ratelimit.o
  LD gatekeeper
  INSTALL-APP gatekeeper
  INSTALL-MAP gatekeeper.map
bhadani@pcinpc:~/projects/AltraMayor/gatekeeper$ ifconfig
eno1: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet 172.17.19.21  netmask 255.255.252.0  broadcast 172.17.19.255
        inet6 fe80::8f1f:deb1:a8d4:a532  prefixlen 64  scopeid 0x20<link>

        ether 94:57:a5:da:7c:07  txqueuelen 1000  (Ethernet)
        RX packets 124600  bytes 152044051 (152.0 MB)

        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 87613  bytes 8260120 (8.2 MB)

        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

lo: flags=73<UP,LOOPBACK,RUNNING>  mtu 65536
        inet 127.0.0.1  netmask 255.0.0.0
        inet6 ::1  prefixlen 128  scopeid 0x10<host>
        loop  txqueuelen 1000  (Local Loopback)
        RX packets 6341  bytes 560999 (560.9 KB)

        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 6341  bytes 560999 (560.9 KB)

        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

wlo1: flags=4099<UP,BROADCAST,MULTICAST>  mtu 1500
        ether 40:b8:9a:68:46:c9  txqueuelen 1000  (Ethernet)
        RX packets 0  bytes 0 (0.0 B)

        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 0  bytes 0 (0.0 B)

        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

bhadani@pcinpc:~/projects/AltraMayor/gatekeeper$ sudo dependencies/dpdk/usertools/dpdk-devbind.py --bind=eno1 wlo1
Error: bind failed for 0000:08:00.0 - Cannot open /sys/bus/pci/drivers/eno1/bind
Error: unbind failed for 0000:08:00.0 - Cannot open /sys/bus/pci/drivers//unbind
bhadani@pcinpc:~/projects/AltraMayor/gatekeeper$ sudo dependencies/dpdk/usertools/dpdk-devbind.py --bind=wlo1 eno1
Routing table indicates that interface 0000:09:00.0 is active. Not modifying
bhadani@pcinpc:~/projects/AltraMayor/gatekeeper$ sudo dependencies/dpdk/usertools/dpdk-devbind.py --bind=eno1 wlo1
Unknown device: wlo1. Please specify device in "bus:slot.func" format
bhadani@pcinpc:~/projects/AltraMayor/gatekeeper$ ifconfig
eno1: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet 172.17.19.21  netmask 255.255.252.0  broadcast 172.17.19.255
        inet6 fe80::8f1f:deb1:a8d4:a532  prefixlen 64  scopeid 0x20<link>

        ether 94:57:a5:da:7c:07  txqueuelen 1000  (Ethernet)
        RX packets 124848  bytes 152104064 (152.1 MB)

        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 87750  bytes 8279307 (8.2 MB)

        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

lo: flags=73<UP,LOOPBACK,RUNNING>  mtu 65536
        inet 127.0.0.1  netmask 255.0.0.0
        inet6 ::1  prefixlen 128  scopeid 0x10<host>
        loop  txqueuelen 1000  (Local Loopback)
        RX packets 6382  bytes 564493 (564.4 KB)

        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 6382  bytes 564493 (564.4 KB)

        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

bhadani@pcinpc:~/projects/AltraMayor/gatekeeper$

Please help in configuring it on my local.

Thanks and Regards,
Himanshu

Himanshu Bhadani

unread,
Feb 13, 2019, 9:23:59 AM2/13/19
to Linux XIA
Hey Cody,

I setup Virtual system using KVM, installed and built everything but on executing "sudo ./build/gatekeeper" i'm getting error of unknown driver issue. please have a look on logs.

bhadani@himanshu:~/projects/gatekeeper$ sudo ./dependencies/dpdk/usertools/dpdk-devbind.py --bind uio_pci_generic 00:06.0
0000:00:06.0 already bound to driver uio_pci_generic, skipping

bhadani@himanshu:~/projects/gatekeeper$  sudo ./dependencies/dpdk/usertools/dpdk-devbind.py --bind uio_pci_generic 00:07.0
0000:00:07.0 already bound to driver uio_pci_generic, skipping

bhadani@himanshu:~/projects/gatekeeper$ sudo ./build/gatekeeper
EAL: Detected 6 lcore(s)
EAL: Detected 1 NUMA nodes
EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
EAL: Probing VFIO support...
EAL: WARNING: cpu flags constant_tsc=yes nonstop_tsc=no -> using unreliable clock cycles !
EAL: PCI device 0000:00:06.0 on NUMA socket -1
EAL:   Invalid NUMA socket, default to 0
EAL:   probe driver: 1af4:1000 net_virtio
EAL: Unknown driver type for 0000:00:06.0
EAL: PCI device 0000:00:07.0 on NUMA socket -1
EAL:   Invalid NUMA socket, default to 0
EAL:   probe driver: 1af4:1000 net_virtio
EAL: Unknown driver type for 0000:00:07.0
bhadani@himanshu:~/projects/gatekeeper$ sudo ./build/gatekeeper
EAL: Detected 6 lcore(s)
EAL: Detected 1 NUMA nodes
EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
EAL: Probing VFIO support...
EAL: WARNING: cpu flags constant_tsc=yes nonstop_tsc=no -> using unreliable clock cycles !
EAL: PCI device 0000:00:06.0 on NUMA socket -1
EAL:   Invalid NUMA socket, default to 0
EAL:   probe driver: 1af4:1000 net_virtio
EAL: Unknown driver type for 0000:00:06.0
EAL: PCI device 0000:00:07.0 on NUMA socket -1
EAL:   Invalid NUMA socket, default to 0
EAL:   probe driver: 1af4:1000 net_virtio
EAL: Unknown driver type for 0000:00:07.0
bhadani@himanshu:~/projects/gatekeeper$

Thanks and Regard,

Himanshu

Cody Doucette

unread,
Feb 13, 2019, 9:34:19 AM2/13/19
to Himanshu Bhadani, Linux XIA
Hi Himanshu,

The output of DPDK during the initialization is actually OK I think. But could you show the results of the Gatekeeper log file? It should be in the repository with a time stamp after you run Gatekeeper.

Note that there are special configuration options needed when running it on a VM, as you can see on the wiki page. I updated that as recently as yesterday, so take another look if you haven’t.

Also make sure that you have the most recent version of Gatekeeper by doing a git pull.

Best,
Cody

Himanshu Bhadani

unread,
Feb 13, 2019, 9:59:32 AM2/13/19
to Cody Doucette, Linux XIA
Hi Cody,
Thanks for replying, I've attached 5-6 different logs which has been created while running gatekeeper. firstly, please go through the earliest log, rest are more or less same.

Regards,
Himanshu
gatekeeper_2019_02_13_13_13.log
gatekeeper_2019_02_13_14_18.log
gatekeeper_2019_02_13_14_25.log
gatekeeper_2019_02_13_14_19.log
gatekeeper_2019_02_13_14_30.log
gatekeeper_2019_02_13_14_31.log

Cody Doucette

unread,
Feb 13, 2019, 10:34:23 AM2/13/19
to Himanshu Bhadani, Linux XIA
Hi Himanshu,

It looks like the devices were not visible when the setup.sh script was run, either because you hadn't added them to the VM yet or because you bound them to the DPDK driver before running setup.sh. This just means that when we specify "ens6" and "ens7" in the Gatekeeper network configuration, Gatekeeper won't know that those ports exist.

You just need to add the following entries to the list in the file lua/if_map.lua:

        ["ens6"] = "0000:00:06.0",
        ["ens7"] = "0000:00:07.0",

Hope that helps,
Cody

Himanshu Bhadani

unread,
Feb 14, 2019, 2:07:09 AM2/14/19
to Cody Doucette, Linux XIA
Hey Cody,

Thanks for all your assistance. Finally I succeeded in setting up the gatekeeper, pktgen-dpdk and dpdk on KVM.
Now I'm going through the codebase of gatekeeper project and exploring the various aspect of doing experiment with it. I also went through the idea list of GSOC 2019. I'm Interested to work on Protecting the GT-GK channel as i've good background of C programming, CN and Cryptography.

I'm following the reading material suggested on the idea list page. So, just want to know, apart from reading material suggested on idea page, is there any specific suggestion you want me to follow?  
Thanks in advance.

Regards,
Himanshu

You received this message because you are subscribed to a topic in the Google Groups "Linux XIA" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/linux-xia/r1l73R31LT0/unsubscribe.
To unsubscribe from this group and all its topics, send an email to linux-xia+...@googlegroups.com.

Qiaobin Fu

unread,
Feb 14, 2019, 4:33:32 PM2/14/19
to Linux XIA
Hi Himanshu,

Glad to hear about your recent progress! That's great!

For the project Protecting the GT-GK channel, as suggested in the idea list there may be different ways to achieve the goal. As part of the project, one needs to investigate the options, check for possible sources of problems, and try to find out the most promising one. So, feel free to explore the solution space as long as you fulfill the project specification.

Moreover, you can find suggestions on writing a strong proposal from our wiki: https://github.com/AltraMayor/XIA-for-Linux/wiki/GSoC-proposal-advice

Hope this helps!

Best,
Qiaobin

Himanshu Bhadani

unread,
Feb 16, 2019, 2:36:02 AM2/16/19
to Qiaobin Fu, Linux XIA
Hi Qiaobin,

Thanks for the suggestion. Ya, I understand their's various way to achieve the target, as mentioned in the idea description, and i'll surely explore all of them and use the most promising one. 
Currently i'm going through the codebase of gatekeeper to understand the workflow. once i understand the workflow, i'll start exploring the solution area. 

I need a favour, My mid semester exam is from upcoming Monday. So, I'll be inactive till next Friday and will resume it from Saturday.

Thanks,
Himanshu.


Reply all
Reply to author
Forward
0 new messages