Re: [bigbluebutton-dev] ICE Error 1007/1002

565 views
Skip to first unread message
Message has been deleted

Reimar Bauer

unread,
Nov 2, 2020, 3:50:00 PM11/2/20
to bigblueb...@googlegroups.com
Hi

this 1002 happens often when you are behind a restrictive firewall.
Have you tried to connect by a different provider, e.g. by smartphone?

regards
Reimar

On Mon, Nov 2, 2020 at 9:07 PM Alex Khimich <khimic...@gmail.com> wrote:
>
>
> Hello.
> I'm struggling for two weeks already with ICE error 1007/1002 with no luck.
>
> I'm a teacher of anatomy and use BBB for my lessons apart from university policy to use MS Teams for covid quarantine period.
> As for me I find BBB far more convenient for lessons, I have A LOT of drawing over some pre-sampled pictures in presentations which is killing feature over Zoom & MSTeams.
>
> Before I've used version 2.2.х (not sure which "x" it was) working just fine from the box installed manually on my personal server.
> Sometimes I used to run auto-install script from Fred Dixon to fix Docker issues beyond my comprehension and it also worked like a charm.
>
> On the beginning classes in autumn semester I updated to 2.2.7 (Damn!!! Damn!!! Damn!!!) and got error with "Connection failure" (ICE error 1007).
>
> I verbatimly followed instructions "BBB behind NAT", and already tried to change local IPs to external in all mentioned configs in different variations,
> tried to change to other pre-checked stun servers, everytime re-tested with different combinations with no luck.
>
> Also, in particular in BBB 2.2.7, if I change config (/etc/bigbluebutton/nginx/sip.nginx) of nginx to external IP like instruction says:
>
> location /ws {
> proxy_pass https://(here comes my ip):7443;
> proxy_http_version 1.1;
> proxy_set_header Upgrade $http_upgrade;
> proxy_set_header Connection "Upgrade";
> proxy_read_timeout 6h;
> proxy_send_timeout 6h;
> client_body_timeout 6h;
> send_timeout 6h;
> }
>
> the error "Call timed out (ICE error 1006)" rises. The error 1006 is immediate, without period of "negotiation" both for WAN and LAN users, not as it happens with ICE error 1007.
> Also I tried other (pre-checked) stun servers, with same "no luck"
>
> In search of solution, decided to switch to alpha 2.3-dev on Ubuntu 18, settled hairpin NAT (can connect to domain name within LAN) and 2.3-dev works even better, reboots faster, reports lesser amount of errors in logs... But... only between devices in local network.
> From user of outside I still have ICE errors
>
> In BBB 2.3-dev if I change config (/etc/bigbluebutton/nginx/sip.nginx) with my WAN external address I get error from external connection "Could not make a WebSocket connection (error 1002)" both for LAN and WAN users.
>
> Despite this, 2.3-dev works just great within LAN network.
>
>
>
>
> Hardware
> --------------------------------------------------
> External static IP behind Mikrotik router.
> Ubuntu 16 and later 18 (for BBB 2.3-dev)
> CPU i7 4 cores 8 Gb RAM 60 Gb SSD (I do not record classes)
>
>
>
> Netcat
> --------------------------------------------------
> All tests with netcat between two servers are passed:
>
> netcat -l 80
> netcat -l 443
> netcat -u -l 18000 (And others ports from the range)
>
>
>
>
> bbb-conf --status (BBB 2.3-dev)
> ---------------------------------------------------
> root@srv:/# bbb-conf --status
> nginx —————————————————► [✔ - active]
> freeswitch ————————————► [✔ - active]
> redis-server ——————————► [✔ - active]
> bbb-apps-akka —————————► [✔ - active]
> bbb-fsesl-akka ————————► [✔ - active]
> mongod ————————————————► [✔ - active]
> bbb-html5 —————————————► [✔ - active]
> bbb-webrtc-sfu ————————► [✔ - active]
> kurento-media-server ——► [✔ - active]
> etherpad ——————————————► [✔ - active]
> bbb-web ———————————————► [✔ - active]
> root@srv:/#
>
>
>
>
>
> Sample of bbb-conf --debug
> (BBB 2.3-dev with default LOCAL IP in Nginx config)
> ---------------------------------------------------
> -- Errors found in /var/log/nginx/error.log --
> 2020/11/02 19:45:30 [error] 21294#21294: *1 connect() failed (111: Connection refused) while connecting to upstream, client: 192.168.1.1, server: bbb.khimich.org, request: "GET /bigbluebutton/api HTTP/1.1", upstream:
>
> "http://127.0.0.1:8090/bigbluebutton/api", host: "bbb.khimich.org"
> 2020/11/02 19:45:30 [error] 21294#21294: *1 open() "/var/www/nginx-default/50x.html" failed (2: No such file or directory), client: 192.168.1.1, server: bbb.khimich.org, request: "GET /bigbluebutton/api HTTP/1.1", upstream:
>
> "http://127.0.0.1:8090/bigbluebutton/api", host: "bbb.khimich.org"
> 2020/11/02 19:45:31 [error] 21294#21294: *3 connect() failed (111: Connection refused) while connecting to upstream, client: 192.168.1.1, server: bbb.khimich.org, request: "GET /bigbluebutton/api HTTP/1.1", upstream:
>
> "http://127.0.0.1:8090/bigbluebutton/api", host: "bbb.khimich.org"
> 2020/11/02 19:45:31 [error] 21294#21294: *3 open() "/var/www/nginx-default/50x.html" failed (2: No such file or directory), client: 192.168.1.1, server: bbb.khimich.org, request: "GET /bigbluebutton/api HTTP/1.1", upstream:
>
> "http://127.0.0.1:8090/bigbluebutton/api", host: "bbb.khimich.org"
> 2020/11/02 19:45:32 [error] 21294#21294: *5 connect() failed (111: Connection refused) while connecting to upstream, client: 192.168.1.1, server: bbb.khimich.org, request: "GET /bigbluebutton/api HTTP/1.1", upstream:
>
> "http://127.0.0.1:8090/bigbluebutton/api", host: "bbb.khimich.org"
> 2020/11/02 19:45:32 [error] 21294#21294: *5 open() "/var/www/nginx-default/50x.html" failed (2: No such file or directory), client: 192.168.1.1, server: bbb.khimich.org, request: "GET /bigbluebutton/api HTTP/1.1", upstream:
>
> "http://127.0.0.1:8090/bigbluebutton/api", host: "bbb.khimich.org"
> 2020/11/02 19:45:33 [error] 21294#21294: *7 connect() failed (111: Connection refused) while connecting to upstream, client: 192.168.1.1, server: bbb.khimich.org, request: "GET /bigbluebutton/api HTTP/1.1", upstream:
>
> "http://127.0.0.1:8090/bigbluebutton/api", host: "bbb.khimich.org"
> 2020/11/02 19:45:33 [error] 21294#21294: *7 open() "/var/www/nginx-default/50x.html" failed (2: No such file or directory), client: 192.168.1.1, server: bbb.khimich.org, request: "GET /bigbluebutton/api HTTP/1.1", upstream:
>
> "http://127.0.0.1:8090/bigbluebutton/api", host: "bbb.khimich.org"
>
>
>
>
> Sample of bbb-conf --debug
> (BBB 2.3-dev with STATIC external IP in nginx proxy_pass)
> ---------------------------------------------------
> 2020/11/02 21:36:48 [error] 25349#25349: *73 connect() failed (111: Connection refused) while connecting to upstream, client: 192.168.1.1, server: bbb.khimich.org, request: "GET /ws?sessionToken=qsqwvkddgim4poum HTTP/1.1", upstream: "https://176.241.129.239:7443/ws?sessionToken=qsqwvkddgim4poum", host: "bbb.khimich.org"
> 2020/11/02 21:36:48 [error] 25349#25349: *73 open() "/var/www/nginx-default/50x.html" failed (2: No such file or directory), client: 192.168.1.1, server: bbb.khimich.org, request: "GET /ws?sessionToken=qsqwvkddgim4poum HTTP/1.1", upstream: "https://176.241.129.239:7443/ws?sessionToken=qsqwvkddgim4poum", host: "bbb.khimich.org"
>
>
>
> ufw
> --------------------------------------------------
> Disabled
>
>
>
> IP showed here is real, same as domain name.
> Also, despite 80 & 443 & udp 16384-32768 I tried to dst-nat all kinds of TCP ports like 5060,5066,7443,5080,6379,8021,8090,3478 also with no luck.
>
> In which direction should I dig next? Thanks for advice.
>
> --
> You received this message because you are subscribed to the Google Groups "BigBlueButton-dev" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to bigbluebutton-...@googlegroups.com.
> To view this discussion on the web visit https://groups.google.com/d/msgid/bigbluebutton-dev/b4368c64-e782-4aae-a8c9-5e8b545f71b5n%40googlegroups.com.
Message has been deleted

Devrim Seral

unread,
Nov 2, 2020, 5:08:18 PM11/2/20
to BigBlueButton-dev
Dear Alex it seem that you are using  BBB 2.3-dev  which is not preferred to use in production system are you aware about this?
It is better to use BBB 2.2.x series..

Devrim 

On Monday, November 2, 2020 at 11:31:03 PM UTC+2 Alex Khimich wrote:
Yes. From different providers, public WiFi's, LTE.
Strange thing, that if desktop-PC connected via VPN and revisits bbb-server from another IP, but keeps LAN connectivity — it works.

понеділок, 2 листопада 2020 р. о 22:50:00 UTC+2 ReimarBauer пише:
Message has been deleted

Devrim Seral

unread,
Nov 3, 2020, 1:21:31 AM11/3/20
to BigBlueButton-dev
Could you send bbb-conf --check output as well 

On Tuesday, November 3, 2020 at 12:24:33 AM UTC+2 Alex Khimich wrote:
Hello  Devrim, the issue was also with 2.2.27, I used "-dev" just in hope it will go away... 

вівторок, 3 листопада 2020 р. о 00:08:18 UTC+2 dse...@gmail.com пише:

Alex Khimich

unread,
Nov 3, 2020, 5:26:09 AM11/3/20
to BigBlueButton-dev

Hello Dervim, 


BigBlueButton Server 2.3.0-dev (1323)
                    Kernel version: 4.15.0-122-generic
                      Distribution: Ubuntu 18.04.5 LTS (64-bit)
                            Memory: 8058 MB
                         CPU cores: 8

/usr/share/bbb-web/WEB-INF/classes/bigbluebutton.properties (bbb-web)
       bigbluebutton.web.serverURL: https://bbb.khimich.org
                defaultGuestPolicy: ALWAYS_ACCEPT
                 svgImagesRequired: true

/etc/nginx/sites-available/bigbluebutton (nginx)
                       server name: bbb.khimich.org
                              port: 80, [::]:80
                              port: 443 ssl

/opt/freeswitch/etc/freeswitch/vars.xml (FreeSWITCH)
                       local_ip_v4: 192.168.1.87
                   external_rtp_ip: 176.241.129.239
                   external_sip_ip: 176.241.129.239

/opt/freeswitch/etc/freeswitch/sip_profiles/external.xml (FreeSWITCH)
                        ext-rtp-ip: $${external_ip_v4}
                        ext-sip-ip: $${external_ip_v4}
                        ws-binding: :5066
                       wss-binding: 176.241.129.239:7443

/usr/local/bigbluebutton/core/scripts/bigbluebutton.yml (record and playback)
                     playback_host: bbb.khimich.org
                 playback_protocol: https
                            ffmpeg: 4.2.4-1ubuntu0.1bbb2~18.04

/etc/bigbluebutton/nginx/sip.nginx (sip.nginx)
                        proxy_pass: 176.241.129.239

/usr/local/bigbluebutton/bbb-webrtc-sfu/config/default.yml (Kurento SFU)
                        kurento.ip: 192.168.1.87
                       kurento.url: ws://127.0.0.1:8888/kurento
                    kurento.sip_ip: 192.168.1.87
                    localIpAddress: 192.168.1.87
               recordScreenSharing: true
                     recordWebcams: true
                  codec_video_main: VP8
               codec_video_content: VP8

/usr/share/meteor/bundle/programs/server/assets/app/config/settings.yml (HTML5 c                                                                                                                                                             lient)
                             build: 1250
                        kurentoUrl: wss://bbb.khimich.org/bbb-webrtc-sfu
                  enableListenOnly: true





вівторок, 3 листопада 2020 р. о 08:21:31 UTC+2 dse...@gmail.com пише:

Alex Khimich

unread,
Nov 3, 2020, 5:47:05 AM11/3/20
to BigBlueButton-dev
Well, now it WORKS...
For 2.3-dev I had to change IP directly in  /opt/freeswitch/etc/freeswitch/sip_profiles/external.xml:

ext-rtp-ip: $${external_ip_v4} => ext-rtp-ip:  176.241.129.239
ext-sip-ip: $${external_ip_v4} =>  ext-sip-ip:  176.241.129.239  
and  restart bbb.

By some strange reason variables didn't work...

I was preparing morally to bring my server to nearest colocation hosting with external IP..
Thanks for all who took care too look into discussion.  

вівторок, 3 листопада 2020 р. о 12:26:09 UTC+2 Alex Khimich пише:

Florian Erfurth

unread,
Nov 4, 2020, 3:30:24 AM11/4/20
to bigbluebutton-dev
Hello, I also have such output in bbb-conf --check

/opt/freeswitch/etc/freeswitch/sip_profiles/external.xml (FreeSWITCH)
                        ext-rtp-ip: $${external_ip_v4}
                        ext-sip-ip: $${external_ip_v4}

Is this expected or is there a bug? I'm using 2.2.23 (2106). Yeah I know, but I'll upgrade to the newest version, after I fixed the 1020-issue (still working on coturn solution).

Best regards
Floh

Alex Khimich

unread,
Nov 6, 2020, 4:59:48 PM11/6/20
to BigBlueButton-dev
* Consider that stun.freeswitch.org are not functioning at the moment
* Install stun-client and check server before writing it to config. In my case i used stun.voipbuster.com and its IP's. Current server from manual (172.217.212.127) is not working either.

середа, 4 листопада 2020 р. о 10:30:24 UTC+2 f.er...@gmail.com пише:

Alex Khimich

unread,
Nov 6, 2020, 6:38:47 PM11/6/20
to BigBlueButton-dev
Also, change stun server here:    /usr/share/bbb-web/WEB-INF/classes/spring/turn-stun-servers.xml  

пʼятниця, 6 листопада 2020 р. о 23:59:48 UTC+2 Alex Khimich пише:

Tam Hoang

unread,
Nov 12, 2020, 1:14:26 PM11/12/20
to BigBlueButton-dev
Hi Alex & all,

I am using bbb 2.3-dev
I have a server without firewall which is working fine & one server with firewall (EC2 AWS, with security bound config following the manual) which has the issue 1002.
I refer to your configuration and made some changes like below:
in /etc/kurento/modules/kurento/WebRtcEndpoint.conf.ini
stunServerAddress=77.72.169.210
stunServerPort=3478

---------------------------------------------------------------------------------------------------------------------------------------------------------- 
My bbb-conf --check:
 ubuntu@ip-172-31-30-206:~$ sudo bbb-conf --check

BigBlueButton Server 2.3.0-dev (1329)
                    Kernel version: 5.4.0-1029-aws
                      Distribution: Ubuntu 18.04.5 LTS (64-bit)
                            Memory: 16396 MB
                         CPU cores: 4

/usr/share/bbb-web/WEB-INF/classes/bigbluebutton.properties (bbb-web)
       bigbluebutton.web.serverURL: https://class-itutorlive.com
                defaultGuestPolicy: ALWAYS_ACCEPT
                 svgImagesRequired: true

/etc/nginx/sites-available/bigbluebutton (nginx)
                       server name: class-itutorlive.com
                              port: 80, [::]:80
                              port: 443 ssl

/opt/freeswitch/etc/freeswitch/vars.xml (FreeSWITCH)
                       local_ip_v4: 172.31.30.206
                   external_rtp_ip: 3.129.161.58
                   external_sip_ip: 3.129.161.58

/opt/freeswitch/etc/freeswitch/sip_profiles/external.xml (FreeSWITCH)
                        ext-rtp-ip: 3.129.161.58
                        ext-sip-ip: 3.129.161.58
                        ws-binding: :5066
                       wss-binding: 3.129.161.58:7443

/usr/local/bigbluebutton/core/scripts/bigbluebutton.yml (record and playback)
                     playback_host: class-itutorlive.com
                 playback_protocol: https
                            ffmpeg: 4.2.4-1ubuntu0.1bbb2~18.04

/etc/bigbluebutton/nginx/sip.nginx (sip.nginx)
                        proxy_pass: 3.129.161.58

/usr/local/bigbluebutton/bbb-webrtc-sfu/config/default.yml (Kurento SFU)
                        kurento.ip: 172.31.30.206 (It's really helpful if someone can help me understand the correct config here, I saw some people set it the external IP, some set internal IP,  in my working server (without firewall it uses the external IP (the public IP))
                       kurento.url: ws://127.0.0.1:8888/kurento
                    kurento.sip_ip: 172.31.30.206  (It's really helpful if someone can help me understand the correct config here, I saw some people set it the external IP, some set internal IP,  in my working server (without firewall it uses the external IP (the public IP))
                    localIpAddress: 172.31.30.206  (It's really helpful if someone can help me understand the correct config here, I saw some people set it the external IP, some set internal IP,  in my working server (without firewall it uses the external IP (the public IP))
               recordScreenSharing: true
                     recordWebcams: true
                  codec_video_main: VP8
               codec_video_content: VP8

/usr/share/meteor/bundle/programs/server/assets/app/config/settings.yml (HTML5 client)
                             build: 1250
                        kurentoUrl: wss://class-itutorlive.com/bbb-webrtc-sfu
                  enableListenOnly: true
# Potential problems described below
# IP does not match:
#                           IP from ifconfig: 172.31.30.206
#   /etc/nginx/sites-available/bigbluebutton: class-itutorlive.com
dpkg-query: no packages found matching libreoffice
# Not running:  LibreOffice

# Warning: The setting of 3.129.161.58 for proxy_pass in
#
#    /etc/bigbluebutton/nginx/sip.nginx
#
# does not match the local IP address (172.31.30.206).
# (This is OK if you've manually changed the values)
----------------------------------------------------------------------------------------------------------------------------------------------------------
@Alex: Is this what you changed in /usr/share/bbb-web/WEB-INF/classes/spring/turn-stun-servers.xml ?
<bean id="stun1" class="org.bigbluebutton.web.services.turn.StunServer"> 
        <constructor-arg index="0" value="stun.voipbuster.com"/> (old stun:stun.freeswitch.org)
    </bean>
How do you know the Google server in the manual is not working.
From what I see: stun 172.217.212.127:39072 and stun stun.voipbuster.com:3478(or stun 77.72.169.210:3478): give the same result as below (It's not like "Open" written in the manual)
ubuntu@ip-172-31-30-206:~$ stun 172.217.212.127:19302
STUN client version 0.97
Primary: Independent Mapping, Independent Filter, preserves ports, will hairpin
Return value is 0x000003
ubuntu@ip-172-31-30-206:~$ stun 77.72.169.210:3478
STUN client version 0.97
Primary: Independent Mapping, Independent Filter, preserves ports, will hairpin
Return value is 0x000003

Thank  you!

Reply all
Reply to author
Forward
0 new messages