SG crashing on launch

27 views
Skip to first unread message

Todd Freese

unread,
Nov 29, 2016, 10:24:38 AM11/29/16
to Couchbase Mobile
I am having troubles getting SG 1.3.1 to connect to CBS 4.5.1 on Linode RedHat 7. 

When launch SG I get the following using a very basic config:

/opt/couchbase-sync-gateway/bin/sync_gateway config.json 

2016-11-29T09:20:33.337-06:00 ==== Couchbase Sync Gateway/1.3.1(16;f18e833) ====

2016-11-29T09:20:33.337-06:00 requestedSoftFDLimit >= currentHardFdLimit (5000 >= 4096) capping at 4096

2016-11-29T09:20:33.337-06:00 Configured process to allow 4096 open file descriptors

2016-11-29T09:20:33.337-06:00 Opening db /kioshdb as bucket "sync_gateway", pool "default", server <http://127.0.0.1:8091>

2016-11-29T09:20:33.337-06:00 Opening Couchbase database sync_gateway on <http://127.0.0.1:8091>

_time=2016-11-29T09:20:33.357-06:00 _level=INFO _msg= Trying with selected node 0 

_time=2016-11-29T09:20:33.358-06:00 _level=INFO _msg= Trying with http://127.0.0.1:8091/pools/default/bucketsStreaming/sync_gateway 

_time=2016-11-29T09:20:33.367-06:00 _level=INFO _msg=Got new configuration for bucket sync_gateway 

_time=2016-11-29T09:20:33.395-06:00 _level=INFO _msg= Trying with selected node 0 

panic: runtime error: invalid memory address or nil pointer dereference

[signal 0xb code=0x1 addr=0x0 pc=0x4e78ea]


goroutine 1 [running]:

github.com/couchbase/sync_gateway/rest.(*ServerContext)._getOrAddDatabaseFromConfig(0xc82019ea00, 0xc8201701c0, 0xc82019ea00, 0x15acc20, 0x0, 0x0)

/home/couchbase/jenkins/workspace/sgw-unix-build@2/1.3.1/enterprise/godeps/src/github.com/couchbase/sync_gateway/rest/server_context.go:473 +0x1f9a

github.com/couchbase/sync_gateway/rest.(*ServerContext).getOrAddDatabaseFromConfig(0xc82019ea00, 0xc8201701c0, 0x406a00, 0x0, 0x0, 0x0)

/home/couchbase/jenkins/workspace/sgw-unix-build@2/1.3.1/enterprise/godeps/src/github.com/couchbase/sync_gateway/rest/server_context.go:254 +0xa4

github.com/couchbase/sync_gateway/rest.(*ServerContext).AddDatabaseFromConfig(0xc82019ea00, 0xc8201701c0, 0xc82014be40, 0x0, 0x0)

/home/couchbase/jenkins/workspace/sgw-unix-build@2/1.3.1/enterprise/godeps/src/github.com/couchbase/sync_gateway/rest/server_context.go:650 +0x3c

github.com/couchbase/sync_gateway/rest.RunServer(0xc8201698c0)

/home/couchbase/jenkins/workspace/sgw-unix-build@2/1.3.1/enterprise/godeps/src/github.com/couchbase/sync_gateway/rest/config.go:676 +0x328

github.com/couchbase/sync_gateway/rest.ServerMain(0xc800000000)

/home/couchbase/jenkins/workspace/sgw-unix-build@2/1.3.1/enterprise/godeps/src/github.com/couchbase/sync_gateway/rest/config.go:735 +0x3a

main.main()

/home/couchbase/jenkins/workspace/sgw-unix-build@2/1.3.1/enterprise/godeps/src/github.com/couchbase/sync_gateway/main.go:34 +0x133


goroutine 17 [syscall, locked to thread]:

runtime.goexit()

/usr/local/go/src/runtime/asm_amd64.s:1721 +0x1


goroutine 5 [syscall]:

os/signal.loop()

/usr/local/go/src/os/signal/signal_unix.go:22 +0x18

created by os/signal.init.1

/usr/local/go/src/os/signal/signal_unix.go:28 +0x37


goroutine 18 [select, locked to thread]:

runtime.gopark(0xf842b8, 0xc820022728, 0xd49e40, 0x6, 0x42e518, 0x2)

/usr/local/go/src/runtime/proc.go:185 +0x163

runtime.selectgoImpl(0xc820022728, 0x0, 0x18)

/usr/local/go/src/runtime/select.go:392 +0xa64

runtime.selectgo(0xc820022728)

/usr/local/go/src/runtime/select.go:212 +0x12

runtime.ensureSigM.func1()

/usr/local/go/src/runtime/signal1_unix.go:227 +0x353

runtime.goexit()

/usr/local/go/src/runtime/asm_amd64.s:1721 +0x1


goroutine 19 [chan receive]:

main.main.func1(0xc82017a960)

/home/couchbase/jenkins/workspace/sgw-unix-build@2/1.3.1/enterprise/godeps/src/github.com/couchbase/sync_gateway/main.go:28 +0x51

created by main.main

/home/couchbase/jenkins/workspace/sgw-unix-build@2/1.3.1/enterprise/godeps/src/github.com/couchbase/sync_gateway/main.go:32 +0x12a


goroutine 21 [IO wait]:

net.runtime_pollWait(0x7fc7095794d0, 0x72, 0xc82000e180)

/usr/local/go/src/runtime/netpoll.go:157 +0x60

net.(*pollDesc).Wait(0xc8201ab790, 0x72, 0x0, 0x0)

/usr/local/go/src/net/fd_poll_runtime.go:73 +0x3a

net.(*pollDesc).WaitRead(0xc8201ab790, 0x0, 0x0)

/usr/local/go/src/net/fd_poll_runtime.go:78 +0x36

net.(*netFD).Read(0xc8201ab730, 0xc8201c8000, 0x1000, 0x1000, 0x0, 0x7fc70c3c3050, 0xc82000e180)

/usr/local/go/src/net/fd_unix.go:232 +0x23a

net.(*conn).Read(0xc820102208, 0xc8201c8000, 0x1000, 0x1000, 0x0, 0x0, 0x0)

/usr/local/go/src/net/net.go:172 +0xe4

net/http.noteEOFReader.Read(0x7fc709579c80, 0xc820102208, 0xc82016a478, 0xc8201c8000, 0x1000, 0x1000, 0x0, 0x0, 0x0)

/usr/local/go/src/net/http/transport.go:1370 +0x67

net/http.(*noteEOFReader).Read(0xc820199700, 0xc8201c8000, 0x1000, 0x1000, 0x0, 0x0, 0x0)

<autogenerated>:126 +0xd0

bufio.(*Reader).fill(0xc82017b320)

/usr/local/go/src/bufio/bufio.go:97 +0x1e9

bufio.(*Reader).Peek(0xc82017b320, 0x1, 0x0, 0x0, 0x0, 0x0, 0x0)

/usr/local/go/src/bufio/bufio.go:132 +0xcc

net/http.(*persistConn).readLoop(0xc82016a420)

/usr/local/go/src/net/http/transport.go:876 +0xf7

created by net/http.(*Transport).dialConn

/usr/local/go/src/net/http/transport.go:685 +0xc78


goroutine 22 [select]:

net/http.(*persistConn).writeLoop(0xc82016a420)

/usr/local/go/src/net/http/transport.go:1009 +0x40c

created by net/http.(*Transport).dialConn

/usr/local/go/src/net/http/transport.go:686 +0xc9d


goroutine 7 [IO wait]:

net.runtime_pollWait(0x7fc709579350, 0x72, 0xc82000e180)

/usr/local/go/src/runtime/netpoll.go:157 +0x60

net.(*pollDesc).Wait(0xc8201e0760, 0x72, 0x0, 0x0)

/usr/local/go/src/net/fd_poll_runtime.go:73 +0x3a

net.(*pollDesc).WaitRead(0xc8201e0760, 0x0, 0x0)

/usr/local/go/src/net/fd_poll_runtime.go:78 +0x36

net.(*netFD).Read(0xc8201e0700, 0xc8202cc000, 0x1000, 0x1000, 0x0, 0x7fc70c3c3050, 0xc82000e180)

/usr/local/go/src/net/fd_unix.go:232 +0x23a

net.(*conn).Read(0xc82002a0d0, 0xc8202cc000, 0x1000, 0x1000, 0x0, 0x0, 0x0)

/usr/local/go/src/net/net.go:172 +0xe4

net/http.noteEOFReader.Read(0x7fc709579c80, 0xc82002a0d0, 0xc8201fe268, 0xc8202cc000, 0x1000, 0x1000, 0x0, 0x0, 0x0)

/usr/local/go/src/net/http/transport.go:1370 +0x67

net/http.(*noteEOFReader).Read(0xc8202b0c00, 0xc8202cc000, 0x1000, 0x1000, 0xb3, 0x0, 0x0)

<autogenerated>:126 +0xd0

bufio.(*Reader).fill(0xc820018ae0)

/usr/local/go/src/bufio/bufio.go:97 +0x1e9

bufio.(*Reader).ReadSlice(0xc820018ae0, 0x43470a, 0x0, 0x0, 0x0, 0x0, 0x0)

/usr/local/go/src/bufio/bufio.go:328 +0x21a

net/http/internal.readLine(0xc820018ae0, 0x0, 0x0, 0x0, 0x0, 0x0)

/usr/local/go/src/net/http/internal/chunked.go:110 +0x4b

net/http/internal.(*chunkedReader).beginChunk(0xc8201a8e70)

/usr/local/go/src/net/http/internal/chunked.go:47 +0x39

net/http/internal.(*chunkedReader).Read(0xc8201a8e70, 0xc8202d2004, 0x3dfc, 0x3dfc, 0x0, 0x0, 0x0)

/usr/local/go/src/net/http/internal/chunked.go:77 +0xb7

net/http.(*body).readLocked(0xc82019ecc0, 0xc8202d2004, 0x3dfc, 0x3dfc, 0xc800000000, 0x0, 0x0)

/usr/local/go/src/net/http/transfer.go:632 +0x98

net/http.(*body).Read(0xc82019ecc0, 0xc8202d2004, 0x3dfc, 0x3dfc, 0x0, 0x0, 0x0)

/usr/local/go/src/net/http/transfer.go:624 +0x110

net/http.(*bodyEOFSignal).Read(0xc82019ed00, 0xc8202d2004, 0x3dfc, 0x3dfc, 0x0, 0x0, 0x0)

/usr/local/go/src/net/http/transport.go:1296 +0x26a

encoding/json.(*Decoder).refill(0xc8201869c0, 0x0, 0x0)

/usr/local/go/src/encoding/json/stream.go:152 +0x287

encoding/json.(*Decoder).readValue(0xc8201869c0, 0x1, 0x0, 0x0)

/usr/local/go/src/encoding/json/stream.go:128 +0x41b

encoding/json.(*Decoder).Decode(0xc8201869c0, 0xa8d620, 0xc820102210, 0x0, 0x0)

/usr/local/go/src/encoding/json/stream.go:57 +0x159

github.com/couchbase/go-couchbase.(*Bucket).UpdateBucket(0xc820268380, 0x0, 0x0)

/home/couchbase/jenkins/workspace/sgw-unix-build@2/1.3.1/enterprise/godeps/src/github.com/couchbase/go-couchbase/streaming.go:139 +0xd0f

github.com/couchbase/go-couchbase.(*Bucket).RunBucketUpdater.func1(0xc820268380, 0xc8202ae960)

/home/couchbase/jenkins/workspace/sgw-unix-build@2/1.3.1/enterprise/godeps/src/github.com/couchbase/go-couchbase/streaming.go:61 +0x25

created by github.com/couchbase/go-couchbase.(*Bucket).RunBucketUpdater

/home/couchbase/jenkins/workspace/sgw-unix-build@2/1.3.1/enterprise/godeps/src/github.com/couchbase/go-couchbase/streaming.go:68 +0x3f


goroutine 11 [select]:

net/http.(*persistConn).readLoop(0xc8201fe210)

/usr/local/go/src/net/http/transport.go:976 +0xac7

created by net/http.(*Transport).dialConn

/usr/local/go/src/net/http/transport.go:685 +0xc78


goroutine 12 [select]:

net/http.(*persistConn).writeLoop(0xc8201fe210)

/usr/local/go/src/net/http/transport.go:1009 +0x40c

created by net/http.(*Transport).dialConn

/usr/local/go/src/net/http/transport.go:686 +0xc9d


goroutine 37 [runnable]:

net/http.(*persistConn).writeLoop(0xc8200d53f0)

/usr/local/go/src/net/http/transport.go:1009 +0x40c

created by net/http.(*Transport).dialConn

/usr/local/go/src/net/http/transport.go:686 +0xc9d

an...@couchbase.com

unread,
Nov 29, 2016, 12:24:36 PM11/29/16
to Couchbase Mobile
For completeness can you post your config on this thread, it will save time trying to reproduce the panic.

If you open the Couchbase Server admin console on http://localhost:8091/, is there any indication of an error with any of the CBS cluster servers in the 'Log' TAB?

Andy


Todd Freese

unread,
Nov 29, 2016, 1:09:39 PM11/29/16
to Couchbase Mobile
No errors in the CBS log via the admin.

Here is my SG Config.

{
        "interface":"45.33.39.219:4984",
        "adminInterface":"45.33.39.219:4985",
        "databases": {
                "kioshdb": {
                        "server": "http://45.33.39.219:8091",
                        "bucket": "sync_gateway",
                        "log": ["HTTP", "REST+", "CRUD", "Access"],
                        "users": {
                                "GUEST": {"disabled": true},
                                "toddfreese": {"password": "cwfcwf", "all_channels": ["toddfreese"]}
                        },
                        "unsupported": {
                          "user_views": {
                             "enabled":true
                          }
                        },
                        "sync":`function(doc) {channel("toddfreese"); access("toddfreese", "toddfreese");}`
                }
        }
}

Todd Freese

unread,
Nov 29, 2016, 6:43:42 PM11/29/16
to Couchbase Mobile
I downgraded to SG 1.3 and it's connecting with no problems. So issue is only in 1.3.1.

T
Reply all
Reply to author
Forward
0 new messages