502, GitLab is not responding.
1,936 views
Skip to first unread message
Jeroen de Neef
Jun 26, 2015, 6:26:25 PM6/26/15
to gitl...@googlegroups.com
Running CentOS 6.6 with the currently latest GitLab installation gitlab-ce.x86_64 0:7.12.0~omnibus.1-1 using YUM.
I am also getting the following error when trying to contact pull commits via Git.
GitLab: Failed to authorize your Git request: internal API unreachable
It seems to be stuck in a loop.
==> /var/log/gitlab/logrotate/logrotate.status <== "/var/log/gitlab/gitlab-shell//gitlab-shell.log" 2015-6-26-0:55:51 "/var/log/gitlab/gitlab-rails/application.log" 2015-6-26-0:55:51 "/var/log/gitlab/nginx/error.log" 2015-6-26-0:55:51 "/var/log/gitlab/gitlab-rails/satellites.log" 2015-6-26-0:55:51 "/var/log/gitlab/unicorn/unicorn_stdout.log" 2015-6-26-0:55:51 "/var/log/gitlab/nginx/gitlab_access.log" 2015-6-26-0:55:51 "/var/log/gitlab/unicorn/unicorn_stderr.log" 2015-6-26-0:55:51 "/var/log/gitlab/nginx/gitlab_ci_access.log" 2015-6-26-0:55:51 "/var/log/gitlab/gitlab-rails/sidekiq.log" 2015-5-16-5:0:0 "/var/log/gitlab/gitlab-rails/production.log" 2015-6-26-0:55:51 ==> /var/log/gitlab/logrotate/current <== ==> /var/log/gitlab/unicorn/unicorn_stdout.log <== ==> /var/log/gitlab/unicorn/current <== 2015-06-26_22:18:13.76605 master failed to start, check stderr log for details 2015-06-26_22:18:14.77384 failed to start a new unicorn master 2015-06-26_22:18:14.80597 starting new unicorn master 2015-06-26_22:18:23.62873 master failed to start, check stderr log for details 2015-06-26_22:18:24.63576 failed to start a new unicorn master 2015-06-26_22:18:24.70112 starting new unicorn master 2015-06-26_22:18:33.22564 master failed to start, check stderr log for details 2015-06-26_22:18:34.23004 failed to start a new unicorn master 2015-06-26_22:18:34.29645 starting new unicorn master 2015-06-26_22:18:42.77644 master failed to start, check stderr log for details ==> /var/log/gitlab/unicorn/state <== ==> /var/log/gitlab/unicorn/unicorn_stderr.log <== from /opt/gitlab/embedded/service/gitlab-rails/config.ru:1:in `new' from /opt/gitlab/embedded/service/gitlab-rails/config.ru:1:in `<main>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn.rb:48:in `eval' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn.rb:48:in `block in builder' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn/http_server.rb:722:in `call' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn/http_server.rb:722:in `build_app!' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn/http_server.rb:140:in `start' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/bin/unicorn:126:in `<top (required)>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/bin/unicorn:23:in `load' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/bin/unicorn:23:in `<main>' ==> /var/log/gitlab/ci-sidekiq/current <== 2014-12-25_22:34:03.31110 2014-12-25T22:34:03Z 18341 TID-s7i84 INFO: Pushed 0 messages back to Redis 2014-12-25_22:34:03.31157 2014-12-25T22:34:03Z 18341 TID-s7i84 INFO: Pushed 0 messages back to Redis 2014-12-25_22:34:03.31201 2014-12-25T22:34:03Z 18341 TID-s7i84 INFO: Pushed 0 messages back to Redis 2014-12-25_22:34:03.31250 2014-12-25T22:34:03Z 18341 TID-s7i84 INFO: Pushed 0 messages back to Redis 2014-12-25_22:34:03.31318 2014-12-25T22:34:03Z 18341 TID-s7i84 INFO: Pushed 0 messages back to Redis 2014-12-25_22:34:03.31376 2014-12-25T22:34:03Z 18341 TID-s7i84 INFO: Pushed 0 messages back to Redis 2014-12-25_22:34:03.31431 2014-12-25T22:34:03Z 18341 TID-s7i84 INFO: Pushed 0 messages back to Redis 2014-12-25_22:34:03.31484 2014-12-25T22:34:03Z 18341 TID-s7i84 INFO: Pushed 0 messages back to Redis 2014-12-25_22:34:03.31542 2014-12-25T22:34:03Z 18341 TID-s7i84 INFO: Pushed 0 messages back to Redis 2014-12-25_22:34:03.32363 2014-12-25T22:34:03Z 18341 TID-s7i84 INFO: Pushed 0 messages back to Redis ==> /var/log/gitlab/ci-sidekiq/state <== ==> /var/log/gitlab/nginx/current <== ==> /var/log/gitlab/nginx/gitlab_ci_access.log <== ==> /var/log/gitlab/nginx/state <== ==> /var/log/gitlab/nginx/gitlab_ci_error.log <== ==> /var/log/gitlab/nginx/gitlab_error.log <== 2015/06/27 00:09:21 [error] 9586#0: *27 connect() to unix:/var/opt/gitlab/gitlab-rails/sockets/gitlab.socket failed (111: Connection refused) while connecting to upstream, client: 127.0.0.1, server: git.jeroendeneef.com, request: "GET /sona/sona-cnr/issues HTTP/1.1", upstream: "http://unix:/var/opt/gitlab/gitlab-rails/sockets/gitlab.socket:/sona/sona-cnr/issues", host: "git.jeroendeneef.com" 2015/06/27 00:09:21 [error] 9585#0: *3 connect() to unix:/var/opt/gitlab/gitlab-rails/sockets/gitlab.socket failed (111: Connection refused) while connecting to upstream, client: 127.0.0.1, server: git.jeroendeneef.com, request: "GET /sona/sona-cnr/issues HTTP/1.1", upstream: "http://unix:/var/opt/gitlab/gitlab-rails/sockets/gitlab.socket:/sona/sona-cnr/issues", host: "git.jeroendeneef.com" 2015/06/27 00:09:22 [error] 9585#0: *7 connect() to unix:/var/opt/gitlab/gitlab-rails/sockets/gitlab.socket failed (111: Connection refused) while connecting to upstream, client: 127.0.0.1, server: git.jeroendeneef.com, request: "GET /sona/sona-cnr/issues HTTP/1.1", upstream: "http://unix:/var/opt/gitlab/gitlab-rails/sockets/gitlab.socket:/sona/sona-cnr/issues", host: "git.jeroendeneef.com" 2015/06/27 00:09:57 [error] 9586#0: *17 connect() to unix:/var/opt/gitlab/gitlab-rails/sockets/gitlab.socket failed (111: Connection refused) while connecting to upstream, client: 127.0.0.1, server: git.jeroendeneef.com, request: "GET /sona/sona-cnr/issues HTTP/1.1", upstream: "http://unix:/var/opt/gitlab/gitlab-rails/sockets/gitlab.socket:/sona/sona-cnr/issues", host: "git.jeroendeneef.com" 2015/06/27 00:12:46 [error] 9586#0: *45 connect() to unix:/var/opt/gitlab/gitlab-rails/sockets/gitlab.socket failed (111: Connection refused) while connecting to upstream, client: 127.0.0.1, server: git.jeroendeneef.com, request: "GET /Jeroen/rcrp-faction-badge-system/issues?assignee_id=1&author_id=0&label_name=text%2Cfeaturerequest&milestone_id=1&scope=all&sort=created_desc&state=opened HTTP/1.1", upstream: "http://unix:/var/opt/gitlab/gitlab-rails/sockets/gitlab.socket:/Jeroen/rcrp-faction-badge-system/issues?assignee_id=1&author_id=0&label_name=text%2Cfeaturerequest&milestone_id=1&scope=all&sort=created_desc&state=opened", host: "git.jeroendeneef.com" 2015/06/27 00:14:34 [error] 9586#0: *47 connect() to unix:/var/opt/gitlab/gitlab-rails/sockets/gitlab.socket failed (111: Connection refused) while connecting to upstream, client: 127.0.0.1, server: git.jeroendeneef.com, request: "GET /gamergate/gamergateop/tree/8bf3ad634b97f7a6553a4670ebf26c478faab410/Operations HTTP/1.1", upstream: "http://unix:/var/opt/gitlab/gitlab-rails/sockets/gitlab.socket:/gamergate/gamergateop/tree/8bf3ad634b97f7a6553a4670ebf26c478faab410/Operations", host: "git.jeroendeneef.com" 2015/06/27 00:15:11 [error] 9586#0: *49 connect() to unix:/var/opt/gitlab/gitlab-rails/sockets/gitlab.socket failed (111: Connection refused) while connecting to upstream, client: 127.0.0.1, server: git.jeroendeneef.com, request: "GET /gamergate/gamergateop/tree/b32ea9033d67a72fef02a48b748a61974d25d0e6 HTTP/1.1", upstream: "http://unix:/var/opt/gitlab/gitlab-rails/sockets/gitlab.socket:/gamergate/gamergateop/tree/b32ea9033d67a72fef02a48b748a61974d25d0e6", host: "git.jeroendeneef.com" 2015/06/27 00:15:51 [error] 9586#0: *51 connect() to unix:/var/opt/gitlab/gitlab-rails/sockets/gitlab.socket failed (111: Connection refused) while connecting to upstream, client: 127.0.0.1, server: git.jeroendeneef.com, request: "GET /Jeroen/rcrp-faction-badge-system/network/0.1.0-alpha6 HTTP/1.1", upstream: "http://unix:/var/opt/gitlab/gitlab-rails/sockets/gitlab.socket:/Jeroen/rcrp-faction-badge-system/network/0.1.0-alpha6", host: "git.jeroendeneef.com" 2015/06/27 00:16:57 [error] 9586#0: *53 connect() to unix:/var/opt/gitlab/gitlab-rails/sockets/gitlab.socket failed (111: Connection refused) while connecting to upstream, client: 127.0.0.1, server: git.jeroendeneef.com, request: "GET /Jeroen/rcrp-faction-badge-system/issues?assignee_id=0&author_id=&label_name=featurerequest&milestone_id=0&scope=all&sort=oldest&state=opened HTTP/1.1", upstream: "http://unix:/var/opt/gitlab/gitlab-rails/sockets/gitlab.socket:/Jeroen/rcrp-faction-badge-system/issues?assignee_id=0&author_id=&label_name=featurerequest&milestone_id=0&scope=all&sort=oldest&state=opened", host: "git.jeroendeneef.com" 2015/06/27 00:17:48 [error] 9586#0: *55 connect() to unix:/var/opt/gitlab/gitlab-rails/sockets/gitlab.socket failed (111: Connection refused) while connecting to upstream, client: 127.0.0.1, server: git.jeroendeneef.com, request: "GET /gamergate/gamergateop/blob/master/Operations/Operation-Vox-Populi/Vox-Media-Advertisers.md HTTP/1.1", upstream: "http://unix:/var/opt/gitlab/gitlab-rails/sockets/gitlab.socket:/gamergate/gamergateop/blob/master/Operations/Operation-Vox-Populi/Vox-Media-Advertisers.md", host: "git.jeroendeneef.com" ==> /var/log/gitlab/nginx/gitlab_access.log <== 127.0.0.1 - - [27/Jun/2015:00:09:22 +0200] "GET /static.css HTTP/1.1" 304 0 "https://git.jeroendeneef.com/sona/sona-cnr/issues" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.130 Safari/537.36" 127.0.0.1 - - [27/Jun/2015:00:09:57 +0200] "GET /sona/sona-cnr/issues HTTP/1.1" 502 429 "-" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.130 Safari/537.36" 127.0.0.1 - - [27/Jun/2015:00:09:57 +0200] "GET /static.css HTTP/1.1" 304 0 "https://git.jeroendeneef.com/sona/sona-cnr/issues" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.130 Safari/537.36" 127.0.0.1 - - [27/Jun/2015:00:09:57 +0200] "GET /favicon.ico HTTP/1.1" 200 32988 "https://git.jeroendeneef.com/sona/sona-cnr/issues" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.130 Safari/537.36" 127.0.0.1 - - [27/Jun/2015:00:12:46 +0200] "GET /Jeroen/rcrp-faction-badge-system/issues?assignee_id=1&author_id=0&label_name=text%2Cfeaturerequest&milestone_id=1&scope=all&sort=created_desc&state=opened HTTP/1.1" 502 429 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)" 127.0.0.1 - - [27/Jun/2015:00:14:34 +0200] "GET /gamergate/gamergateop/tree/8bf3ad634b97f7a6553a4670ebf26c478faab410/Operations HTTP/1.1" 502 429 "-" "Mozilla/5.0 (compatible; AhrefsBot/5.0; +http://ahrefs.com/robot/)" 127.0.0.1 - - [27/Jun/2015:00:15:11 +0200] "GET /gamergate/gamergateop/tree/b32ea9033d67a72fef02a48b748a61974d25d0e6 HTTP/1.1" 502 429 "-" "Mozilla/5.0 (compatible; AhrefsBot/5.0; +http://ahrefs.com/robot/)" 127.0.0.1 - - [27/Jun/2015:00:15:51 +0200] "GET /Jeroen/rcrp-faction-badge-system/network/0.1.0-alpha6 HTTP/1.1" 502 429 "-" "Mozilla/5.0 (compatible; AhrefsBot/5.0; +http://ahrefs.com/robot/)" 127.0.0.1 - - [27/Jun/2015:00:16:57 +0200] "GET /Jeroen/rcrp-faction-badge-system/issues?assignee_id=0&author_id=&label_name=featurerequest&milestone_id=0&scope=all&sort=oldest&state=opened HTTP/1.1" 502 429 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)" 127.0.0.1 - - [27/Jun/2015:00:17:48 +0200] "GET /gamergate/gamergateop/blob/master/Operations/Operation-Vox-Populi/Vox-Media-Advertisers.md HTTP/1.1" 502 429 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)" ==> /var/log/gitlab/nginx/error.log <== ==> /var/log/gitlab/ci-unicorn/unicorn_stdout.log <== ==> /var/log/gitlab/ci-unicorn/current <== 2014-12-25_22:31:39.28760 starting new unicorn master 2014-12-25_22:31:44.43013 adopted new unicorn master 17665 2014-12-25_22:33:35.55775 forwarding TERM to unicorn master 17665 2014-12-25_22:33:35.55805 forwarding CONT to unicorn master 17665 2014-12-25_22:33:36.55928 wrapper for unicorn master 17665 exiting 2014-12-25_22:33:45.41385 starting new unicorn master 2014-12-25_22:33:50.85789 adopted new unicorn master 18371 2014-12-25_22:34:09.87926 forwarding TERM to unicorn master 18371 2014-12-25_22:34:09.87931 forwarding CONT to unicorn master 18371 2014-12-25_22:34:10.88064 wrapper for unicorn master 18371 exiting ==> /var/log/gitlab/ci-unicorn/state <== ==> /var/log/gitlab/ci-unicorn/unicorn_stderr.log <== I, [2014-12-25T23:33:49.802811 #18371] INFO -- : unlinking existing socket=/var/opt/gitlab/gitlab-ci/sockets/gitlab.socket I, [2014-12-25T23:33:49.802946 #18371] INFO -- : listening on addr=/var/opt/gitlab/gitlab-ci/sockets/gitlab.socket fd=12 I, [2014-12-25T23:33:49.809125 #18445] INFO -- : worker=0 spawned pid=18445 I, [2014-12-25T23:33:49.809654 #18445] INFO -- : worker=0 ready I, [2014-12-25T23:33:49.814194 #18371] INFO -- : master process ready I, [2014-12-25T23:33:49.815234 #18448] INFO -- : worker=1 spawned pid=18448 I, [2014-12-25T23:33:49.815777 #18448] INFO -- : worker=1 ready I, [2014-12-25T23:34:09.979961 #18371] INFO -- : reaped #<Process::Status: pid 18445 exit 0> worker=0 I, [2014-12-25T23:34:09.980103 #18371] INFO -- : reaped #<Process::Status: pid 18448 exit 0> worker=1 I, [2014-12-25T23:34:09.980206 #18371] INFO -- : master complete ==> /var/log/gitlab/redis/current <== 2015-06-26_22:09:13.96791 `-._ `-._`-.__.-'_.-' _.-' 2015-06-26_22:09:13.96792 `-._ `-.__.-' _.-' 2015-06-26_22:09:13.96792 `-._ _.-' 2015-06-26_22:09:13.96793 `-.__.-' 2015-06-26_22:09:13.96793 2015-06-26_22:09:13.96793 [9622] 27 Jun 00:09:13.967 # Server started, Redis version 2.8.20 2015-06-26_22:09:13.96796 [9622] 27 Jun 00:09:13.967 # WARNING overcommit_memory is set to 0! Background save may fail under low memory condition. To fix this issue add 'vm.overcommit_memory = 1' to /etc/sysctl.conf and then reboot or run the command 'sysctl vm.overcommit_memory=1' for this to take effect. 2015-06-26_22:09:13.96800 [9622] 27 Jun 00:09:13.967 # WARNING: The TCP backlog setting of 511 cannot be enforced because /proc/sys/net/core/somaxconn is set to the lower value of 128. 2015-06-26_22:09:14.05474 [9622] 27 Jun 00:09:14.054 * DB loaded from disk: 0.087 seconds 2015-06-26_22:09:14.05478 [9622] 27 Jun 00:09:14.054 * The server is now ready to accept connections at /var/opt/gitlab/redis/redis.socket ==> /var/log/gitlab/redis/state <== ==> /var/log/gitlab/gitlab-ci/production.log <== ==> /var/log/gitlab/gitlab-rails/application.log <== ==> /var/log/gitlab/gitlab-rails/production.log <== Parameters: {"view"=>"parallel", "namespace_id"=>"gamergate", "project_id"=>"gamergateop", "id"=>"a9df47c8e35e673ce912098b00f6135594fe0973"} Completed 200 OK in 946ms (Views: 502.8ms | ActiveRecord: 11.8ms) Started GET "/Jeroen/rcrp-faction-badge-system/issues?assignee_id=1&author_id=0&label_name=curve%2Cfeaturerequest&milestone_id=0&scope=all&sort=created_desc&state=opened" for 66.249.64.198 at 2015-06-26 04:58:47 +0200 Processing by Projects::IssuesController#index as HTML Parameters: {"assignee_id"=>"1", "author_id"=>"0", "label_name"=>"curve,featurerequest", "milestone_id"=>"0", "scope"=>"all", "sort"=>"created_desc", "state"=>"opened", "namespace_id"=>"Jeroen", "project_id"=>"rcrp-faction-badge-system"} Completed 200 OK in 93ms (Views: 58.6ms | ActiveRecord: 11.3ms) Started GET "/Jeroen/rcrp-faction-badge-system/merge_requests?assignee_id=1&author_id=0&label_name=text%2Ccurve%2Cfeaturerequest&milestone_id=&scope=all&sort=created_desc&state=opened" for 66.249.64.193 at 2015-06-26 05:02:34 +0200 Processing by Projects::MergeRequestsController#index as HTML Parameters: {"assignee_id"=>"1", "author_id"=>"0", "label_name"=>"text,curve,featurerequest", "milestone_id"=>"", "scope"=>"all", "sort"=>"created_desc", "state"=>"opened", "namespace_id"=>"Jeroen", "project_id"=>"rcrp-faction-badge-system"} Completed 200 OK in 2862ms (Views: 1441.0ms | ActiveRecord: 186.0ms) ==> /var/log/gitlab/gitlab-rails/satellites.log <== ==> /var/log/gitlab/gitlab-rails/githost.log <== ==> /var/log/gitlab/gitlab-shell/gitlab-shell.log <== W, [2015-06-27T00:13:59.110647 #19415] WARN -- : Failed to connect to internal API <POST http://127.0.0.1:8080/api/v3/internal/allowed>: #<Errno::ECONNREFUSED: Connection refused - connect(2) for "127.0.0.1" port 8080> W, [2015-06-27T00:14:03.120953 #19549] WARN -- : Failed to connect to internal API <POST http://127.0.0.1:8080/api/v3/internal/allowed>: #<Errno::ECONNREFUSED: Connection refused - connect(2) for "127.0.0.1" port 8080> W, [2015-06-27T00:14:07.124467 #19651] WARN -- : Failed to connect to internal API <POST http://127.0.0.1:8080/api/v3/internal/allowed>: #<Errno::ECONNREFUSED: Connection refused - connect(2) for "127.0.0.1" port 8080> W, [2015-06-27T00:14:19.976552 #19918] WARN -- : Failed to connect to internal API <POST http://127.0.0.1:8080/api/v3/internal/allowed>: #<Errno::ECONNREFUSED: Connection refused - connect(2) for "127.0.0.1" port 8080> W, [2015-06-27T00:14:24.005003 #20021] WARN -- : Failed to connect to internal API <POST http://127.0.0.1:8080/api/v3/internal/allowed>: #<Errno::ECONNREFUSED: Connection refused - connect(2) for "127.0.0.1" port 8080> W, [2015-06-27T00:14:30.640667 #20158] WARN -- : Failed to connect to internal API <POST http://127.0.0.1:8080/api/v3/internal/allowed>: #<Errno::ECONNREFUSED: Connection refused - connect(2) for "127.0.0.1" port 8080> W, [2015-06-27T00:14:40.033113 #20372] WARN -- : Failed to connect to internal API <POST http://127.0.0.1:8080/api/v3/internal/allowed>: #<Errno::ECONNREFUSED: Connection refused - connect(2) for "127.0.0.1" port 8080> W, [2015-06-27T00:14:47.566002 #20525] WARN -- : Failed to connect to internal API <POST http://127.0.0.1:8080/api/v3/internal/allowed>: #<Errno::ECONNREFUSED: Connection refused - connect(2) for "127.0.0.1" port 8080> W, [2015-06-27T00:14:51.515633 #20588] WARN -- : Failed to connect to internal API <POST http://127.0.0.1:8080/api/v3/internal/allowed>: #<Errno::ECONNREFUSED: Connection refused - connect(2) for "127.0.0.1" port 8080> W, [2015-06-27T00:18:41.841584 #27097] WARN -- : Failed to connect to internal API <POST http://127.0.0.1:8080/api/v3/internal/allowed>: #<Errno::ECONNREFUSED: Connection refused - connect(2) for "127.0.0.1" port 8080> ==> /var/log/gitlab/postgresql/current <== 2015-06-26_22:08:50.30962 LOG: autovacuum launcher started 2015-06-26_22:09:12.30913 received TERM from runit, sending INT instead to force quit connections 2015-06-26_22:09:12.56600 LOG: received fast shutdown request 2015-06-26_22:09:12.56606 LOG: aborting any active transactions 2015-06-26_22:09:12.56607 LOG: autovacuum launcher shutting down 2015-06-26_22:09:12.56729 LOG: shutting down 2015-06-26_22:09:13.15553 LOG: database system is shut down 2015-06-26_22:09:13.74714 LOG: database system was shut down at 2015-06-26 22:09:12 GMT 2015-06-26_22:09:13.96578 LOG: database system is ready to accept connections 2015-06-26_22:09:13.96714 LOG: autovacuum launcher started ==> /var/log/gitlab/postgresql/state <== ==> /var/log/gitlab/ci-redis/current <== 2014-12-25_22:33:44.59130 [18336] 25 Dec 23:33:44.591 # WARNING overcommit_memory is set to 0! Background save may fail under low memory condition. To fix this issue add 'vm.overcommit_memory = 1' to /etc/sysctl.conf and then reboot or run the command 'sysctl vm.overcommit_memory=1' for this to take effect. 2014-12-25_22:33:44.59135 [18336] 25 Dec 23:33:44.591 * DB loaded from disk: 0.000 seconds 2014-12-25_22:33:44.59135 [18336] 25 Dec 23:33:44.591 * The server is now ready to accept connections on port 0 2014-12-25_22:33:44.59136 [18336] 25 Dec 23:33:44.591 * The server is now ready to accept connections at /var/opt/gitlab/ci-redis/redis.socket 2014-12-25_22:33:59.30897 [18336 | signal handler] (1419546839) Received SIGTERM, scheduling shutdown... 2014-12-25_22:33:59.31619 [18336] 25 Dec 23:33:59.316 # User requested shutdown... 2014-12-25_22:33:59.31621 [18336] 25 Dec 23:33:59.316 * Saving the final RDB snapshot before exiting. 2014-12-25_22:33:59.36101 [18336] 25 Dec 23:33:59.360 * DB saved on disk 2014-12-25_22:33:59.36190 [18336] 25 Dec 23:33:59.361 * Removing the unix socket file. 2014-12-25_22:33:59.36191 [18336] 25 Dec 23:33:59.361 # Redis is now ready to exit, bye bye... ==> /var/log/gitlab/ci-redis/state <== ==> /var/log/gitlab/sidekiq/current <== 2015-06-26_22:18:43.23841 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-3.3.0/lib/sidekiq/cli.rb:236:in `boot_system' 2015-06-26_22:18:43.23841 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-3.3.0/lib/sidekiq/cli.rb:50:in `run' 2015-06-26_22:18:43.23841 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-3.3.0/bin/sidekiq:8:in `<top (required)>' 2015-06-26_22:18:43.23842 /opt/gitlab/embedded/service/gem/ruby/2.1.0/bin/sidekiq:23:in `load' 2015-06-26_22:18:43.23842 /opt/gitlab/embedded/service/gem/ruby/2.1.0/bin/sidekiq:23:in `<main>' 2015-06-26_22:18:43.23948 2015-06-26T22:18:43.239Z 27026 TID-pvbxk INFO: [Sidetiq] Sidetiq::Actor::Clock id: 43455980 shutting down ... 2015-06-26_22:18:43.24053 2015-06-26T22:18:43.239Z 27026 TID-pubhc INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43406940 shutting down ... 2015-06-26_22:18:43.24059 2015-06-26T22:18:43.240Z 27026 TID-pu02s INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43392580 shutting down ... 2015-06-26_22:18:43.24066 2015-06-26T22:18:43.240Z 27026 TID-ptot8 INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43385860 shutting down ... 2015-06-26_22:18:43.24093 2015-06-26T22:18:43.240Z 27026 TID-ptndk INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43370720 shutting down ... ==> /var/log/gitlab/sidekiq/state <== ==> /var/log/gitlab/unicorn/current <== 2015-06-26_22:18:43.78359 failed to start a new unicorn master 2015-06-26_22:18:43.79291 starting new unicorn master ==> /var/log/gitlab/unicorn/unicorn_stderr.log <== I, [2015-06-27T00:18:45.102434 #27144] INFO -- : Refreshing Gem list ==> /var/log/gitlab/gitlab-shell/gitlab-shell.log <== W, [2015-06-27T00:18:45.918411 #27148] WARN -- : Failed to connect to internal API <POST http://127.0.0.1:8080/api/v3/internal/allowed>: #<Errno::ECONNREFUSED: Connection refused - connect(2) for "127.0.0.1" port 8080> ==> /var/log/gitlab/sidekiq/current <== 2015-06-26_22:18:50.14566 2015-06-26T22:18:50.145Z 27113 TID-1ze7s INFO: [Sidetiq] Sidetiq v0.6.3 - Copyright (c) 2012-2013, Tobias Svensson <t...@tobiassvensson.co.uk> 2015-06-26_22:18:50.14569 2015-06-26T22:18:50.145Z 27113 TID-1ze7s INFO: [Sidetiq] Sidetiq is covered by the 3-clause BSD license. 2015-06-26_22:18:50.14571 2015-06-26T22:18:50.145Z 27113 TID-1ze7s INFO: [Sidetiq] See LICENSE and http://opensource.org/licenses/BSD-3-Clause for licensing details. 2015-06-26_22:18:50.14574 2015-06-26T22:18:50.145Z 27113 TID-1ze7s INFO: [Sidetiq] Sidetiq::Supervisor start 2015-06-26_22:18:50.14715 2015-06-26T22:18:50.147Z 27113 TID-punj8 INFO: [Sidetiq] Sidetiq::Actor::Clock id: 43425940 initialize 2015-06-26_22:18:50.14862 2015-06-26T22:18:50.148Z 27113 TID-pty9s INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43390140 initialize 2015-06-26_22:18:50.15121 2015-06-26T22:18:50.151Z 27113 TID-ptmpo INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43375600 initialize 2015-06-26_22:18:50.15210 2015-06-26T22:18:50.152Z 27113 TID-ptavk INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43373540 initialize 2015-06-26_22:18:50.15293 2015-06-26T22:18:50.152Z 27113 TID-pswpk INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43343800 initialize 2015-06-26_22:18:51.77538 2015-06-26T22:18:51.775Z 27113 TID-1ze7s INFO: Booting Sidekiq 3.3.0 with redis options {:url=>"unix:/var/opt/gitlab/redis/redis.socket", :namespace=>"resque:gitlab"} 2015-06-26_22:18:51.84674 Permission denied @ rb_sysopen - /opt/gitlab/embedded/service/gitlab-rails/.gitlab_shell_secret 2015-06-26_22:18:51.84678 /opt/gitlab/embedded/service/gitlab-rails/config/initializers/gitlab_shell_secret_token.rb:13:in `write' 2015-06-26_22:18:51.84678 /opt/gitlab/embedded/service/gitlab-rails/config/initializers/gitlab_shell_secret_token.rb:13:in `<top (required)>' 2015-06-26_22:18:51.84679 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:241:in `load' 2015-06-26_22:18:51.84680 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:241:in `block in load' 2015-06-26_22:18:51.84681 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:232:in `load_dependency' 2015-06-26_22:18:51.84682 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:241:in `load' 2015-06-26_22:18:51.84682 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:648:in `block in load_config_initializer' 2015-06-26_22:18:51.84682 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/notifications.rb:161:in `instrument' 2015-06-26_22:18:51.84683 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:647:in `load_config_initializer' 2015-06-26_22:18:51.84684 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:612:in `block (2 levels) in <class:Engine>' 2015-06-26_22:18:51.84684 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:611:in `each' 2015-06-26_22:18:51.84684 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:611:in `block in <class:Engine>' 2015-06-26_22:18:51.84685 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:30:in `instance_exec' 2015-06-26_22:18:51.84685 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:30:in `run' 2015-06-26_22:18:51.84686 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:55:in `block in run_initializers' 2015-06-26_22:18:51.84686 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:226:in `block in tsort_each' 2015-06-26_22:18:51.84687 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:348:in `block (2 levels) in each_strongly_connected_component' 2015-06-26_22:18:51.84687 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:418:in `block (2 levels) in each_strongly_connected_component_from' 2015-06-26_22:18:51.84689 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:427:in `each_strongly_connected_component_from' 2015-06-26_22:18:51.84689 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:417:in `block in each_strongly_connected_component_from' 2015-06-26_22:18:51.84690 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:44:in `each' 2015-06-26_22:18:51.84690 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:44:in `tsort_each_child' 2015-06-26_22:18:51.84690 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:411:in `call' 2015-06-26_22:18:51.84691 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:411:in `each_strongly_connected_component_from' 2015-06-26_22:18:51.84691 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:347:in `block in each_strongly_connected_component' 2015-06-26_22:18:51.84692 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:345:in `each' 2015-06-26_22:18:51.84692 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:345:in `call' 2015-06-26_22:18:51.84693 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:345:in `each_strongly_connected_component' 2015-06-26_22:18:51.84696 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:224:in `tsort_each' 2015-06-26_22:18:51.84697 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:205:in `tsort_each' 2015-06-26_22:18:51.84698 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:54:in `run_initializers' 2015-06-26_22:18:51.84699 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/application.rb:300:in `initialize!' 2015-06-26_22:18:51.84700 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/railtie.rb:194:in `public_send' 2015-06-26_22:18:51.84700 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/railtie.rb:194:in `method_missing' 2015-06-26_22:18:51.84701 /opt/gitlab/embedded/service/gitlab-rails/config/environment.rb:5:in `<top (required)>' 2015-06-26_22:18:51.84701 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:247:in `require' 2015-06-26_22:18:51.84701 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:247:in `block in require' 2015-06-26_22:18:51.84702 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:232:in `load_dependency' 2015-06-26_22:18:51.84703 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:247:in `require' 2015-06-26_22:18:51.84704 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-3.3.0/lib/sidekiq/cli.rb:236:in `boot_system' 2015-06-26_22:18:51.84704 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-3.3.0/lib/sidekiq/cli.rb:50:in `run' 2015-06-26_22:18:51.84705 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-3.3.0/bin/sidekiq:8:in `<top (required)>' 2015-06-26_22:18:51.84706 /opt/gitlab/embedded/service/gem/ruby/2.1.0/bin/sidekiq:23:in `load' 2015-06-26_22:18:51.84707 /opt/gitlab/embedded/service/gem/ruby/2.1.0/bin/sidekiq:23:in `<main>' 2015-06-26_22:18:51.84820 2015-06-26T22:18:51.848Z 27113 TID-punj8 INFO: [Sidetiq] Sidetiq::Actor::Clock id: 43425940 shutting down ... 2015-06-26_22:18:51.84950 2015-06-26T22:18:51.848Z 27113 TID-pty9s INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43390140 shutting down ... 2015-06-26_22:18:51.84970 2015-06-26T22:18:51.848Z 27113 TID-ptmpo INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43375600 shutting down ... 2015-06-26_22:18:51.84976 2015-06-26T22:18:51.849Z 27113 TID-ptavk INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43373540 shutting down ... 2015-06-26_22:18:51.84980 2015-06-26T22:18:51.849Z 27113 TID-pswpk INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43343800 shutting down ... ==> /var/log/gitlab/unicorn/unicorn_stderr.log <== /opt/gitlab/embedded/service/gitlab-rails/config/initializers/gitlab_shell_secret_token.rb:13:in `write': Permission denied @ rb_sysopen - /opt/gitlab/embedded/service/gitlab-rails/.gitlab_shell_secret (Errno::EACCES) from /opt/gitlab/embedded/service/gitlab-rails/config/initializers/gitlab_shell_secret_token.rb:13:in `<top (required)>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:241:in `load' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:241:in `block in load' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:232:in `load_dependency' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:241:in `load' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:648:in `block in load_config_initializer' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/notifications.rb:161:in `instrument' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:647:in `load_config_initializer' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:612:in `block (2 levels) in <class:Engine>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:611:in `each' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:611:in `block in <class:Engine>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:30:in `instance_exec' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:30:in `run' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:55:in `block in run_initializers' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:226:in `block in tsort_each' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:348:in `block (2 levels) in each_strongly_connected_component' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:418:in `block (2 levels) in each_strongly_connected_component_from' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:427:in `each_strongly_connected_component_from' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:417:in `block in each_strongly_connected_component_from' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:44:in `each' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:44:in `tsort_each_child' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:411:in `call' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:411:in `each_strongly_connected_component_from' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:347:in `block in each_strongly_connected_component' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:345:in `each' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:345:in `call' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:345:in `each_strongly_connected_component' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:224:in `tsort_each' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:205:in `tsort_each' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:54:in `run_initializers' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/application.rb:300:in `initialize!' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/railtie.rb:194:in `public_send' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/railtie.rb:194:in `method_missing' from /opt/gitlab/embedded/service/gitlab-rails/config/environment.rb:5:in `<top (required)>' from /opt/gitlab/embedded/service/gitlab-rails/config.ru:16:in `require' from /opt/gitlab/embedded/service/gitlab-rails/config.ru:16:in `block in <main>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/rack-1.5.4/lib/rack/builder.rb:55:in `instance_eval' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/rack-1.5.4/lib/rack/builder.rb:55:in `initialize' from /opt/gitlab/embedded/service/gitlab-rails/config.ru:1:in `new' from /opt/gitlab/embedded/service/gitlab-rails/config.ru:1:in `<main>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn.rb:48:in `eval' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn.rb:48:in `block in builder' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn/http_server.rb:722:in `call' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn/http_server.rb:722:in `build_app!' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn/http_server.rb:140:in `start' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/bin/unicorn:126:in `<top (required)>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/bin/unicorn:23:in `load' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/bin/unicorn:23:in `<main>' ==> /var/log/gitlab/unicorn/current <== 2015-06-26_22:18:52.47695 master failed to start, check stderr log for details 2015-06-26_22:18:53.48454 failed to start a new unicorn master 2015-06-26_22:18:53.49397 starting new unicorn master ==> /var/log/gitlab/unicorn/unicorn_stderr.log <== I, [2015-06-27T00:18:54.602065 #27232] INFO -- : Refreshing Gem list ==> /var/log/gitlab/gitlab-shell/gitlab-shell.log <== W, [2015-06-27T00:18:55.029157 #27239] WARN -- : Failed to connect to internal API <POST http://127.0.0.1:8080/api/v3/internal/allowed>: #<Errno::ECONNREFUSED: Connection refused - connect(2) for "127.0.0.1" port 8080> W, [2015-06-27T00:18:59.219039 #27271] WARN -- : Failed to connect to internal API <POST http://127.0.0.1:8080/api/v3/internal/allowed>: #<Errno::ECONNREFUSED: Connection refused - connect(2) for "127.0.0.1" port 8080> ==> /var/log/gitlab/sidekiq/current <== 2015-06-26_22:18:59.52128 2015-06-26T22:18:59.521Z 27197 TID-1ze7s INFO: [Sidetiq] Sidetiq v0.6.3 - Copyright (c) 2012-2013, Tobias Svensson <t...@tobiassvensson.co.uk> 2015-06-26_22:18:59.52132 2015-06-26T22:18:59.521Z 27197 TID-1ze7s INFO: [Sidetiq] Sidetiq is covered by the 3-clause BSD license. 2015-06-26_22:18:59.52134 2015-06-26T22:18:59.521Z 27197 TID-1ze7s INFO: [Sidetiq] See LICENSE and http://opensource.org/licenses/BSD-3-Clause for licensing details. 2015-06-26_22:18:59.52150 2015-06-26T22:18:59.521Z 27197 TID-1ze7s INFO: [Sidetiq] Sidetiq::Supervisor start 2015-06-26_22:18:59.52306 2015-06-26T22:18:59.522Z 27197 TID-pv6p8 INFO: [Sidetiq] Sidetiq::Actor::Clock id: 43447900 initialize 2015-06-26_22:18:59.52504 2015-06-26T22:18:59.524Z 27197 TID-pub2w INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43406840 initialize 2015-06-26_22:18:59.52577 2015-06-26T22:18:59.525Z 27197 TID-pu03w INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43392540 initialize 2015-06-26_22:18:59.52626 2015-06-26T22:18:59.526Z 27197 TID-ptot8 INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43385940 initialize 2015-06-26_22:18:59.52680 2015-06-26T22:18:59.526Z 27197 TID-ptkzg INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43370860 initialize 2015-06-26_22:19:01.50178 2015-06-26T22:19:01.501Z 27197 TID-1ze7s INFO: Booting Sidekiq 3.3.0 with redis options {:url=>"unix:/var/opt/gitlab/redis/redis.socket", :namespace=>"resque:gitlab"} 2015-06-26_22:19:01.57576 Permission denied @ rb_sysopen - /opt/gitlab/embedded/service/gitlab-rails/.gitlab_shell_secret 2015-06-26_22:19:01.57599 /opt/gitlab/embedded/service/gitlab-rails/config/initializers/gitlab_shell_secret_token.rb:13:in `write' 2015-06-26_22:19:01.57600 /opt/gitlab/embedded/service/gitlab-rails/config/initializers/gitlab_shell_secret_token.rb:13:in `<top (required)>' 2015-06-26_22:19:01.57601 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:241:in `load' 2015-06-26_22:19:01.57601 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:241:in `block in load' 2015-06-26_22:19:01.57602 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:232:in `load_dependency' 2015-06-26_22:19:01.57602 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:241:in `load' 2015-06-26_22:19:01.57602 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:648:in `block in load_config_initializer' 2015-06-26_22:19:01.57603 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/notifications.rb:161:in `instrument' 2015-06-26_22:19:01.57603 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:647:in `load_config_initializer' 2015-06-26_22:19:01.57604 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:612:in `block (2 levels) in <class:Engine>' 2015-06-26_22:19:01.57605 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:611:in `each' 2015-06-26_22:19:01.57605 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:611:in `block in <class:Engine>' 2015-06-26_22:19:01.57605 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:30:in `instance_exec' 2015-06-26_22:19:01.57606 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:30:in `run' 2015-06-26_22:19:01.57606 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:55:in `block in run_initializers' 2015-06-26_22:19:01.57607 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:226:in `block in tsort_each' 2015-06-26_22:19:01.57607 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:348:in `block (2 levels) in each_strongly_connected_component' 2015-06-26_22:19:01.57607 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:418:in `block (2 levels) in each_strongly_connected_component_from' 2015-06-26_22:19:01.57608 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:427:in `each_strongly_connected_component_from' 2015-06-26_22:19:01.57609 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:417:in `block in each_strongly_connected_component_from' 2015-06-26_22:19:01.57609 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:44:in `each' 2015-06-26_22:19:01.57609 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:44:in `tsort_each_child' 2015-06-26_22:19:01.57610 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:411:in `call' 2015-06-26_22:19:01.57610 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:411:in `each_strongly_connected_component_from' 2015-06-26_22:19:01.57611 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:347:in `block in each_strongly_connected_component' 2015-06-26_22:19:01.57611 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:345:in `each' 2015-06-26_22:19:01.57612 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:345:in `call' 2015-06-26_22:19:01.57612 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:345:in `each_strongly_connected_component' 2015-06-26_22:19:01.57612 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:224:in `tsort_each' 2015-06-26_22:19:01.57613 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:205:in `tsort_each' 2015-06-26_22:19:01.57613 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:54:in `run_initializers' 2015-06-26_22:19:01.57616 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/application.rb:300:in `initialize!' 2015-06-26_22:19:01.57616 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/railtie.rb:194:in `public_send' 2015-06-26_22:19:01.57617 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/railtie.rb:194:in `method_missing' 2015-06-26_22:19:01.57617 /opt/gitlab/embedded/service/gitlab-rails/config/environment.rb:5:in `<top (required)>' 2015-06-26_22:19:01.57618 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:247:in `require' 2015-06-26_22:19:01.57618 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:247:in `block in require' 2015-06-26_22:19:01.57618 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:232:in `load_dependency' 2015-06-26_22:19:01.57619 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:247:in `require' 2015-06-26_22:19:01.57630 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-3.3.0/lib/sidekiq/cli.rb:236:in `boot_system' 2015-06-26_22:19:01.57631 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-3.3.0/lib/sidekiq/cli.rb:50:in `run' 2015-06-26_22:19:01.57631 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-3.3.0/bin/sidekiq:8:in `<top (required)>' 2015-06-26_22:19:01.57632 /opt/gitlab/embedded/service/gem/ruby/2.1.0/bin/sidekiq:23:in `load' 2015-06-26_22:19:01.57632 /opt/gitlab/embedded/service/gem/ruby/2.1.0/bin/sidekiq:23:in `<main>' 2015-06-26_22:19:01.57731 2015-06-26T22:19:01.577Z 27197 TID-pv6p8 INFO: [Sidetiq] Sidetiq::Actor::Clock id: 43447900 shutting down ... 2015-06-26_22:19:01.57884 2015-06-26T22:19:01.577Z 27197 TID-pu03w INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43392540 shutting down ... 2015-06-26_22:19:01.57905 2015-06-26T22:19:01.578Z 27197 TID-pub2w INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43406840 shutting down ... 2015-06-26_22:19:01.57908 2015-06-26T22:19:01.578Z 27197 TID-ptot8 INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43385940 shutting down ... 2015-06-26_22:19:01.57915 2015-06-26T22:19:01.578Z 27197 TID-ptkzg INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43370860 shutting down ... ==> /var/log/gitlab/unicorn/unicorn_stderr.log <== /opt/gitlab/embedded/service/gitlab-rails/config/initializers/gitlab_shell_secret_token.rb:13:in `write': Permission denied @ rb_sysopen - /opt/gitlab/embedded/service/gitlab-rails/.gitlab_shell_secret (Errno::EACCES) from /opt/gitlab/embedded/service/gitlab-rails/config/initializers/gitlab_shell_secret_token.rb:13:in `<top (required)>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:241:in `load' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:241:in `block in load' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:232:in `load_dependency' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:241:in `load' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:648:in `block in load_config_initializer' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/notifications.rb:161:in `instrument' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:647:in `load_config_initializer' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:612:in `block (2 levels) in <class:Engine>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:611:in `each' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:611:in `block in <class:Engine>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:30:in `instance_exec' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:30:in `run' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:55:in `block in run_initializers' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:226:in `block in tsort_each' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:348:in `block (2 levels) in each_strongly_connected_component' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:418:in `block (2 levels) in each_strongly_connected_component_from' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:427:in `each_strongly_connected_component_from' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:417:in `block in each_strongly_connected_component_from' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:44:in `each' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:44:in `tsort_each_child' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:411:in `call' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:411:in `each_strongly_connected_component_from' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:347:in `block in each_strongly_connected_component' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:345:in `each' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:345:in `call' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:345:in `each_strongly_connected_component' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:224:in `tsort_each' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:205:in `tsort_each' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:54:in `run_initializers' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/application.rb:300:in `initialize!' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/railtie.rb:194:in `public_send' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/railtie.rb:194:in `method_missing' from /opt/gitlab/embedded/service/gitlab-rails/config/environment.rb:5:in `<top (required)>' from /opt/gitlab/embedded/service/gitlab-rails/config.ru:16:in `require' from /opt/gitlab/embedded/service/gitlab-rails/config.ru:16:in `block in <main>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/rack-1.5.4/lib/rack/builder.rb:55:in `instance_eval' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/rack-1.5.4/lib/rack/builder.rb:55:in `initialize' from /opt/gitlab/embedded/service/gitlab-rails/config.ru:1:in `new' from /opt/gitlab/embedded/service/gitlab-rails/config.ru:1:in `<main>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn.rb:48:in `eval' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn.rb:48:in `block in builder' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn/http_server.rb:722:in `call' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn/http_server.rb:722:in `build_app!' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn/http_server.rb:140:in `start' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/bin/unicorn:126:in `<top (required)>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/bin/unicorn:23:in `load' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/bin/unicorn:23:in `<main>' ==> /var/log/gitlab/unicorn/current <== 2015-06-26_22:19:01.97313 master failed to start, check stderr log for details 2015-06-26_22:19:03.00986 failed to start a new unicorn master 2015-06-26_22:19:03.01974 starting new unicorn master ==> /var/log/gitlab/gitlab-shell/gitlab-shell.log <== W, [2015-06-27T00:19:03.564783 #27367] WARN -- : Failed to connect to internal API <POST http://127.0.0.1:8080/api/v3/internal/allowed>: #<Errno::ECONNREFUSED: Connection refused - connect(2) for "127.0.0.1" port 8080> ==> /var/log/gitlab/unicorn/unicorn_stderr.log <== I, [2015-06-27T00:19:05.046992 #27381] INFO -- : Refreshing Gem list ==> /var/log/gitlab/gitlab-shell/gitlab-shell.log <== W, [2015-06-27T00:19:07.683197 #27409] WARN -- : Failed to connect to internal API <POST http://127.0.0.1:8080/api/v3/internal/allowed>: #<Errno::ECONNREFUSED: Connection refused - connect(2) for "127.0.0.1" port 8080> ==> /var/log/gitlab/sidekiq/current <== 2015-06-26_22:19:10.59697 2015-06-26T22:19:10.596Z 27291 TID-1ze7s INFO: [Sidetiq] Sidetiq v0.6.3 - Copyright (c) 2012-2013, Tobias Svensson <t...@tobiassvensson.co.uk> 2015-06-26_22:19:10.59708 2015-06-26T22:19:10.597Z 27291 TID-1ze7s INFO: [Sidetiq] Sidetiq is covered by the 3-clause BSD license. 2015-06-26_22:19:10.59713 2015-06-26T22:19:10.597Z 27291 TID-1ze7s INFO: [Sidetiq] See LICENSE and http://opensource.org/licenses/BSD-3-Clause for licensing details. 2015-06-26_22:19:10.59718 2015-06-26T22:19:10.597Z 27291 TID-1ze7s INFO: [Sidetiq] Sidetiq::Supervisor start 2015-06-26_22:19:10.59949 2015-06-26T22:19:10.599Z 27291 TID-pvbz8 INFO: [Sidetiq] Sidetiq::Actor::Clock id: 43455440 initialize 2015-06-26_22:19:10.60138 2015-06-26T22:19:10.601Z 27291 TID-pubq8 INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43407280 initialize 2015-06-26_22:19:10.60190 2015-06-26T22:19:10.601Z 27291 TID-pu078 INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43392800 initialize 2015-06-26_22:19:10.60244 2015-06-26T22:19:10.602Z 27291 TID-ptouw INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43386140 initialize 2015-06-26_22:19:10.60320 2015-06-26T22:19:10.603Z 27291 TID-ptp3s INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43370940 initialize ==> /var/log/gitlab/nginx/error.log <== ^C/opt/gitlab/embedded/lib/ruby/gems/2.1.0/gems/omnibus-ctl-0.3.4/lib/omnibus-ctl.rb:426:in `system': Interrupt from /opt/gitlab/embedded/lib/ruby/gems/2.1.0/gems/omnibus-ctl-0.3.4/lib/omnibus-ctl.rb:426:in `tail' from /opt/gitlab/embedded/lib/ruby/gems/2.1.0/gems/omnibus-ctl-0.3.4/lib/omnibus-ctl.rb:566:in `run' from /opt/gitlab/embedded/lib/ruby/gems/2.1.0/gems/omnibus-ctl-0.3.4/bin/omnibus-ctl:31:in `<top (required)>' from /opt/gitlab/embedded/bin/omnibus-ctl:23:in `load' from /opt/gitlab/embedded/bin/omnibus-ctl:23:in `<main>' [root@milkyway ~]# sudo gitlab-ctl tail ==> /var/log/gitlab/logrotate/logrotate.status <== "/var/log/gitlab/gitlab-rails/application.log" 2015-6-27-0:19:11 "/var/log/gitlab/gitlab-shell//gitlab-shell.log" 2015-6-27-0:19:11 "/var/log/gitlab/nginx/error.log" 2015-6-27-0:19:11 "/var/log/gitlab/gitlab-rails/satellites.log" 2015-6-27-0:19:11 "/var/log/gitlab/unicorn/unicorn_stdout.log" 2015-6-27-0:19:11 "/var/log/gitlab/nginx/gitlab_access.log" 2015-6-27-0:19:11 "/var/log/gitlab/nginx/gitlab_ci_access.log" 2015-6-27-0:19:11 "/var/log/gitlab/unicorn/unicorn_stderr.log" 2015-6-27-0:19:11 "/var/log/gitlab/gitlab-rails/sidekiq.log" 2015-5-16-5:0:0 "/var/log/gitlab/gitlab-rails/production.log" 2015-6-27-0:19:11 ==> /var/log/gitlab/logrotate/current <== ==> /var/log/gitlab/unicorn/unicorn_stdout.log <== ==> /var/log/gitlab/unicorn/current <== 2015-06-26_22:18:53.49397 starting new unicorn master 2015-06-26_22:19:01.97313 master failed to start, check stderr log for details 2015-06-26_22:19:03.00986 failed to start a new unicorn master 2015-06-26_22:19:03.01974 starting new unicorn master 2015-06-26_22:19:12.57075 master failed to start, check stderr log for details 2015-06-26_22:19:13.61849 failed to start a new unicorn master 2015-06-26_22:19:13.63101 starting new unicorn master 2015-06-26_22:19:22.39393 master failed to start, check stderr log for details 2015-06-26_22:19:23.40264 failed to start a new unicorn master 2015-06-26_22:19:23.49317 starting new unicorn master ==> /var/log/gitlab/unicorn/state <== ==> /var/log/gitlab/unicorn/unicorn_stderr.log <== from /opt/gitlab/embedded/service/gitlab-rails/config.ru:1:in `<main>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn.rb:48:in `eval' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn.rb:48:in `block in builder' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn/http_server.rb:722:in `call' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn/http_server.rb:722:in `build_app!' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn/http_server.rb:140:in `start' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/bin/unicorn:126:in `<top (required)>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/bin/unicorn:23:in `load' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/bin/unicorn:23:in `<main>' I, [2015-06-27T00:19:24.609503 #27569] INFO -- : Refreshing Gem list ==> /var/log/gitlab/ci-sidekiq/current <== 2014-12-25_22:34:03.31110 2014-12-25T22:34:03Z 18341 TID-s7i84 INFO: Pushed 0 messages back to Redis 2014-12-25_22:34:03.31157 2014-12-25T22:34:03Z 18341 TID-s7i84 INFO: Pushed 0 messages back to Redis 2014-12-25_22:34:03.31201 2014-12-25T22:34:03Z 18341 TID-s7i84 INFO: Pushed 0 messages back to Redis 2014-12-25_22:34:03.31250 2014-12-25T22:34:03Z 18341 TID-s7i84 INFO: Pushed 0 messages back to Redis 2014-12-25_22:34:03.31318 2014-12-25T22:34:03Z 18341 TID-s7i84 INFO: Pushed 0 messages back to Redis 2014-12-25_22:34:03.31376 2014-12-25T22:34:03Z 18341 TID-s7i84 INFO: Pushed 0 messages back to Redis 2014-12-25_22:34:03.31431 2014-12-25T22:34:03Z 18341 TID-s7i84 INFO: Pushed 0 messages back to Redis 2014-12-25_22:34:03.31484 2014-12-25T22:34:03Z 18341 TID-s7i84 INFO: Pushed 0 messages back to Redis 2014-12-25_22:34:03.31542 2014-12-25T22:34:03Z 18341 TID-s7i84 INFO: Pushed 0 messages back to Redis 2014-12-25_22:34:03.32363 2014-12-25T22:34:03Z 18341 TID-s7i84 INFO: Pushed 0 messages back to Redis ==> /var/log/gitlab/ci-sidekiq/state <== ==> /var/log/gitlab/nginx/current <== ==> /var/log/gitlab/nginx/gitlab_ci_access.log <== ==> /var/log/gitlab/nginx/state <== ==> /var/log/gitlab/nginx/gitlab_ci_error.log <== ==> /var/log/gitlab/nginx/gitlab_error.log <== ==> /var/log/gitlab/nginx/gitlab_access.log <== ==> /var/log/gitlab/nginx/error.log <== ==> /var/log/gitlab/ci-unicorn/unicorn_stdout.log <== ==> /var/log/gitlab/ci-unicorn/current <== 2014-12-25_22:31:39.28760 starting new unicorn master 2014-12-25_22:31:44.43013 adopted new unicorn master 17665 2014-12-25_22:33:35.55775 forwarding TERM to unicorn master 17665 2014-12-25_22:33:35.55805 forwarding CONT to unicorn master 17665 2014-12-25_22:33:36.55928 wrapper for unicorn master 17665 exiting 2014-12-25_22:33:45.41385 starting new unicorn master 2014-12-25_22:33:50.85789 adopted new unicorn master 18371 2014-12-25_22:34:09.87926 forwarding TERM to unicorn master 18371 2014-12-25_22:34:09.87931 forwarding CONT to unicorn master 18371 2014-12-25_22:34:10.88064 wrapper for unicorn master 18371 exiting ==> /var/log/gitlab/ci-unicorn/state <== ==> /var/log/gitlab/ci-unicorn/unicorn_stderr.log <== I, [2014-12-25T23:33:49.802811 #18371] INFO -- : unlinking existing socket=/var/opt/gitlab/gitlab-ci/sockets/gitlab.socket I, [2014-12-25T23:33:49.802946 #18371] INFO -- : listening on addr=/var/opt/gitlab/gitlab-ci/sockets/gitlab.socket fd=12 I, [2014-12-25T23:33:49.809125 #18445] INFO -- : worker=0 spawned pid=18445 I, [2014-12-25T23:33:49.809654 #18445] INFO -- : worker=0 ready I, [2014-12-25T23:33:49.814194 #18371] INFO -- : master process ready I, [2014-12-25T23:33:49.815234 #18448] INFO -- : worker=1 spawned pid=18448 I, [2014-12-25T23:33:49.815777 #18448] INFO -- : worker=1 ready I, [2014-12-25T23:34:09.979961 #18371] INFO -- : reaped #<Process::Status: pid 18445 exit 0> worker=0 I, [2014-12-25T23:34:09.980103 #18371] INFO -- : reaped #<Process::Status: pid 18448 exit 0> worker=1 I, [2014-12-25T23:34:09.980206 #18371] INFO -- : master complete ==> /var/log/gitlab/redis/current <== 2015-06-26_22:09:13.96791 `-._ `-._`-.__.-'_.-' _.-' 2015-06-26_22:09:13.96792 `-._ `-.__.-' _.-' 2015-06-26_22:09:13.96792 `-._ _.-' 2015-06-26_22:09:13.96793 `-.__.-' 2015-06-26_22:09:13.96793 2015-06-26_22:09:13.96793 [9622] 27 Jun 00:09:13.967 # Server started, Redis version 2.8.20 2015-06-26_22:09:13.96796 [9622] 27 Jun 00:09:13.967 # WARNING overcommit_memory is set to 0! Background save may fail under low memory condition. To fix this issue add 'vm.overcommit_memory = 1' to /etc/sysctl.conf and then reboot or run the command 'sysctl vm.overcommit_memory=1' for this to take effect. 2015-06-26_22:09:13.96800 [9622] 27 Jun 00:09:13.967 # WARNING: The TCP backlog setting of 511 cannot be enforced because /proc/sys/net/core/somaxconn is set to the lower value of 128. 2015-06-26_22:09:14.05474 [9622] 27 Jun 00:09:14.054 * DB loaded from disk: 0.087 seconds 2015-06-26_22:09:14.05478 [9622] 27 Jun 00:09:14.054 * The server is now ready to accept connections at /var/opt/gitlab/redis/redis.socket ==> /var/log/gitlab/redis/state <== ==> /var/log/gitlab/gitlab-ci/production.log <== ==> /var/log/gitlab/gitlab-rails/application.log <== ==> /var/log/gitlab/gitlab-rails/production.log <== ==> /var/log/gitlab/gitlab-rails/satellites.log <== ==> /var/log/gitlab/gitlab-rails/githost.log <== ==> /var/log/gitlab/gitlab-shell/gitlab-shell.log <== W, [2015-06-27T00:19:24.706762 #27564] WARN -- : Failed to connect to internal API <POST http://127.0.0.1:8080/api/v3/internal/allowed>: #<Errno::ECONNREFUSED: Connection refused - connect(2) for "127.0.0.1" port 8080> ==> /var/log/gitlab/postgresql/current <== 2015-06-26_22:08:50.30962 LOG: autovacuum launcher started 2015-06-26_22:09:12.30913 received TERM from runit, sending INT instead to force quit connections 2015-06-26_22:09:12.56600 LOG: received fast shutdown request 2015-06-26_22:09:12.56606 LOG: aborting any active transactions 2015-06-26_22:09:12.56607 LOG: autovacuum launcher shutting down 2015-06-26_22:09:12.56729 LOG: shutting down 2015-06-26_22:09:13.15553 LOG: database system is shut down 2015-06-26_22:09:13.74714 LOG: database system was shut down at 2015-06-26 22:09:12 GMT 2015-06-26_22:09:13.96578 LOG: database system is ready to accept connections 2015-06-26_22:09:13.96714 LOG: autovacuum launcher started ==> /var/log/gitlab/postgresql/state <== ==> /var/log/gitlab/ci-redis/current <== 2014-12-25_22:33:44.59130 [18336] 25 Dec 23:33:44.591 # WARNING overcommit_memory is set to 0! Background save may fail under low memory condition. To fix this issue add 'vm.overcommit_memory = 1' to /etc/sysctl.conf and then reboot or run the command 'sysctl vm.overcommit_memory=1' for this to take effect. 2014-12-25_22:33:44.59135 [18336] 25 Dec 23:33:44.591 * DB loaded from disk: 0.000 seconds 2014-12-25_22:33:44.59135 [18336] 25 Dec 23:33:44.591 * The server is now ready to accept connections on port 0 2014-12-25_22:33:44.59136 [18336] 25 Dec 23:33:44.591 * The server is now ready to accept connections at /var/opt/gitlab/ci-redis/redis.socket 2014-12-25_22:33:59.30897 [18336 | signal handler] (1419546839) Received SIGTERM, scheduling shutdown... 2014-12-25_22:33:59.31619 [18336] 25 Dec 23:33:59.316 # User requested shutdown... 2014-12-25_22:33:59.31621 [18336] 25 Dec 23:33:59.316 * Saving the final RDB snapshot before exiting. 2014-12-25_22:33:59.36101 [18336] 25 Dec 23:33:59.360 * DB saved on disk 2014-12-25_22:33:59.36190 [18336] 25 Dec 23:33:59.361 * Removing the unix socket file. 2014-12-25_22:33:59.36191 [18336] 25 Dec 23:33:59.361 # Redis is now ready to exit, bye bye... ==> /var/log/gitlab/ci-redis/state <== ==> /var/log/gitlab/sidekiq/current <== 2015-06-26_22:19:30.41462 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-3.3.0/lib/sidekiq/cli.rb:236:in `boot_system' 2015-06-26_22:19:30.41463 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-3.3.0/lib/sidekiq/cli.rb:50:in `run' 2015-06-26_22:19:30.41463 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-3.3.0/bin/sidekiq:8:in `<top (required)>' 2015-06-26_22:19:30.41463 /opt/gitlab/embedded/service/gem/ruby/2.1.0/bin/sidekiq:23:in `load' 2015-06-26_22:19:30.41464 /opt/gitlab/embedded/service/gem/ruby/2.1.0/bin/sidekiq:23:in `<main>' 2015-06-26_22:19:30.41618 2015-06-26T22:19:30.416Z 27519 TID-pvlgw INFO: [Sidetiq] Sidetiq::Actor::Clock id: 43480320 shutting down ... 2015-06-26_22:19:30.41756 2015-06-26T22:19:30.416Z 27519 TID-pv1p8 INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43442520 shutting down ... 2015-06-26_22:19:30.41765 2015-06-26T22:19:30.416Z 27519 TID-punuc INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43423980 shutting down ... 2015-06-26_22:19:30.41774 2015-06-26T22:19:30.417Z 27519 TID-pu9fg INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43404520 shutting down ... 2015-06-26_22:19:30.41782 2015-06-26T22:19:30.417Z 27519 TID-ptyes INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43390140 shutting down ... ==> /var/log/gitlab/sidekiq/state <== ==> /var/log/gitlab/gitlab-shell/gitlab-shell.log <== W, [2015-06-27T00:19:31.598691 #27646] WARN -- : Failed to connect to internal API <POST http://127.0.0.1:8080/api/v3/internal/allowed>: #<Errno::ECONNREFUSED: Connection refused - connect(2) for "127.0.0.1" port 8080> ==> /var/log/gitlab/unicorn/unicorn_stderr.log <== /opt/gitlab/embedded/service/gitlab-rails/config/initializers/gitlab_shell_secret_token.rb:13:in `write': Permission denied @ rb_sysopen - /opt/gitlab/embedded/service/gitlab-rails/.gitlab_shell_secret (Errno::EACCES) from /opt/gitlab/embedded/service/gitlab-rails/config/initializers/gitlab_shell_secret_token.rb:13:in `<top (required)>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:241:in `load' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:241:in `block in load' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:232:in `load_dependency' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:241:in `load' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:648:in `block in load_config_initializer' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/notifications.rb:161:in `instrument' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:647:in `load_config_initializer' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:612:in `block (2 levels) in <class:Engine>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:611:in `each' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:611:in `block in <class:Engine>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:30:in `instance_exec' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:30:in `run' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:55:in `block in run_initializers' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:226:in `block in tsort_each' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:348:in `block (2 levels) in each_strongly_connected_component' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:418:in `block (2 levels) in each_strongly_connected_component_from' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:427:in `each_strongly_connected_component_from' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:417:in `block in each_strongly_connected_component_from' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:44:in `each' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:44:in `tsort_each_child' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:411:in `call' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:411:in `each_strongly_connected_component_from' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:347:in `block in each_strongly_connected_component' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:345:in `each' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:345:in `call' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:345:in `each_strongly_connected_component' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:224:in `tsort_each' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:205:in `tsort_each' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:54:in `run_initializers' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/application.rb:300:in `initialize!' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/railtie.rb:194:in `public_send' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/railtie.rb:194:in `method_missing' from /opt/gitlab/embedded/service/gitlab-rails/config/environment.rb:5:in `<top (required)>' from /opt/gitlab/embedded/service/gitlab-rails/config.ru:16:in `require' from /opt/gitlab/embedded/service/gitlab-rails/config.ru:16:in `block in <main>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/rack-1.5.4/lib/rack/builder.rb:55:in `instance_eval' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/rack-1.5.4/lib/rack/builder.rb:55:in `initialize' from /opt/gitlab/embedded/service/gitlab-rails/config.ru:1:in `new' from /opt/gitlab/embedded/service/gitlab-rails/config.ru:1:in `<main>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn.rb:48:in `eval' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn.rb:48:in `block in builder' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn/http_server.rb:722:in `call' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn/http_server.rb:722:in `build_app!' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn/http_server.rb:140:in `start' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/bin/unicorn:126:in `<top (required)>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/bin/unicorn:23:in `load' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/bin/unicorn:23:in `<main>' ==> /var/log/gitlab/unicorn/current <== 2015-06-26_22:19:32.24424 master failed to start, check stderr log for details ^C/opt/gitlab/embedded/lib/ruby/gems/2.1.0/gems/omnibus-ctl-0.3.4/lib/omnibus-ctl.rb:426:in `system': Interrupt from /opt/gitlab/embedded/lib/ruby/gems/2.1.0/gems/omnibus-ctl-0.3.4/lib/omnibus-ctl.rb:426:in `tail' from /opt/gitlab/embedded/lib/ruby/gems/2.1.0/gems/omnibus-ctl-0.3.4/lib/omnibus-ctl.rb:566:in `run' from /opt/gitlab/embedded/lib/ruby/gems/2.1.0/gems/omnibus-ctl-0.3.4/bin/omnibus-ctl:31:in `<top (required)>' from /opt/gitlab/embedded/bin/omnibus-ctl:23:in `load' from /opt/gitlab/embedded/bin/omnibus-ctl:23:in `<main>' [root@milkyway ~]# clear [root@milkyway ~]# sudo gitlab-ctl tail ==> /var/log/gitlab/logrotate/logrotate.status <== "/var/log/gitlab/gitlab-rails/application.log" 2015-6-27-0:19:11 "/var/log/gitlab/gitlab-shell//gitlab-shell.log" 2015-6-27-0:19:11 "/var/log/gitlab/nginx/error.log" 2015-6-27-0:19:11 "/var/log/gitlab/gitlab-rails/satellites.log" 2015-6-27-0:19:11 "/var/log/gitlab/unicorn/unicorn_stdout.log" 2015-6-27-0:19:11 "/var/log/gitlab/nginx/gitlab_access.log" 2015-6-27-0:19:11 "/var/log/gitlab/nginx/gitlab_ci_access.log" 2015-6-27-0:19:11 "/var/log/gitlab/unicorn/unicorn_stderr.log" 2015-6-27-0:19:11 "/var/log/gitlab/gitlab-rails/sidekiq.log" 2015-5-16-5:0:0 "/var/log/gitlab/gitlab-rails/production.log" 2015-6-27-0:19:11 ==> /var/log/gitlab/logrotate/current <== ==> /var/log/gitlab/unicorn/unicorn_stdout.log <== ==> /var/log/gitlab/unicorn/current <== 2015-06-26_22:19:03.01974 starting new unicorn master 2015-06-26_22:19:12.57075 master failed to start, check stderr log for details 2015-06-26_22:19:13.61849 failed to start a new unicorn master 2015-06-26_22:19:13.63101 starting new unicorn master 2015-06-26_22:19:22.39393 master failed to start, check stderr log for details 2015-06-26_22:19:23.40264 failed to start a new unicorn master 2015-06-26_22:19:23.49317 starting new unicorn master 2015-06-26_22:19:32.24424 master failed to start, check stderr log for details 2015-06-26_22:19:33.25149 failed to start a new unicorn master 2015-06-26_22:19:33.31699 starting new unicorn master ==> /var/log/gitlab/unicorn/state <== ==> /var/log/gitlab/unicorn/unicorn_stderr.log <== from /opt/gitlab/embedded/service/gitlab-rails/config.ru:1:in `<main>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn.rb:48:in `eval' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn.rb:48:in `block in builder' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn/http_server.rb:722:in `call' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn/http_server.rb:722:in `build_app!' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn/http_server.rb:140:in `start' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/bin/unicorn:126:in `<top (required)>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/bin/unicorn:23:in `load' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/bin/unicorn:23:in `<main>' I, [2015-06-27T00:19:34.592391 #27695] INFO -- : Refreshing Gem list ==> /var/log/gitlab/ci-sidekiq/current <== 2014-12-25_22:34:03.31110 2014-12-25T22:34:03Z 18341 TID-s7i84 INFO: Pushed 0 messages back to Redis 2014-12-25_22:34:03.31157 2014-12-25T22:34:03Z 18341 TID-s7i84 INFO: Pushed 0 messages back to Redis 2014-12-25_22:34:03.31201 2014-12-25T22:34:03Z 18341 TID-s7i84 INFO: Pushed 0 messages back to Redis 2014-12-25_22:34:03.31250 2014-12-25T22:34:03Z 18341 TID-s7i84 INFO: Pushed 0 messages back to Redis 2014-12-25_22:34:03.31318 2014-12-25T22:34:03Z 18341 TID-s7i84 INFO: Pushed 0 messages back to Redis 2014-12-25_22:34:03.31376 2014-12-25T22:34:03Z 18341 TID-s7i84 INFO: Pushed 0 messages back to Redis 2014-12-25_22:34:03.31431 2014-12-25T22:34:03Z 18341 TID-s7i84 INFO: Pushed 0 messages back to Redis 2014-12-25_22:34:03.31484 2014-12-25T22:34:03Z 18341 TID-s7i84 INFO: Pushed 0 messages back to Redis 2014-12-25_22:34:03.31542 2014-12-25T22:34:03Z 18341 TID-s7i84 INFO: Pushed 0 messages back to Redis 2014-12-25_22:34:03.32363 2014-12-25T22:34:03Z 18341 TID-s7i84 INFO: Pushed 0 messages back to Redis ==> /var/log/gitlab/ci-sidekiq/state <== ==> /var/log/gitlab/nginx/current <== ==> /var/log/gitlab/nginx/gitlab_ci_access.log <== ==> /var/log/gitlab/nginx/state <== ==> /var/log/gitlab/nginx/gitlab_ci_error.log <== ==> /var/log/gitlab/nginx/gitlab_error.log <== ==> /var/log/gitlab/nginx/gitlab_access.log <== ==> /var/log/gitlab/nginx/error.log <== ==> /var/log/gitlab/ci-unicorn/unicorn_stdout.log <== ==> /var/log/gitlab/ci-unicorn/current <== 2014-12-25_22:31:39.28760 starting new unicorn master 2014-12-25_22:31:44.43013 adopted new unicorn master 17665 2014-12-25_22:33:35.55775 forwarding TERM to unicorn master 17665 2014-12-25_22:33:35.55805 forwarding CONT to unicorn master 17665 2014-12-25_22:33:36.55928 wrapper for unicorn master 17665 exiting 2014-12-25_22:33:45.41385 starting new unicorn master 2014-12-25_22:33:50.85789 adopted new unicorn master 18371 2014-12-25_22:34:09.87926 forwarding TERM to unicorn master 18371 2014-12-25_22:34:09.87931 forwarding CONT to unicorn master 18371 2014-12-25_22:34:10.88064 wrapper for unicorn master 18371 exiting ==> /var/log/gitlab/ci-unicorn/state <== ==> /var/log/gitlab/ci-unicorn/unicorn_stderr.log <== I, [2014-12-25T23:33:49.802811 #18371] INFO -- : unlinking existing socket=/var/opt/gitlab/gitlab-ci/sockets/gitlab.socket I, [2014-12-25T23:33:49.802946 #18371] INFO -- : listening on addr=/var/opt/gitlab/gitlab-ci/sockets/gitlab.socket fd=12 I, [2014-12-25T23:33:49.809125 #18445] INFO -- : worker=0 spawned pid=18445 I, [2014-12-25T23:33:49.809654 #18445] INFO -- : worker=0 ready I, [2014-12-25T23:33:49.814194 #18371] INFO -- : master process ready I, [2014-12-25T23:33:49.815234 #18448] INFO -- : worker=1 spawned pid=18448 I, [2014-12-25T23:33:49.815777 #18448] INFO -- : worker=1 ready I, [2014-12-25T23:34:09.979961 #18371] INFO -- : reaped #<Process::Status: pid 18445 exit 0> worker=0 I, [2014-12-25T23:34:09.980103 #18371] INFO -- : reaped #<Process::Status: pid 18448 exit 0> worker=1 I, [2014-12-25T23:34:09.980206 #18371] INFO -- : master complete ==> /var/log/gitlab/redis/current <== 2015-06-26_22:09:13.96791 `-._ `-._`-.__.-'_.-' _.-' 2015-06-26_22:09:13.96792 `-._ `-.__.-' _.-' 2015-06-26_22:09:13.96792 `-._ _.-' 2015-06-26_22:09:13.96793 `-.__.-' 2015-06-26_22:09:13.96793 2015-06-26_22:09:13.96793 [9622] 27 Jun 00:09:13.967 # Server started, Redis version 2.8.20 2015-06-26_22:09:13.96796 [9622] 27 Jun 00:09:13.967 # WARNING overcommit_memory is set to 0! Background save may fail under low memory condition. To fix this issue add 'vm.overcommit_memory = 1' to /etc/sysctl.conf and then reboot or run the command 'sysctl vm.overcommit_memory=1' for this to take effect. 2015-06-26_22:09:13.96800 [9622] 27 Jun 00:09:13.967 # WARNING: The TCP backlog setting of 511 cannot be enforced because /proc/sys/net/core/somaxconn is set to the lower value of 128. 2015-06-26_22:09:14.05474 [9622] 27 Jun 00:09:14.054 * DB loaded from disk: 0.087 seconds 2015-06-26_22:09:14.05478 [9622] 27 Jun 00:09:14.054 * The server is now ready to accept connections at /var/opt/gitlab/redis/redis.socket ==> /var/log/gitlab/redis/state <== ==> /var/log/gitlab/gitlab-ci/production.log <== ==> /var/log/gitlab/gitlab-rails/application.log <== ==> /var/log/gitlab/gitlab-rails/production.log <== ==> /var/log/gitlab/gitlab-rails/satellites.log <== ==> /var/log/gitlab/gitlab-rails/githost.log <== ==> /var/log/gitlab/gitlab-shell/gitlab-shell.log <== W, [2015-06-27T00:19:24.706762 #27564] WARN -- : Failed to connect to internal API <POST http://127.0.0.1:8080/api/v3/internal/allowed>: #<Errno::ECONNREFUSED: Connection refused - connect(2) for "127.0.0.1" port 8080> W, [2015-06-27T00:19:31.598691 #27646] WARN -- : Failed to connect to internal API <POST http://127.0.0.1:8080/api/v3/internal/allowed>: #<Errno::ECONNREFUSED: Connection refused - connect(2) for "127.0.0.1" port 8080> ==> /var/log/gitlab/postgresql/current <== 2015-06-26_22:08:50.30962 LOG: autovacuum launcher started 2015-06-26_22:09:12.30913 received TERM from runit, sending INT instead to force quit connections 2015-06-26_22:09:12.56600 LOG: received fast shutdown request 2015-06-26_22:09:12.56606 LOG: aborting any active transactions 2015-06-26_22:09:12.56607 LOG: autovacuum launcher shutting down 2015-06-26_22:09:12.56729 LOG: shutting down 2015-06-26_22:09:13.15553 LOG: database system is shut down 2015-06-26_22:09:13.74714 LOG: database system was shut down at 2015-06-26 22:09:12 GMT 2015-06-26_22:09:13.96578 LOG: database system is ready to accept connections 2015-06-26_22:09:13.96714 LOG: autovacuum launcher started ==> /var/log/gitlab/postgresql/state <== ==> /var/log/gitlab/ci-redis/current <== 2014-12-25_22:33:44.59130 [18336] 25 Dec 23:33:44.591 # WARNING overcommit_memory is set to 0! Background save may fail under low memory condition. To fix this issue add 'vm.overcommit_memory = 1' to /etc/sysctl.conf and then reboot or run the command 'sysctl vm.overcommit_memory=1' for this to take effect. 2014-12-25_22:33:44.59135 [18336] 25 Dec 23:33:44.591 * DB loaded from disk: 0.000 seconds 2014-12-25_22:33:44.59135 [18336] 25 Dec 23:33:44.591 * The server is now ready to accept connections on port 0 2014-12-25_22:33:44.59136 [18336] 25 Dec 23:33:44.591 * The server is now ready to accept connections at /var/opt/gitlab/ci-redis/redis.socket 2014-12-25_22:33:59.30897 [18336 | signal handler] (1419546839) Received SIGTERM, scheduling shutdown... 2014-12-25_22:33:59.31619 [18336] 25 Dec 23:33:59.316 # User requested shutdown... 2014-12-25_22:33:59.31621 [18336] 25 Dec 23:33:59.316 * Saving the final RDB snapshot before exiting. 2014-12-25_22:33:59.36101 [18336] 25 Dec 23:33:59.360 * DB saved on disk 2014-12-25_22:33:59.36190 [18336] 25 Dec 23:33:59.361 * Removing the unix socket file. 2014-12-25_22:33:59.36191 [18336] 25 Dec 23:33:59.361 # Redis is now ready to exit, bye bye... ==> /var/log/gitlab/ci-redis/state <== ==> /var/log/gitlab/sidekiq/current <== 2015-06-26_22:19:30.41462 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-3.3.0/lib/sidekiq/cli.rb:236:in `boot_system' 2015-06-26_22:19:30.41463 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-3.3.0/lib/sidekiq/cli.rb:50:in `run' 2015-06-26_22:19:30.41463 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-3.3.0/bin/sidekiq:8:in `<top (required)>' 2015-06-26_22:19:30.41463 /opt/gitlab/embedded/service/gem/ruby/2.1.0/bin/sidekiq:23:in `load' 2015-06-26_22:19:30.41464 /opt/gitlab/embedded/service/gem/ruby/2.1.0/bin/sidekiq:23:in `<main>' 2015-06-26_22:19:30.41618 2015-06-26T22:19:30.416Z 27519 TID-pvlgw INFO: [Sidetiq] Sidetiq::Actor::Clock id: 43480320 shutting down ... 2015-06-26_22:19:30.41756 2015-06-26T22:19:30.416Z 27519 TID-pv1p8 INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43442520 shutting down ... 2015-06-26_22:19:30.41765 2015-06-26T22:19:30.416Z 27519 TID-punuc INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43423980 shutting down ... 2015-06-26_22:19:30.41774 2015-06-26T22:19:30.417Z 27519 TID-pu9fg INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43404520 shutting down ... 2015-06-26_22:19:30.41782 2015-06-26T22:19:30.417Z 27519 TID-ptyes INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43390140 shutting down ... ==> /var/log/gitlab/sidekiq/state <== ==> /var/log/gitlab/sidekiq/current <== 2015-06-26_22:19:37.51950 2015-06-26T22:19:37.519Z 27626 TID-1ze7s INFO: [Sidetiq] Sidetiq v0.6.3 - Copyright (c) 2012-2013, Tobias Svensson <t...@tobiassvensson.co.uk> 2015-06-26_22:19:37.51954 2015-06-26T22:19:37.519Z 27626 TID-1ze7s INFO: [Sidetiq] Sidetiq is covered by the 3-clause BSD license. 2015-06-26_22:19:37.51955 2015-06-26T22:19:37.519Z 27626 TID-1ze7s INFO: [Sidetiq] See LICENSE and http://opensource.org/licenses/BSD-3-Clause for licensing details. 2015-06-26_22:19:37.51958 2015-06-26T22:19:37.519Z 27626 TID-1ze7s INFO: [Sidetiq] Sidetiq::Supervisor start 2015-06-26_22:19:37.52136 2015-06-26T22:19:37.521Z 27626 TID-pvc0c INFO: [Sidetiq] Sidetiq::Actor::Clock id: 43456160 initialize 2015-06-26_22:19:37.52400 2015-06-26T22:19:37.523Z 27626 TID-pubgs INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43406920 initialize 2015-06-26_22:19:37.52460 2015-06-26T22:19:37.524Z 27626 TID-pu028 INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43392600 initialize 2015-06-26_22:19:37.52514 2015-06-26T22:19:37.525Z 27626 TID-pton4 INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43385980 initialize 2015-06-26_22:19:37.52574 2015-06-26T22:19:37.525Z 27626 TID-ptp24 INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43370620 initialize 2015-06-26_22:19:39.13746 2015-06-26T22:19:39.137Z 27626 TID-1ze7s INFO: Booting Sidekiq 3.3.0 with redis options {:url=>"unix:/var/opt/gitlab/redis/redis.socket", :namespace=>"resque:gitlab"} 2015-06-26_22:19:39.21161 Permission denied @ rb_sysopen - /opt/gitlab/embedded/service/gitlab-rails/.gitlab_shell_secret 2015-06-26_22:19:39.21172 /opt/gitlab/embedded/service/gitlab-rails/config/initializers/gitlab_shell_secret_token.rb:13:in `write' 2015-06-26_22:19:39.21173 /opt/gitlab/embedded/service/gitlab-rails/config/initializers/gitlab_shell_secret_token.rb:13:in `<top (required)>' 2015-06-26_22:19:39.21174 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:241:in `load' 2015-06-26_22:19:39.21174 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:241:in `block in load' 2015-06-26_22:19:39.21174 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:232:in `load_dependency' 2015-06-26_22:19:39.21175 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:241:in `load' 2015-06-26_22:19:39.21175 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:648:in `block in load_config_initializer' 2015-06-26_22:19:39.21178 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/notifications.rb:161:in `instrument' 2015-06-26_22:19:39.21178 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:647:in `load_config_initializer' 2015-06-26_22:19:39.21179 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:612:in `block (2 levels) in <class:Engine>' 2015-06-26_22:19:39.21179 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:611:in `each' 2015-06-26_22:19:39.21180 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:611:in `block in <class:Engine>' 2015-06-26_22:19:39.21180 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:30:in `instance_exec' 2015-06-26_22:19:39.21180 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:30:in `run' 2015-06-26_22:19:39.21181 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:55:in `block in run_initializers' 2015-06-26_22:19:39.21181 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:226:in `block in tsort_each' 2015-06-26_22:19:39.21182 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:348:in `block (2 levels) in each_strongly_connected_component' 2015-06-26_22:19:39.21182 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:418:in `block (2 levels) in each_strongly_connected_component_from' 2015-06-26_22:19:39.21183 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:427:in `each_strongly_connected_component_from' 2015-06-26_22:19:39.21183 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:417:in `block in each_strongly_connected_component_from' 2015-06-26_22:19:39.21183 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:44:in `each' 2015-06-26_22:19:39.21184 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:44:in `tsort_each_child' 2015-06-26_22:19:39.21184 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:411:in `call' 2015-06-26_22:19:39.21184 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:411:in `each_strongly_connected_component_from' 2015-06-26_22:19:39.21185 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:347:in `block in each_strongly_connected_component' 2015-06-26_22:19:39.21185 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:345:in `each' 2015-06-26_22:19:39.21186 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:345:in `call' 2015-06-26_22:19:39.21186 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:345:in `each_strongly_connected_component' 2015-06-26_22:19:39.21186 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:224:in `tsort_each' 2015-06-26_22:19:39.21187 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:205:in `tsort_each' 2015-06-26_22:19:39.21187 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:54:in `run_initializers' 2015-06-26_22:19:39.21188 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/application.rb:300:in `initialize!' 2015-06-26_22:19:39.21188 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/railtie.rb:194:in `public_send' 2015-06-26_22:19:39.21188 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/railtie.rb:194:in `method_missing' 2015-06-26_22:19:39.21189 /opt/gitlab/embedded/service/gitlab-rails/config/environment.rb:5:in `<top (required)>' 2015-06-26_22:19:39.21189 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:247:in `require' 2015-06-26_22:19:39.21190 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:247:in `block in require' 2015-06-26_22:19:39.21190 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:232:in `load_dependency' 2015-06-26_22:19:39.21190 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:247:in `require' 2015-06-26_22:19:39.21204 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-3.3.0/lib/sidekiq/cli.rb:236:in `boot_system' 2015-06-26_22:19:39.21204 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-3.3.0/lib/sidekiq/cli.rb:50:in `run' 2015-06-26_22:19:39.21205 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-3.3.0/bin/sidekiq:8:in `<top (required)>' 2015-06-26_22:19:39.21205 /opt/gitlab/embedded/service/gem/ruby/2.1.0/bin/sidekiq:23:in `load' 2015-06-26_22:19:39.21205 /opt/gitlab/embedded/service/gem/ruby/2.1.0/bin/sidekiq:23:in `<main>' 2015-06-26_22:19:39.21334 2015-06-26T22:19:39.213Z 27626 TID-pvc0c INFO: [Sidetiq] Sidetiq::Actor::Clock id: 43456160 shutting down ... 2015-06-26_22:19:39.21553 2015-06-26T22:19:39.213Z 27626 TID-pubgs INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43406920 shutting down ... 2015-06-26_22:19:39.21555 2015-06-26T22:19:39.214Z 27626 TID-pu028 INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43392600 shutting down ... 2015-06-26_22:19:39.21556 2015-06-26T22:19:39.214Z 27626 TID-pton4 INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43385980 shutting down ... 2015-06-26_22:19:39.21556 2015-06-26T22:19:39.214Z 27626 TID-ptp24 INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43370620 shutting down ... ==> /var/log/gitlab/unicorn/unicorn_stderr.log <== /opt/gitlab/embedded/service/gitlab-rails/config/initializers/gitlab_shell_secret_token.rb:13:in `write': Permission denied @ rb_sysopen - /opt/gitlab/embedded/service/gitlab-rails/.gitlab_shell_secret (Errno::EACCES) from /opt/gitlab/embedded/service/gitlab-rails/config/initializers/gitlab_shell_secret_token.rb:13:in `<top (required)>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:241:in `load' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:241:in `block in load' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:232:in `load_dependency' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:241:in `load' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:648:in `block in load_config_initializer' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/notifications.rb:161:in `instrument' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:647:in `load_config_initializer' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:612:in `block (2 levels) in <class:Engine>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:611:in `each' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:611:in `block in <class:Engine>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:30:in `instance_exec' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:30:in `run' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:55:in `block in run_initializers' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:226:in `block in tsort_each' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:348:in `block (2 levels) in each_strongly_connected_component' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:418:in `block (2 levels) in each_strongly_connected_component_from' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:427:in `each_strongly_connected_component_from' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:417:in `block in each_strongly_connected_component_from' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:44:in `each' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:44:in `tsort_each_child' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:411:in `call' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:411:in `each_strongly_connected_component_from' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:347:in `block in each_strongly_connected_component' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:345:in `each' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:345:in `call' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:345:in `each_strongly_connected_component' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:224:in `tsort_each' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:205:in `tsort_each' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:54:in `run_initializers' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/application.rb:300:in `initialize!' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/railtie.rb:194:in `public_send' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/railtie.rb:194:in `method_missing' from /opt/gitlab/embedded/service/gitlab-rails/config/environment.rb:5:in `<top (required)>' from /opt/gitlab/embedded/service/gitlab-rails/config.ru:16:in `require' from /opt/gitlab/embedded/service/gitlab-rails/config.ru:16:in `block in <main>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/rack-1.5.4/lib/rack/builder.rb:55:in `instance_eval' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/rack-1.5.4/lib/rack/builder.rb:55:in `initialize' from /opt/gitlab/embedded/service/gitlab-rails/config.ru:1:in `new' from /opt/gitlab/embedded/service/gitlab-rails/config.ru:1:in `<main>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn.rb:48:in `eval' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn.rb:48:in `block in builder' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn/http_server.rb:722:in `call' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn/http_server.rb:722:in `build_app!' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn/http_server.rb:140:in `start' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/bin/unicorn:126:in `<top (required)>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/bin/unicorn:23:in `load' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/bin/unicorn:23:in `<main>' ==> /var/log/gitlab/gitlab-shell/gitlab-shell.log <== W, [2015-06-27T00:19:41.834999 #27767] WARN -- : Failed to connect to internal API <POST http://127.0.0.1:8080/api/v3/internal/allowed>: #<Errno::ECONNREFUSED: Connection refused - connect(2) for "127.0.0.1" port 8080> ==> /var/log/gitlab/unicorn/current <== 2015-06-26_22:19:41.88633 master failed to start, check stderr log for details 2015-06-26_22:19:42.89461 failed to start a new unicorn master 2015-06-26_22:19:42.97710 starting new unicorn master ==> /var/log/gitlab/unicorn/unicorn_stderr.log <== I, [2015-06-27T00:19:44.075297 #27792] INFO -- : Refreshing Gem list ==> /var/log/gitlab/sidekiq/current <== 2015-06-26_22:19:46.40857 2015-06-26T22:19:46.408Z 27754 TID-1ze7s INFO: [Sidetiq] Sidetiq v0.6.3 - Copyright (c) 2012-2013, Tobias Svensson <t...@tobiassvensson.co.uk> 2015-06-26_22:19:46.40861 2015-06-26T22:19:46.408Z 27754 TID-1ze7s INFO: [Sidetiq] Sidetiq is covered by the 3-clause BSD license. 2015-06-26_22:19:46.40862 2015-06-26T22:19:46.408Z 27754 TID-1ze7s INFO: [Sidetiq] See LICENSE and http://opensource.org/licenses/BSD-3-Clause for licensing details. 2015-06-26_22:19:46.40868 2015-06-26T22:19:46.408Z 27754 TID-1ze7s INFO: [Sidetiq] Sidetiq::Supervisor start 2015-06-26_22:19:46.41047 2015-06-26T22:19:46.410Z 27754 TID-pvbu8 INFO: [Sidetiq] Sidetiq::Actor::Clock id: 43455240 initialize 2015-06-26_22:19:46.41225 2015-06-26T22:19:46.412Z 27754 TID-pubjk INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43407000 initialize 2015-06-26_22:19:46.41280 2015-06-26T22:19:46.412Z 27754 TID-pu014 INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43392500 initialize 2015-06-26_22:19:46.41334 2015-06-26T22:19:46.413Z 27754 TID-ptom0 INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43385940 initialize 2015-06-26_22:19:46.41383 2015-06-26T22:19:46.413Z 27754 TID-ptcmc INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43370640 initialize 2015-06-26_22:19:48.06668 2015-06-26T22:19:48.066Z 27754 TID-1ze7s INFO: Booting Sidekiq 3.3.0 with redis options {:url=>"unix:/var/opt/gitlab/redis/redis.socket", :namespace=>"resque:gitlab"} 2015-06-26_22:19:48.13692 Permission denied @ rb_sysopen - /opt/gitlab/embedded/service/gitlab-rails/.gitlab_shell_secret 2015-06-26_22:19:48.13696 /opt/gitlab/embedded/service/gitlab-rails/config/initializers/gitlab_shell_secret_token.rb:13:in `write' 2015-06-26_22:19:48.13697 /opt/gitlab/embedded/service/gitlab-rails/config/initializers/gitlab_shell_secret_token.rb:13:in `<top (required)>' 2015-06-26_22:19:48.13698 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:241:in `load' 2015-06-26_22:19:48.13699 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:241:in `block in load' 2015-06-26_22:19:48.13700 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:232:in `load_dependency' 2015-06-26_22:19:48.13701 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:241:in `load' 2015-06-26_22:19:48.13701 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:648:in `block in load_config_initializer' 2015-06-26_22:19:48.13702 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/notifications.rb:161:in `instrument' 2015-06-26_22:19:48.13706 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:647:in `load_config_initializer' 2015-06-26_22:19:48.13706 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:612:in `block (2 levels) in <class:Engine>' 2015-06-26_22:19:48.13707 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:611:in `each' 2015-06-26_22:19:48.13707 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:611:in `block in <class:Engine>' 2015-06-26_22:19:48.13708 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:30:in `instance_exec' 2015-06-26_22:19:48.13708 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:30:in `run' 2015-06-26_22:19:48.13708 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:55:in `block in run_initializers' 2015-06-26_22:19:48.13709 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:226:in `block in tsort_each' 2015-06-26_22:19:48.13709 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:348:in `block (2 levels) in each_strongly_connected_component' 2015-06-26_22:19:48.13709 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:418:in `block (2 levels) in each_strongly_connected_component_from' 2015-06-26_22:19:48.13710 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:427:in `each_strongly_connected_component_from' 2015-06-26_22:19:48.13711 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:417:in `block in each_strongly_connected_component_from' 2015-06-26_22:19:48.13711 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:44:in `each' 2015-06-26_22:19:48.13711 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:44:in `tsort_each_child' 2015-06-26_22:19:48.13712 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:411:in `call' 2015-06-26_22:19:48.13712 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:411:in `each_strongly_connected_component_from' 2015-06-26_22:19:48.13712 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:347:in `block in each_strongly_connected_component' 2015-06-26_22:19:48.13713 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:345:in `each' 2015-06-26_22:19:48.13713 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:345:in `call' 2015-06-26_22:19:48.13713 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:345:in `each_strongly_connected_component' 2015-06-26_22:19:48.13714 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:224:in `tsort_each' 2015-06-26_22:19:48.13714 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:205:in `tsort_each' 2015-06-26_22:19:48.13715 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:54:in `run_initializers' 2015-06-26_22:19:48.13715 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/application.rb:300:in `initialize!' 2015-06-26_22:19:48.13716 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/railtie.rb:194:in `public_send' 2015-06-26_22:19:48.13716 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/railtie.rb:194:in `method_missing' 2015-06-26_22:19:48.13716 /opt/gitlab/embedded/service/gitlab-rails/config/environment.rb:5:in `<top (required)>' 2015-06-26_22:19:48.13717 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:247:in `require' 2015-06-26_22:19:48.13717 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:247:in `block in require' 2015-06-26_22:19:48.13718 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:232:in `load_dependency' 2015-06-26_22:19:48.13718 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:247:in `require' 2015-06-26_22:19:48.13719 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-3.3.0/lib/sidekiq/cli.rb:236:in `boot_system' 2015-06-26_22:19:48.13719 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-3.3.0/lib/sidekiq/cli.rb:50:in `run' 2015-06-26_22:19:48.13721 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-3.3.0/bin/sidekiq:8:in `<top (required)>' 2015-06-26_22:19:48.13721 /opt/gitlab/embedded/service/gem/ruby/2.1.0/bin/sidekiq:23:in `load' 2015-06-26_22:19:48.13722 /opt/gitlab/embedded/service/gem/ruby/2.1.0/bin/sidekiq:23:in `<main>' 2015-06-26_22:19:48.13845 2015-06-26T22:19:48.138Z 27754 TID-pvbu8 INFO: [Sidetiq] Sidetiq::Actor::Clock id: 43455240 shutting down ... 2015-06-26_22:19:48.13864 2015-06-26T22:19:48.138Z 27754 TID-pubjk INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43407000 shutting down ... 2015-06-26_22:19:48.13881 2015-06-26T22:19:48.138Z 27754 TID-ptom0 INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43385940 shutting down ... 2015-06-26_22:19:48.13964 2015-06-26T22:19:48.139Z 27754 TID-pu014 INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43392500 shutting down ... 2015-06-26_22:19:48.13993 2015-06-26T22:19:48.139Z 27754 TID-ptcmc INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43370640 shutting down ... ==> /var/log/gitlab/gitlab-shell/gitlab-shell.log <== W, [2015-06-27T00:19:49.804644 #27844] WARN -- : Failed to connect to internal API <POST http://127.0.0.1:8080/api/v3/internal/allowed>: #<Errno::ECONNREFUSED: Connection refused - connect(2) for "127.0.0.1" port 8080> ==> /var/log/gitlab/unicorn/unicorn_stderr.log <== /opt/gitlab/embedded/service/gitlab-rails/config/initializers/gitlab_shell_secret_token.rb:13:in `write': Permission denied @ rb_sysopen - /opt/gitlab/embedded/service/gitlab-rails/.gitlab_shell_secret (Errno::EACCES) from /opt/gitlab/embedded/service/gitlab-rails/config/initializers/gitlab_shell_secret_token.rb:13:in `<top (required)>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:241:in `load' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:241:in `block in load' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:232:in `load_dependency' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:241:in `load' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:648:in `block in load_config_initializer' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/notifications.rb:161:in `instrument' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:647:in `load_config_initializer' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:612:in `block (2 levels) in <class:Engine>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:611:in `each' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:611:in `block in <class:Engine>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:30:in `instance_exec' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:30:in `run' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:55:in `block in run_initializers' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:226:in `block in tsort_each' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:348:in `block (2 levels) in each_strongly_connected_component' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:418:in `block (2 levels) in each_strongly_connected_component_from' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:427:in `each_strongly_connected_component_from' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:417:in `block in each_strongly_connected_component_from' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:44:in `each' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:44:in `tsort_each_child' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:411:in `call' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:411:in `each_strongly_connected_component_from' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:347:in `block in each_strongly_connected_component' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:345:in `each' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:345:in `call' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:345:in `each_strongly_connected_component' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:224:in `tsort_each' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:205:in `tsort_each' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:54:in `run_initializers' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/application.rb:300:in `initialize!' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/railtie.rb:194:in `public_send' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/railtie.rb:194:in `method_missing' from /opt/gitlab/embedded/service/gitlab-rails/config/environment.rb:5:in `<top (required)>' from /opt/gitlab/embedded/service/gitlab-rails/config.ru:16:in `require' from /opt/gitlab/embedded/service/gitlab-rails/config.ru:16:in `block in <main>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/rack-1.5.4/lib/rack/builder.rb:55:in `instance_eval' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/rack-1.5.4/lib/rack/builder.rb:55:in `initialize' from /opt/gitlab/embedded/service/gitlab-rails/config.ru:1:in `new' from /opt/gitlab/embedded/service/gitlab-rails/config.ru:1:in `<main>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn.rb:48:in `eval' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn.rb:48:in `block in builder' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn/http_server.rb:722:in `call' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn/http_server.rb:722:in `build_app!' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn/http_server.rb:140:in `start' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/bin/unicorn:126:in `<top (required)>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/bin/unicorn:23:in `load' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/bin/unicorn:23:in `<main>' ==> /var/log/gitlab/unicorn/current <== 2015-06-26_22:19:51.64331 master failed to start, check stderr log for details 2015-06-26_22:19:52.64625 failed to start a new unicorn master 2015-06-26_22:19:52.70915 starting new unicorn master ==> /var/log/gitlab/unicorn/unicorn_stderr.log <== I, [2015-06-27T00:19:53.899999 #27907] INFO -- : Refreshing Gem list ==> /var/log/gitlab/gitlab-shell/gitlab-shell.log <== W, [2015-06-27T00:19:54.022373 #27910] WARN -- : Failed to connect to internal API <POST http://127.0.0.1:8080/api/v3/internal/allowed>: #<Errno::ECONNREFUSED: Connection refused - connect(2) for "127.0.0.1" port 8080> ==> /var/log/gitlab/sidekiq/current <== 2015-06-26_22:19:55.56193 2015-06-26T22:19:55.561Z 27834 TID-1ze7s INFO: [Sidetiq] Sidetiq v0.6.3 - Copyright (c) 2012-2013, Tobias Svensson <t...@tobiassvensson.co.uk> 2015-06-26_22:19:55.56197 2015-06-26T22:19:55.561Z 27834 TID-1ze7s INFO: [Sidetiq] Sidetiq is covered by the 3-clause BSD license. 2015-06-26_22:19:55.56198 2015-06-26T22:19:55.561Z 27834 TID-1ze7s INFO: [Sidetiq] See LICENSE and http://opensource.org/licenses/BSD-3-Clause for licensing details. 2015-06-26_22:19:55.56201 2015-06-26T22:19:55.561Z 27834 TID-1ze7s INFO: [Sidetiq] Sidetiq::Supervisor start 2015-06-26_22:19:55.56355 2015-06-26T22:19:55.563Z 27834 TID-pv5fo INFO: [Sidetiq] Sidetiq::Actor::Clock id: 43446820 initialize 2015-06-26_22:19:55.56535 2015-06-26T22:19:55.565Z 27834 TID-pubrc INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43407300 initialize 2015-06-26_22:19:55.56605 2015-06-26T22:19:55.565Z 27834 TID-pu050 INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43392680 initialize 2015-06-26_22:19:55.56663 2015-06-26T22:19:55.566Z 27834 TID-ptouc INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43386080 initialize 2015-06-26_22:19:55.56720 2015-06-26T22:19:55.567Z 27834 TID-ptcuo INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43370920 initialize 2015-06-26_22:19:57.45750 2015-06-26T22:19:57.457Z 27834 TID-1ze7s INFO: Booting Sidekiq 3.3.0 with redis options {:url=>"unix:/var/opt/gitlab/redis/redis.socket", :namespace=>"resque:gitlab"} 2015-06-26_22:19:57.52917 Permission denied @ rb_sysopen - /opt/gitlab/embedded/service/gitlab-rails/.gitlab_shell_secret 2015-06-26_22:19:57.52920 /opt/gitlab/embedded/service/gitlab-rails/config/initializers/gitlab_shell_secret_token.rb:13:in `write' 2015-06-26_22:19:57.52921 /opt/gitlab/embedded/service/gitlab-rails/config/initializers/gitlab_shell_secret_token.rb:13:in `<top (required)>' 2015-06-26_22:19:57.52921 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:241:in `load' 2015-06-26_22:19:57.52922 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:241:in `block in load' 2015-06-26_22:19:57.52922 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:232:in `load_dependency' 2015-06-26_22:19:57.52922 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:241:in `load' 2015-06-26_22:19:57.52923 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:648:in `block in load_config_initializer' 2015-06-26_22:19:57.52923 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/notifications.rb:161:in `instrument' 2015-06-26_22:19:57.52923 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:647:in `load_config_initializer' 2015-06-26_22:19:57.52924 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:612:in `block (2 levels) in <class:Engine>' 2015-06-26_22:19:57.52927 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:611:in `each' 2015-06-26_22:19:57.52928 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:611:in `block in <class:Engine>' 2015-06-26_22:19:57.52928 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:30:in `instance_exec' 2015-06-26_22:19:57.52929 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:30:in `run' 2015-06-26_22:19:57.52930 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:55:in `block in run_initializers' 2015-06-26_22:19:57.52931 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:226:in `block in tsort_each' 2015-06-26_22:19:57.52931 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:348:in `block (2 levels) in each_strongly_connected_component' 2015-06-26_22:19:57.52931 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:418:in `block (2 levels) in each_strongly_connected_component_from' 2015-06-26_22:19:57.52932 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:427:in `each_strongly_connected_component_from' 2015-06-26_22:19:57.52933 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:417:in `block in each_strongly_connected_component_from' 2015-06-26_22:19:57.52933 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:44:in `each' 2015-06-26_22:19:57.52933 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:44:in `tsort_each_child' 2015-06-26_22:19:57.52934 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:411:in `call' 2015-06-26_22:19:57.52934 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:411:in `each_strongly_connected_component_from' 2015-06-26_22:19:57.52934 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:347:in `block in each_strongly_connected_component' 2015-06-26_22:19:57.52935 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:345:in `each' 2015-06-26_22:19:57.52935 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:345:in `call' 2015-06-26_22:19:57.52936 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:345:in `each_strongly_connected_component' 2015-06-26_22:19:57.52936 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:224:in `tsort_each' 2015-06-26_22:19:57.52936 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:205:in `tsort_each' 2015-06-26_22:19:57.52937 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:54:in `run_initializers' 2015-06-26_22:19:57.52938 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/application.rb:300:in `initialize!' 2015-06-26_22:19:57.52938 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/railtie.rb:194:in `public_send' 2015-06-26_22:19:57.52938 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/railtie.rb:194:in `method_missing' 2015-06-26_22:19:57.52939 /opt/gitlab/embedded/service/gitlab-rails/config/environment.rb:5:in `<top (required)>' 2015-06-26_22:19:57.52939 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:247:in `require' 2015-06-26_22:19:57.52940 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:247:in `block in require' 2015-06-26_22:19:57.52941 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:232:in `load_dependency' 2015-06-26_22:19:57.52941 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:247:in `require' 2015-06-26_22:19:57.52942 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-3.3.0/lib/sidekiq/cli.rb:236:in `boot_system' 2015-06-26_22:19:57.52943 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-3.3.0/lib/sidekiq/cli.rb:50:in `run' 2015-06-26_22:19:57.52943 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-3.3.0/bin/sidekiq:8:in `<top (required)>' 2015-06-26_22:19:57.52944 /opt/gitlab/embedded/service/gem/ruby/2.1.0/bin/sidekiq:23:in `load' 2015-06-26_22:19:57.52945 /opt/gitlab/embedded/service/gem/ruby/2.1.0/bin/sidekiq:23:in `<main>' 2015-06-26_22:19:57.53089 2015-06-26T22:19:57.530Z 27834 TID-pv5fo INFO: [Sidetiq] Sidetiq::Actor::Clock id: 43446820 shutting down ... 2015-06-26_22:19:57.53150 2015-06-26T22:19:57.530Z 27834 TID-pubrc INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43407300 shutting down ... 2015-06-26_22:19:57.53162 2015-06-26T22:19:57.531Z 27834 TID-pu050 INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43392680 shutting down ... 2015-06-26_22:19:57.53170 2015-06-26T22:19:57.531Z 27834 TID-ptouc INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43386080 shutting down ... 2015-06-26_22:19:57.53171 2015-06-26T22:19:57.531Z 27834 TID-ptcuo INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43370920 shutting down ... ==> /var/log/gitlab/unicorn/unicorn_stderr.log <== /opt/gitlab/embedded/service/gitlab-rails/config/initializers/gitlab_shell_secret_token.rb:13:in `write': Permission denied @ rb_sysopen - /opt/gitlab/embedded/service/gitlab-rails/.gitlab_shell_secret (Errno::EACCES) from /opt/gitlab/embedded/service/gitlab-rails/config/initializers/gitlab_shell_secret_token.rb:13:in `<top (required)>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:241:in `load' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:241:in `block in load' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:232:in `load_dependency' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:241:in `load' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:648:in `block in load_config_initializer' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/notifications.rb:161:in `instrument' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:647:in `load_config_initializer' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:612:in `block (2 levels) in <class:Engine>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:611:in `each' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:611:in `block in <class:Engine>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:30:in `instance_exec' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:30:in `run' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:55:in `block in run_initializers' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:226:in `block in tsort_each' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:348:in `block (2 levels) in each_strongly_connected_component' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:418:in `block (2 levels) in each_strongly_connected_component_from' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:427:in `each_strongly_connected_component_from' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:417:in `block in each_strongly_connected_component_from' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:44:in `each' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:44:in `tsort_each_child' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:411:in `call' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:411:in `each_strongly_connected_component_from' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:347:in `block in each_strongly_connected_component' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:345:in `each' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:345:in `call' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:345:in `each_strongly_connected_component' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:224:in `tsort_each' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:205:in `tsort_each' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:54:in `run_initializers' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/application.rb:300:in `initialize!' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/railtie.rb:194:in `public_send' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/railtie.rb:194:in `method_missing' from /opt/gitlab/embedded/service/gitlab-rails/config/environment.rb:5:in `<top (required)>' from /opt/gitlab/embedded/service/gitlab-rails/config.ru:16:in `require' from /opt/gitlab/embedded/service/gitlab-rails/config.ru:16:in `block in <main>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/rack-1.5.4/lib/rack/builder.rb:55:in `instance_eval' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/rack-1.5.4/lib/rack/builder.rb:55:in `initialize' from /opt/gitlab/embedded/service/gitlab-rails/config.ru:1:in `new' from /opt/gitlab/embedded/service/gitlab-rails/config.ru:1:in `<main>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn.rb:48:in `eval' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn.rb:48:in `block in builder' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn/http_server.rb:722:in `call' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn/http_server.rb:722:in `build_app!' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn/http_server.rb:140:in `start' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/bin/unicorn:126:in `<top (required)>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/bin/unicorn:23:in `load' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/bin/unicorn:23:in `<main>' ==> /var/log/gitlab/unicorn/current <== 2015-06-26_22:20:01.28846 master failed to start, check stderr log for details 2015-06-26_22:20:02.46741 failed to start a new unicorn master 2015-06-26_22:20:02.53506 starting new unicorn master ==> /var/log/gitlab/unicorn/unicorn_stderr.log <== I, [2015-06-27T00:20:03.606889 #28050] INFO -- : Refreshing Gem list ==> /var/log/gitlab/sidekiq/current <== 2015-06-26_22:20:06.82597 2015-06-26T22:20:06.825Z 27944 TID-1ze7s INFO: [Sidetiq] Sidetiq v0.6.3 - Copyright (c) 2012-2013, Tobias Svensson <t...@tobiassvensson.co.uk> 2015-06-26_22:20:06.82601 2015-06-26T22:20:06.825Z 27944 TID-1ze7s INFO: [Sidetiq] Sidetiq is covered by the 3-clause BSD license. 2015-06-26_22:20:06.82602 2015-06-26T22:20:06.826Z 27944 TID-1ze7s INFO: [Sidetiq] See LICENSE and http://opensource.org/licenses/BSD-3-Clause for licensing details. 2015-06-26_22:20:06.82606 2015-06-26T22:20:06.826Z 27944 TID-1ze7s INFO: [Sidetiq] Sidetiq::Supervisor start 2015-06-26_22:20:06.82739 2015-06-26T22:20:06.827Z 27944 TID-pv5jk INFO: [Sidetiq] Sidetiq::Actor::Clock id: 43447660 initialize 2015-06-26_22:20:06.82907 2015-06-26T22:20:06.828Z 27944 TID-pubek INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43406820 initialize 2015-06-26_22:20:06.82965 2015-06-26T22:20:06.829Z 27944 TID-pu014 INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43392600 initialize 2015-06-26_22:20:06.83019 2015-06-26T22:20:06.830Z 27944 TID-ptouc INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43385800 initialize 2015-06-26_22:20:06.83083 2015-06-26T22:20:06.830Z 27944 TID-ptmko INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43370740 initialize 2015-06-26_22:20:08.41742 2015-06-26T22:20:08.417Z 27944 TID-1ze7s INFO: Booting Sidekiq 3.3.0 with redis options {:url=>"unix:/var/opt/gitlab/redis/redis.socket", :namespace=>"resque:gitlab"} 2015-06-26_22:20:08.48663 Permission denied @ rb_sysopen - /opt/gitlab/embedded/service/gitlab-rails/.gitlab_shell_secret 2015-06-26_22:20:08.48667 /opt/gitlab/embedded/service/gitlab-rails/config/initializers/gitlab_shell_secret_token.rb:13:in `write' 2015-06-26_22:20:08.48668 /opt/gitlab/embedded/service/gitlab-rails/config/initializers/gitlab_shell_secret_token.rb:13:in `<top (required)>' 2015-06-26_22:20:08.48668 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:241:in `load' 2015-06-26_22:20:08.48669 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:241:in `block in load' 2015-06-26_22:20:08.48669 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:232:in `load_dependency' 2015-06-26_22:20:08.48669 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:241:in `load' 2015-06-26_22:20:08.48670 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:648:in `block in load_config_initializer' 2015-06-26_22:20:08.48671 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/notifications.rb:161:in `instrument' 2015-06-26_22:20:08.48671 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:647:in `load_config_initializer' 2015-06-26_22:20:08.48672 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:612:in `block (2 levels) in <class:Engine>' 2015-06-26_22:20:08.48672 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:611:in `each' 2015-06-26_22:20:08.48672 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:611:in `block in <class:Engine>' 2015-06-26_22:20:08.48676 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:30:in `instance_exec' 2015-06-26_22:20:08.48676 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:30:in `run' 2015-06-26_22:20:08.48677 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:55:in `block in run_initializers' 2015-06-26_22:20:08.48677 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:226:in `block in tsort_each' 2015-06-26_22:20:08.48677 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:348:in `block (2 levels) in each_strongly_connected_component' 2015-06-26_22:20:08.48678 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:418:in `block (2 levels) in each_strongly_connected_component_from' 2015-06-26_22:20:08.48678 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:427:in `each_strongly_connected_component_from' 2015-06-26_22:20:08.48679 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:417:in `block in each_strongly_connected_component_from' 2015-06-26_22:20:08.48679 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:44:in `each' 2015-06-26_22:20:08.48680 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:44:in `tsort_each_child' 2015-06-26_22:20:08.48680 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:411:in `call' 2015-06-26_22:20:08.48680 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:411:in `each_strongly_connected_component_from' 2015-06-26_22:20:08.48681 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:347:in `block in each_strongly_connected_component' 2015-06-26_22:20:08.48681 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:345:in `each' 2015-06-26_22:20:08.48681 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:345:in `call' 2015-06-26_22:20:08.48682 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:345:in `each_strongly_connected_component' 2015-06-26_22:20:08.48682 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:224:in `tsort_each' 2015-06-26_22:20:08.48683 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:205:in `tsort_each' 2015-06-26_22:20:08.48683 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:54:in `run_initializers' 2015-06-26_22:20:08.48684 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/application.rb:300:in `initialize!' 2015-06-26_22:20:08.48684 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/railtie.rb:194:in `public_send' 2015-06-26_22:20:08.48685 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/railtie.rb:194:in `method_missing' 2015-06-26_22:20:08.48685 /opt/gitlab/embedded/service/gitlab-rails/config/environment.rb:5:in `<top (required)>' 2015-06-26_22:20:08.48685 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:247:in `require' 2015-06-26_22:20:08.48686 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:247:in `block in require' 2015-06-26_22:20:08.48686 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:232:in `load_dependency' 2015-06-26_22:20:08.48686 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:247:in `require' 2015-06-26_22:20:08.48687 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-3.3.0/lib/sidekiq/cli.rb:236:in `boot_system' 2015-06-26_22:20:08.48688 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-3.3.0/lib/sidekiq/cli.rb:50:in `run' 2015-06-26_22:20:08.48688 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-3.3.0/bin/sidekiq:8:in `<top (required)>' 2015-06-26_22:20:08.48689 /opt/gitlab/embedded/service/gem/ruby/2.1.0/bin/sidekiq:23:in `load' 2015-06-26_22:20:08.48689 /opt/gitlab/embedded/service/gem/ruby/2.1.0/bin/sidekiq:23:in `<main>' 2015-06-26_22:20:08.48893 2015-06-26T22:20:08.488Z 27944 TID-pv5jk INFO: [Sidetiq] Sidetiq::Actor::Clock id: 43447660 shutting down ... 2015-06-26_22:20:08.48899 2015-06-26T22:20:08.488Z 27944 TID-pubek INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43406820 shutting down ... 2015-06-26_22:20:08.48900 2015-06-26T22:20:08.488Z 27944 TID-pu014 INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43392600 shutting down ... 2015-06-26_22:20:08.48964 2015-06-26T22:20:08.489Z 27944 TID-ptouc INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43385800 shutting down ... 2015-06-26_22:20:08.48966 2015-06-26T22:20:08.489Z 27944 TID-ptmko INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43370740 shutting down ... ==> /var/log/gitlab/unicorn/unicorn_stderr.log <== /opt/gitlab/embedded/service/gitlab-rails/config/initializers/gitlab_shell_secret_token.rb:13:in `write': Permission denied @ rb_sysopen - /opt/gitlab/embedded/service/gitlab-rails/.gitlab_shell_secret (Errno::EACCES) from /opt/gitlab/embedded/service/gitlab-rails/config/initializers/gitlab_shell_secret_token.rb:13:in `<top (required)>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:241:in `load' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:241:in `block in load' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:232:in `load_dependency' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:241:in `load' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:648:in `block in load_config_initializer' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/notifications.rb:161:in `instrument' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:647:in `load_config_initializer' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:612:in `block (2 levels) in <class:Engine>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:611:in `each' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:611:in `block in <class:Engine>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:30:in `instance_exec' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:30:in `run' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:55:in `block in run_initializers' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:226:in `block in tsort_each' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:348:in `block (2 levels) in each_strongly_connected_component' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:418:in `block (2 levels) in each_strongly_connected_component_from' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:427:in `each_strongly_connected_component_from' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:417:in `block in each_strongly_connected_component_from' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:44:in `each' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:44:in `tsort_each_child' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:411:in `call' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:411:in `each_strongly_connected_component_from' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:347:in `block in each_strongly_connected_component' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:345:in `each' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:345:in `call' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:345:in `each_strongly_connected_component' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:224:in `tsort_each' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:205:in `tsort_each' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:54:in `run_initializers' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/application.rb:300:in `initialize!' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/railtie.rb:194:in `public_send' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/railtie.rb:194:in `method_missing' from /opt/gitlab/embedded/service/gitlab-rails/config/environment.rb:5:in `<top (required)>' from /opt/gitlab/embedded/service/gitlab-rails/config.ru:16:in `require' from /opt/gitlab/embedded/service/gitlab-rails/config.ru:16:in `block in <main>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/rack-1.5.4/lib/rack/builder.rb:55:in `instance_eval' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/rack-1.5.4/lib/rack/builder.rb:55:in `initialize' from /opt/gitlab/embedded/service/gitlab-rails/config.ru:1:in `new' from /opt/gitlab/embedded/service/gitlab-rails/config.ru:1:in `<main>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn.rb:48:in `eval' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn.rb:48:in `block in builder' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn/http_server.rb:722:in `call' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn/http_server.rb:722:in `build_app!' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn/http_server.rb:140:in `start' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/bin/unicorn:126:in `<top (required)>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/bin/unicorn:23:in `load' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/bin/unicorn:23:in `<main>' ==> /var/log/gitlab/unicorn/current <== 2015-06-26_22:20:10.94248 master failed to start, check stderr log for details 2015-06-26_22:20:11.94606 failed to start a new unicorn master 2015-06-26_22:20:11.99334 starting new unicorn master ==> /var/log/gitlab/unicorn/unicorn_stderr.log <== I, [2015-06-27T00:20:13.209923 #28137] INFO -- : Refreshing Gem list ==> /var/log/gitlab/sidekiq/current <== 2015-06-26_22:20:15.60168 2015-06-26T22:20:15.601Z 28085 TID-1ze7s INFO: [Sidetiq] Sidetiq v0.6.3 - Copyright (c) 2012-2013, Tobias Svensson <t...@tobiassvensson.co.uk> 2015-06-26_22:20:15.60172 2015-06-26T22:20:15.601Z 28085 TID-1ze7s INFO: [Sidetiq] Sidetiq is covered by the 3-clause BSD license. 2015-06-26_22:20:15.60173 2015-06-26T22:20:15.601Z 28085 TID-1ze7s INFO: [Sidetiq] See LICENSE and http://opensource.org/licenses/BSD-3-Clause for licensing details. 2015-06-26_22:20:15.60176 2015-06-26T22:20:15.601Z 28085 TID-1ze7s INFO: [Sidetiq] Sidetiq::Supervisor start 2015-06-26_22:20:15.60340 2015-06-26T22:20:15.603Z 28085 TID-pujoc INFO: [Sidetiq] Sidetiq::Actor::Clock id: 43426880 initialize 2015-06-26_22:20:15.60480 2015-06-26T22:20:15.604Z 28085 TID-pty6g INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43390080 initialize 2015-06-26_22:20:15.60523 2015-06-26T22:20:15.605Z 28085 TID-ptmng INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43375400 initialize 2015-06-26_22:20:15.60566 2015-06-26T22:20:15.605Z 28085 TID-ptb1o INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43373760 initialize 2015-06-26_22:20:15.60613 2015-06-26T22:20:15.606Z 28085 TID-psyd0 INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43352260 initialize 2015-06-26_22:20:17.19677 2015-06-26T22:20:17.196Z 28085 TID-1ze7s INFO: Booting Sidekiq 3.3.0 with redis options {:url=>"unix:/var/opt/gitlab/redis/redis.socket", :namespace=>"resque:gitlab"} 2015-06-26_22:20:17.26634 Permission denied @ rb_sysopen - /opt/gitlab/embedded/service/gitlab-rails/.gitlab_shell_secret 2015-06-26_22:20:17.26638 /opt/gitlab/embedded/service/gitlab-rails/config/initializers/gitlab_shell_secret_token.rb:13:in `write' 2015-06-26_22:20:17.26639 /opt/gitlab/embedded/service/gitlab-rails/config/initializers/gitlab_shell_secret_token.rb:13:in `<top (required)>' 2015-06-26_22:20:17.26639 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:241:in `load' 2015-06-26_22:20:17.26640 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:241:in `block in load' 2015-06-26_22:20:17.26640 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:232:in `load_dependency' 2015-06-26_22:20:17.26641 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:241:in `load' 2015-06-26_22:20:17.26642 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:648:in `block in load_config_initializer' 2015-06-26_22:20:17.26642 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/notifications.rb:161:in `instrument' 2015-06-26_22:20:17.26642 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:647:in `load_config_initializer' 2015-06-26_22:20:17.26643 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:612:in `block (2 levels) in <class:Engine>' 2015-06-26_22:20:17.26644 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:611:in `each' 2015-06-26_22:20:17.26644 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:611:in `block in <class:Engine>' 2015-06-26_22:20:17.26644 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:30:in `instance_exec' 2015-06-26_22:20:17.26645 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:30:in `run' 2015-06-26_22:20:17.26648 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:55:in `block in run_initializers' 2015-06-26_22:20:17.26649 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:226:in `block in tsort_each' 2015-06-26_22:20:17.26650 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:348:in `block (2 levels) in each_strongly_connected_component' 2015-06-26_22:20:17.26650 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:418:in `block (2 levels) in each_strongly_connected_component_from' 2015-06-26_22:20:17.26651 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:427:in `each_strongly_connected_component_from' 2015-06-26_22:20:17.26653 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:417:in `block in each_strongly_connected_component_from' 2015-06-26_22:20:17.26654 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:44:in `each' 2015-06-26_22:20:17.26654 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:44:in `tsort_each_child' 2015-06-26_22:20:17.26655 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:411:in `call' 2015-06-26_22:20:17.26656 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:411:in `each_strongly_connected_component_from' 2015-06-26_22:20:17.26656 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:347:in `block in each_strongly_connected_component' 2015-06-26_22:20:17.26657 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:345:in `each' 2015-06-26_22:20:17.26657 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:345:in `call' 2015-06-26_22:20:17.26658 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:345:in `each_strongly_connected_component' 2015-06-26_22:20:17.26658 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:224:in `tsort_each' 2015-06-26_22:20:17.26659 /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:205:in `tsort_each' 2015-06-26_22:20:17.26660 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:54:in `run_initializers' 2015-06-26_22:20:17.26661 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/application.rb:300:in `initialize!' 2015-06-26_22:20:17.26661 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/railtie.rb:194:in `public_send' 2015-06-26_22:20:17.26662 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/railtie.rb:194:in `method_missing' 2015-06-26_22:20:17.26662 /opt/gitlab/embedded/service/gitlab-rails/config/environment.rb:5:in `<top (required)>' 2015-06-26_22:20:17.26663 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:247:in `require' 2015-06-26_22:20:17.26664 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:247:in `block in require' 2015-06-26_22:20:17.26664 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:232:in `load_dependency' 2015-06-26_22:20:17.26665 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:247:in `require' 2015-06-26_22:20:17.26666 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-3.3.0/lib/sidekiq/cli.rb:236:in `boot_system' 2015-06-26_22:20:17.26666 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-3.3.0/lib/sidekiq/cli.rb:50:in `run' 2015-06-26_22:20:17.26667 /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/sidekiq-3.3.0/bin/sidekiq:8:in `<top (required)>' 2015-06-26_22:20:17.26667 /opt/gitlab/embedded/service/gem/ruby/2.1.0/bin/sidekiq:23:in `load' 2015-06-26_22:20:17.26668 /opt/gitlab/embedded/service/gem/ruby/2.1.0/bin/sidekiq:23:in `<main>' 2015-06-26_22:20:17.26783 2015-06-26T22:20:17.267Z 28085 TID-pujoc INFO: [Sidetiq] Sidetiq::Actor::Clock id: 43426880 shutting down ... 2015-06-26_22:20:17.26840 2015-06-26T22:20:17.268Z 28085 TID-ptmng INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43375400 shutting down ... 2015-06-26_22:20:17.26889 2015-06-26T22:20:17.268Z 28085 TID-ptb1o INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43373760 shutting down ... 2015-06-26_22:20:17.26893 2015-06-26T22:20:17.268Z 28085 TID-psyd0 INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43352260 shutting down ... 2015-06-26_22:20:17.26901 2015-06-26T22:20:17.268Z 28085 TID-pty6g INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43390080 shutting down ... ==> /var/log/gitlab/unicorn/unicorn_stderr.log <== /opt/gitlab/embedded/service/gitlab-rails/config/initializers/gitlab_shell_secret_token.rb:13:in `write': Permission denied @ rb_sysopen - /opt/gitlab/embedded/service/gitlab-rails/.gitlab_shell_secret (Errno::EACCES) from /opt/gitlab/embedded/service/gitlab-rails/config/initializers/gitlab_shell_secret_token.rb:13:in `<top (required)>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:241:in `load' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:241:in `block in load' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:232:in `load_dependency' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/dependencies.rb:241:in `load' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:648:in `block in load_config_initializer' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/activesupport-4.1.11/lib/active_support/notifications.rb:161:in `instrument' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:647:in `load_config_initializer' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:612:in `block (2 levels) in <class:Engine>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:611:in `each' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/engine.rb:611:in `block in <class:Engine>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:30:in `instance_exec' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:30:in `run' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:55:in `block in run_initializers' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:226:in `block in tsort_each' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:348:in `block (2 levels) in each_strongly_connected_component' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:418:in `block (2 levels) in each_strongly_connected_component_from' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:427:in `each_strongly_connected_component_from' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:417:in `block in each_strongly_connected_component_from' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:44:in `each' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:44:in `tsort_each_child' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:411:in `call' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:411:in `each_strongly_connected_component_from' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:347:in `block in each_strongly_connected_component' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:345:in `each' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:345:in `call' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:345:in `each_strongly_connected_component' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:224:in `tsort_each' from /opt/gitlab/embedded/lib/ruby/2.1.0/tsort.rb:205:in `tsort_each' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/initializable.rb:54:in `run_initializers' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/application.rb:300:in `initialize!' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/railtie.rb:194:in `public_send' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/railties-4.1.11/lib/rails/railtie.rb:194:in `method_missing' from /opt/gitlab/embedded/service/gitlab-rails/config/environment.rb:5:in `<top (required)>' from /opt/gitlab/embedded/service/gitlab-rails/config.ru:16:in `require' from /opt/gitlab/embedded/service/gitlab-rails/config.ru:16:in `block in <main>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/rack-1.5.4/lib/rack/builder.rb:55:in `instance_eval' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/rack-1.5.4/lib/rack/builder.rb:55:in `initialize' from /opt/gitlab/embedded/service/gitlab-rails/config.ru:1:in `new' from /opt/gitlab/embedded/service/gitlab-rails/config.ru:1:in `<main>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn.rb:48:in `eval' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn.rb:48:in `block in builder' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn/http_server.rb:722:in `call' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn/http_server.rb:722:in `build_app!' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/lib/unicorn/http_server.rb:140:in `start' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/unicorn-4.6.3/bin/unicorn:126:in `<top (required)>' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/bin/unicorn:23:in `load' from /opt/gitlab/embedded/service/gem/ruby/2.1.0/bin/unicorn:23:in `<main>' ==> /var/log/gitlab/unicorn/current <== 2015-06-26_22:20:20.54350 master failed to start, check stderr log for details ==> /var/log/gitlab/nginx/gitlab_error.log <== 2015/06/27 00:20:20 [error] 9583#0: *57 connect() to unix:/var/opt/gitlab/gitlab-rails/sockets/gitlab.socket failed (111: Connection refused) while connecting to upstream, client: 127.0.0.1, server: git.jeroendeneef.com, request: "GET /Jeroen/rcrp-faction-badge-system/issues?assignee_id=1&author_id=0&label_name=curve%2Ctext&milestone_id=0&scope=all&sort=milestone_due_desc&state=opened HTTP/1.1", upstream: "http://unix:/var/opt/gitlab/gitlab-rails/sockets/gitlab.socket:/Jeroen/rcrp-faction-badge-system/issues?assignee_id=1&author_id=0&label_name=curve%2Ctext&milestone_id=0&scope=all&sort=milestone_due_desc&state=opened", host: "git.jeroendeneef.com" ==> /var/log/gitlab/nginx/gitlab_access.log <== 127.0.0.1 - - [27/Jun/2015:00:20:20 +0200] "GET /Jeroen/rcrp-faction-badge-system/issues?assignee_id=1&author_id=0&label_name=curve%2Ctext&milestone_id=0&scope=all&sort=milestone_due_desc&state=opened HTTP/1.1" 502 429 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)" ==> /var/log/gitlab/unicorn/current <== 2015-06-26_22:20:21.55105 failed to start a new unicorn master 2015-06-26_22:20:21.59873 starting new unicorn master ==> /var/log/gitlab/unicorn/unicorn_stderr.log <== I, [2015-06-27T00:20:23.026656 #28212] INFO -- : Refreshing Gem list ==> /var/log/gitlab/sidekiq/current <== 2015-06-26_22:20:24.08775 2015-06-26T22:20:24.087Z 28162 TID-1ze7s INFO: [Sidetiq] Sidetiq v0.6.3 - Copyright (c) 2012-2013, Tobias Svensson <t...@tobiassvensson.co.uk> 2015-06-26_22:20:24.08779 2015-06-26T22:20:24.087Z 28162 TID-1ze7s INFO: [Sidetiq] Sidetiq is covered by the 3-clause BSD license. 2015-06-26_22:20:24.08786 2015-06-26T22:20:24.087Z 28162 TID-1ze7s INFO: [Sidetiq] See LICENSE and http://opensource.org/licenses/BSD-3-Clause for licensing details. 2015-06-26_22:20:24.08793 2015-06-26T22:20:24.087Z 28162 TID-1ze7s INFO: [Sidetiq] Sidetiq::Supervisor start 2015-06-26_22:20:24.08922 2015-06-26T22:20:24.089Z 28162 TID-pvbnk INFO: [Sidetiq] Sidetiq::Actor::Clock id: 43454900 initialize 2015-06-26_22:20:24.09073 2015-06-26T22:20:24.090Z 28162 TID-publ8 INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43407060 initialize 2015-06-26_22:20:24.09132 2015-06-26T22:20:24.091Z 28162 TID-pu02s INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43392560 initialize 2015-06-26_22:20:24.09186 2015-06-26T22:20:24.091Z 28162 TID-pton4 INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43385960 initialize 2015-06-26_22:20:24.09238 2015-06-26T22:20:24.092Z 28162 TID-ptcp4 INFO: [Sidetiq] Sidetiq::Actor::Handler id: 43370700 initialize
Haynes
Jul 2, 2015, 2:00:26 AM7/2/15
to gitl...@googlegroups.com
Hi Jeroen,
did you see this line?:
did you see this line?:
Permission denied @ rb_sysopen - /opt/gitlab/embedded/service/gitlab-rails/.gitlab_shell_secret
Please check the permissions of this file.
regards,
Haynes
...
Jeroen de Neef
Jul 2, 2015, 3:52:11 AM7/2/15
to gitl...@googlegroups.com
Seems that the symbolic link disappeared after updating to the latest revisions.
I'll look into restoring it.
--
You received this message because you are subscribed to the Google Groups "GitLab" group.
To unsubscribe from this group and stop receiving emails from it, send an email to gitlabhq+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/gitlabhq/2304cb70-25d9-4c2c-9396-727b27624fa7%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Jeroen de Neef
Jul 2, 2015, 3:52:21 AM7/2/15
to gitl...@googlegroups.com
And creating an issue ticket.
Jeroen de Neef
Jul 2, 2015, 4:25:56 AM7/2/15
to gitl...@googlegroups.com
It seems that adding the symbolic link that points towards /etc/gitlab/gitlab-secrets.json works, thanks!
I'll create an issue on the GitLab project.
Reply all
Reply to author
Forward
0 new messages