Ubuntu 14.04/Trusty setup/deployments?

[Jamie Orchard-Hays]

Curious if the RM team is using Trusty yet. I just set up a test server cluster of three and tried setup and deployment.

Setup:
* setup succeeds with brightbox21
* setup fails with src21 and /usr/bin/ruby2.1 is not written (/usr/bin/ruby* is)

Deployment:
* Apache installs but Passenger 4 and 5 fail to build and install properly
* assets:precompile fails
* apache restart fails from dependency failure (assuming Passenger not there for now)

Looking for ideas/help.

Cheers,
Jamie

Passenger compile / Apache restart failure:

** [out :: ip-address] Notice: /Exec[build_passenger]/returns: /var/lib/gems/2.1.0/gems/passenger-4.0.58/build/cplusplus_support.rb:51:in `run_compiler'
** [out :: ip-address] Notice: /Exec[build_passenger]/returns: /var/lib/gems/2.1.0/gems/passenger-4.0.58/build/cplusplus_support.rb:61:in `compile_cxx'
** [out :: ip-address] Notice: /Exec[build_passenger]/returns: /var/lib/gems/2.1.0/gems/passenger-4.0.58/build/agents.rb:95:in `block in <top (required)>'
** [out :: ip-address] Notice: /Exec[build_passenger]/returns: Tasks: TOP => apache2 => buildout/agents/PassengerHelperAgent
** [out :: ip-address] Notice: /Exec[build_passenger]/returns: (See full trace by running task with --trace)
** [out :: ip-address] Error: sudo /usr/bin/ruby -S rake clean apache2 returned 1 instead of one of [0]
** [out :: ip-address] Error: /Exec[build_passenger]/returns: change from notrun to 0 failed: sudo /usr/bin/ruby -S rake clean apache2 returned 1 instead of one of [0]
** [out :: ip-address] Notice: /File[/etc/apache2/mods-available/passenger.conf]: Dependency Exec[build_passenger] has failures: true
** [out :: ip-address] Warning: /File[/etc/apache2/mods-available/passenger.conf]: Skipping because of failed dependencies
** [out :: ip-address] Notice: /File[/etc/apache2/mods-available/passenger.load]: Dependency Exec[build_passenger] has failures: true
** [out :: ip-address] Warning: /File[/etc/apache2/mods-available/passenger.load]: Skipping because of failed dependencies
** [out :: ip-address] Notice: /Exec[a2enmod passenger]: Dependency Exec[build_passenger] has failures: true
** [out :: ip-address] Warning: /Exec[a2enmod passenger]: Skipping because of failed dependencies
** [out :: ip-address] Notice: /File[/etc/apache2/sites-available/staging.conf]: Dependency Exec[build_passenger] has failures: true
** [out :: ip-address] Warning: /File[/etc/apache2/sites-available/staging.conf]: Skipping because of failed dependencies
** [out :: ip-address] Notice: /Exec[a2ensite staging]: Dependency Exec[build_passenger] has failures: true
** [out :: ip-address] Warning: /Exec[a2ensite staging]: Skipping because of failed dependencies
** [out :: ip-address] Notice: /Exec[a2dissite 000-default]: Dependency Exec[build_passenger] has failures: true
** [out :: ip-address] Warning: /Exec[a2dissite 000-default]: Skipping because of failed dependencies
** [out :: ip-address] Notice: /Service[apache2]: Dependency Exec[build_passenger] has failures: true
** [out :: ip-address] Warning: /Service[apache2]: Skipping because of failed dependencies



assets:precompile trace:

** [out :: ip-address] Notice: /Exec[bundle exec rake assets:precompile]/returns: /usr/bin/ruby2.1 /usr/local/bin/rake assets:precompile:all RAILS_ENV=staging RAILS_GROUPS=assets
** [out :: ip-address] Notice: /Exec[bundle exec rake assets:precompile]/returns: rake aborted!
** [out :: ip-address] Notice: /Exec[bundle exec rake assets:precompile]/returns: execution expired
** [out :: ip-address] Notice: /Exec[bundle exec rake assets:precompile]/returns: /srv/staging/shared/bundle/ruby/2.1.0/gems/mongo-1.11.1/lib/mongo/connection/socket/tcp_socket.rb:56:in `connect'
** [out :: ip-address] Notice: /Exec[bundle exec rake assets:precompile]/returns: /srv/staging/shared/bundle/ruby/2.1.0/gems/mongo-1.11.1/lib/mongo/connection/socket/tcp_socket.rb:56:in `block in connect'
** [out :: ip-address] Notice: /Exec[bundle exec rake assets:precompile]/returns: /srv/staging/shared/bundle/ruby/2.1.0/gems/mongo-1.11.1/lib/mongo/connection/socket/tcp_socket.rb:55:in `connect'
** [out :: ip-address] Notice: /Exec[bundle exec rake assets:precompile]/returns: /srv/staging/shared/bundle/ruby/2.1.0/gems/mongo-1.11.1/lib/mongo/connection/socket/tcp_socket.rb:43:in `block in handle_connect'
** [out :: ip-address] Notice: /Exec[bundle exec rake assets:precompile]/returns: /srv/staging/shared/bundle/ruby/2.1.0/gems/mongo-1.11.1/lib/mongo/connection/socket/tcp_socket.rb:38:in `each'
** [out :: ip-address] Notice: /Exec[bundle exec rake assets:precompile]/returns: /srv/staging/shared/bundle/ruby/2.1.0/gems/mongo-1.11.1/lib/mongo/connection/socket/tcp_socket.rb:38:in `handle_connect'
** [out :: ip-address] Notice: /Exec[bundle exec rake assets:precompile]/returns: /srv/staging/shared/bundle/ruby/2.1.0/gems/mongo-1.11.1/lib/mongo/connection/socket/tcp_socket.rb:30:in `initialize'
** [out :: ip-address] Notice: /Exec[bundle exec rake assets:precompile]/returns: /srv/staging/shared/bundle/ruby/2.1.0/gems/mongo-1.11.1/lib/mongo/mongo_client.rb:544:in `new'
** [out :: ip-address] Notice: /Exec[bundle exec rake assets:precompile]/returns: /srv/staging/shared/bundle/ruby/2.1.0/gems/mongo-1.11.1/lib/mongo/mongo_client.rb:544:in `check_is_master'
** [out :: ip-address] Notice: /Exec[bundle exec rake assets:precompile]/returns: /srv/staging/shared/bundle/ruby/2.1.0/gems/mongo-1.11.1/lib/mongo/mongo_client.rb:400:in `connect'
** [out :: ip-address] Notice: /Exec[bundle exec rake assets:precompile]/returns: /srv/staging/shared/bundle/ruby/2.1.0/gems/mongo-1.11.1/lib/mongo/mongo_client.rb:661:in `setup'
** [out :: ip-address] Notice: /Exec[bundle exec rake assets:precompile]/returns: /srv/staging/shared/bundle/ruby/2.1.0/gems/mongo-1.11.1/lib/mongo/mongo_client.rb:177:in `initialize'
** [out :: ip-address]
** [out :: ip-address] Notice: /Exec[bundle exec rake assets:precompile]/returns: /srv/staging/shared/bundle/ruby/2.1.0/gems/mongo-1.11.1/lib/mongo/legacy.rb:52:in `initialize'
** [out :: ip-address]
** [out :: ip-address] Notice: /Exec[bundle exec rake assets:precompile]/returns: /srv/staging/releases/20150419203122/config/initializers/mongo.rb:30:in `new'
** [out :: ip-address]
** [out :: ip-address] Notice: /Exec[bundle exec rake assets:precompile]/returns: /srv/staging/releases/20150419203122/config/initializers/mongo.rb:30:in `<top (required)>'
** [out :: ip-address]
** [out :: ip-address] Notice: /Exec[bundle exec rake assets:precompile]/returns: /srv/staging/shared/bundle/ruby/2.1.0/gems/activesupport-3.2.20/lib/active_support/dependencies.rb:245:in `load'
** [out :: ip-address]
** [out :: ip-address] Notice: /Exec[bundle exec rake assets:precompile]/returns: /srv/staging/shared/bundle/ruby/2.1.0/gems/activesupport-3.2.20/lib/active_support/dependencies.rb:245:in `block in load'
** [out :: ip-address]
** [out :: ip-address] Notice: /Exec[bundle exec rake assets:precompile]/returns: /srv/staging/shared/bundle/ruby/2.1.0/gems/activesupport-3.2.20/lib/active_support/dependencies.rb:236:in `load_dependency'
** [out :: ip-address]
** [out :: ip-address] Notice: /Exec[bundle exec rake assets:precompile]/returns: /srv/staging/shared/bundle/ruby/2.1.0/gems/activesupport-3.2.20/lib/active_support/dependencies.rb:245:in `load'
** [out :: ip-address]
** [out :: ip-address] Notice: /Exec[bundle exec rake assets:precompile]/returns: /srv/staging/shared/bundle/ruby/2.1.0/gems/railties-3.2.20/lib/rails/engine.rb:593:in `block (2 levels) in <class:Engine>'
** [out :: ip-address]
** [out :: ip-address] Notice: /Exec[bundle exec rake assets:precompile]/returns: /srv/staging/shared/bundle/ruby/2.1.0/gems/railties-3.2.20/lib/rails/engine.rb:592:in `each'
** [out :: ip-address]
** [out :: ip-address] Notice: /Exec[bundle exec rake assets:precompile]/returns: /srv/staging/shared/bundle/ruby/2.1.0/gems/railties-3.2.20/lib/rails/engine.rb:592:in `block in <class:Engine>'
** [out :: ip-address]
** [out :: ip-address] Notice: /Exec[bundle exec rake assets:precompile]/returns: /srv/staging/shared/bundle/ruby/2.1.0/gems/railties-3.2.20/lib/rails/initializable.rb:30:in `instance_exec'
** [out :: ip-address]
** [out :: ip-address] Notice: /Exec[bundle exec rake assets:precompile]/returns: /srv/staging/shared/bundle/ruby/2.1.0/gems/railties-3.2.20/lib/rails/initializable.rb:30:in `run'
** [out :: ip-address]
** [out :: ip-address] Notice: /Exec[bundle exec rake assets:precompile]/returns: /srv/staging/shared/bundle/ruby/2.1.0/gems/railties-3.2.20/lib/rails/initializable.rb:55:in `block in run_initializers'
** [out :: ip-address]
** [out :: ip-address] Notice: /Exec[bundle exec rake assets:precompile]/returns: /srv/staging/shared/bundle/ruby/2.1.0/gems/railties-3.2.20/lib/rails/initializable.rb:54:in `each'
** [out :: ip-address]
** [out :: ip-address] Notice: /Exec[bundle exec rake assets:precompile]/returns: /srv/staging/shared/bundle/ruby/2.1.0/gems/railties-3.2.20/lib/rails/initializable.rb:54:in `run_initializers'
** [out :: ip-address]
** [out :: ip-address] Notice: /Exec[bundle exec rake assets:precompile]/returns: /srv/staging/shared/bundle/ruby/2.1.0/gems/railties-3.2.20/lib/rails/application.rb:136:in `initialize!'
** [out :: ip-address]
** [out :: ip-address] Notice: /Exec[bundle exec rake assets:precompile]/returns: /srv/staging/shared/bundle/ruby/2.1.0/gems/railties-3.2.20/lib/rails/railtie/configurable.rb:30:in `method_missing'
** [out :: ip-address]
** [out :: ip-address] Notice: /Exec[bundle exec rake assets:precompile]/returns: /srv/staging/releases/20150419203122/config/environment.rb:5:in `<top (required)>'
** [out :: ip-address]
** [out :: ip-address] Notice: /Exec[bundle exec rake assets:precompile]/returns: /srv/staging/shared/bundle/ruby/2.1.0/gems/activesupport-3.2.20/lib/active_support/dependencies.rb:251:in `require'
** [out :: ip-address]
** [out :: ip-address] Notice: /Exec[bundle exec rake assets:precompile]/returns: /srv/staging/shared/bundle/ruby/2.1.0/gems/activesupport-3.2.20/lib/active_support/dependencies.rb:251:in `block in require'
** [out :: ip-address]
** [out :: ip-address] Notice: /Exec[bundle exec rake assets:precompile]/returns: /srv/staging/shared/bundle/ruby/2.1.0/gems/activesupport-3.2.20/lib/active_support/dependencies.rb:236:in `load_dependency'
** [out :: ip-address]
** [out :: ip-address] Notice: /Exec[bundle exec rake assets:precompile]/returns: /srv/staging/shared/bundle/ruby/2.1.0/gems/activesupport-3.2.20/lib/active_support/dependencies.rb:251:in `require'
** [out :: ip-address]
** [out :: ip-address] Notice: /Exec[bundle exec rake assets:precompile]/returns: /srv/staging/shared/bundle/ruby/2.1.0/gems/railties-3.2.20/lib/rails/application.rb:103:in `require_environment!'
** [out :: ip-address]
** [out :: ip-address] Notice: /Exec[bundle exec rake assets:precompile]/returns: /srv/staging/shared/bundle/ruby/2.1.0/gems/railties-3.2.20/lib/rails/application.rb:305:in `block (2 levels) in initialize_tasks'
** [out :: ip-address]
** [out :: ip-address] Notice: /Exec[bundle exec rake assets:precompile]/returns: /srv/staging/shared/bundle/ruby/2.1.0/gems/actionpack-3.2.20/lib/sprockets/assets.rake:93:in `block (2 levels) in <top (required)>'
** [out :: ip-address]
** [out :: ip-address] Notice: /Exec[bundle exec rake assets:precompile]/returns: /srv/staging/shared/bundle/ruby/2.1.0/gems/actionpack-3.2.20/lib/sprockets/assets.rake:60:in `block (3 levels) in <top (required)>'
** [out :: ip-address]
** [out :: ip-address] Notice: /Exec[bundle exec rake assets:precompile]/returns: Tasks: TOP => environment
** [out :: ip-address]
** [out :: ip-address] Notice: /Exec[bundle exec rake assets:precompile]/returns: (See full trace by running task with --trace)
** [out :: ip-address]
** [out :: ip-address] Notice: /Exec[bundle exec rake assets:precompile]/returns: rake aborted!
** [out :: ip-address]
** [out :: ip-address] Notice: /Exec[bundle exec rake assets:precompile]/returns: Command failed with status (1): [/usr/bin/ruby2.1 /usr/local/bin/rake asset...]
** [out :: ip-address]
** [out :: ip-address] Notice: /Exec[bundle exec rake assets:precompile]/returns: /srv/staging/shared/bundle/ruby/2.1.0/gems/actionpack-3.2.20/lib/sprockets/assets.rake:12:in `ruby_rake_task'
** [out :: ip-address]
** [out :: ip-address] Notice: /Exec[bundle exec rake assets:precompile]/returns: /srv/staging/shared/bundle/ruby/2.1.0/gems/actionpack-3.2.20/lib/sprockets/assets.rake:21:in `invoke_or_reboot_rake_task'
** [out :: ip-address]
** [out :: ip-address] Notice: /Exec[bundle exec rake assets:precompile]/returns: /srv/staging/shared/bundle/ruby/2.1.0/gems/actionpack-3.2.20/lib/sprockets/assets.rake:29:in `block (2 levels) in <top (required)>'
** [out :: ip-address]
** [out :: ip-address] Notice: /Exec[bundle exec rake assets:precompile]/returns: Tasks: TOP => assets:precompile
** [out :: ip-address]
** [out :: ip-address] Notice: /Exec[bundle exec rake assets:precompile]/returns: (See full trace by running task with --trace)
** [out :: ip-address]
** [out :: ip-address] Error: bundle exec rake assets:precompile returned 1 instead of one of [0]
** [out :: ip-address]
** [out :: ip-address] Error: /Exec[bundle exec rake assets:precompile]/returns: change from notrun to 0 failed: bundle exec rake assets:precompile returned 1 instead of one of [0]

[Jamie Orchard-Hays]

The assets:precompile failure was my own from a misconfiguration related to the mongo driver in conf/initializers. Solved that. Still can't get Passenger compiled/installed:


** [out :: ip-address] Notice: /Exec[build_passenger]/returns: Command failed with status (1): [c++ -o buildout/agents/PassengerHelperAgent.o -Iext -Iext/common -Iext/libev -Iext/libeio -D_REENTRANT -I/usr/local/include -Wall -Wextra -Wno-unused-parameter -Wno-parentheses -Wpointer-arith -Wwrite-strings -Wno-long-long -Wno-missing-field-initializers -fcommon -feliminate-unused-debug-symbols -feliminate-unused-debug-types -fvisibility=hidden -DVISIBILITY_ATTRIBUTE_SUPPORTED -Wno-attributes -ggdb -DHAS_ALLOCA_H -DHAVE_ACCEPT4 -DHAS_SFENCE -DHAS_LFENCE -DPASSENGER_DEBUG -DBOOST_DISABLE_ASSERTS -std=gnu++11 -Wno-unused-local-typedefs -DHASH_NAMESPACE="__gnu_cxx" -DHASH_MAP_HEADER="<hash_map>" -DHASH_MAP_CLASS="hash_map" -DHASH_FUN_H="<hash_fun.h>" -c ext/common/agents/HelperAgent/Main.cpp]

** [out :: ip-address] Notice: /Exec[build_passenger]/returns: /var/lib/gems/2.1.0/gems/passenger-4.0.58/build/cplusplus_support.rb:51:in `run_compiler'
** [out :: ip-address] Notice: /Exec[build_passenger]/returns: /var/lib/gems/2.1.0/gems/passenger-4.0.58/build/cplusplus_support.rb:61:in `compile_cxx'
** [out :: ip-address] Notice: /Exec[build_passenger]/returns: /var/lib/gems/2.1.0/gems/passenger-4.0.58/build/agents.rb:95:in `block in <top (required)>'
** [out :: ip-address] Notice: /Exec[build_passenger]/returns: Tasks: TOP => apache2 => buildout/agents/PassengerHelperAgent
** [out :: ip-address] Notice: /Exec[build_passenger]/returns: (See full trace by running task with --trace)
** [out :: ip-address] Error: sudo /usr/bin/ruby -S rake clean apache2 returned 1 instead of one of [0]
** [out :: ip-address] Error: /Exec[build_passenger]/returns: change from notrun to 0 failed: sudo /usr/bin/ruby -S rake clean apache2 returned 1 instead of one of [0]
** [out :: ip-address] Notice: /File[/etc/apache2/mods-available/passenger.conf]: Dependency Exec[build_passenger] has failures: true
** [out :: ip-address] Warning: /File[/etc/apache2/mods-available/passenger.conf]: Skipping because of failed dependencies
** [out :: ip-address] Notice: /File[/etc/apache2/mods-available/passenger.load]: Dependency Exec[build_passenger] has failures: true
** [out :: ip-address] Warning: /File[/etc/apache2/mods-available/passenger.load]: Skipping because of failed dependencies
** [out :: ip-address] Notice: /Exec[a2enmod passenger]: Dependency Exec[build_passenger] has failures: true
** [out :: ip-address] Warning: /Exec[a2enmod passenger]: Skipping because of failed dependencies
** [out :: ip-address] Notice: /File[/etc/apache2/sites-available/staging.conf]: Dependency Exec[build_passenger] has failures: true
** [out :: ip-address] Warning: /File[/etc/apache2/sites-available/staging.conf]: Skipping because of failed dependencies
** [out :: ip-address] Notice: /Exec[a2ensite staging]: Dependency Exec[build_passenger] has failures: true
** [out :: ip-address] Warning: /Exec[a2ensite staging]: Skipping because of failed dependencies
** [out :: ip-address] Notice: /Exec[a2dissite 000-default]: Dependency Exec[build_passenger] has failures: true
** [out :: ip-address] Warning: /Exec[a2dissite 000-default]: Skipping because of failed dependencies
** [out :: ip-address] Notice: /Service[apache2]: Dependency Exec[build_passenger] has failures: true
** [out :: ip-address] Warning: /Service[apache2]: Skipping because of failed dependencies

** [out :: ip-address] Notice: /Service[apache2]: Triggered 'refresh' from 7 events

[Jamie Orchard-Hays]

A few lines above this I just noticed:

Notice: /Exec[build_passenger]/returns: virtual memory exhausted: Cannot allocate memory

I'm flummoxed. 1 gig RAM. 20 gigs on drive. 17 available. Regular 14.04 installation. Erroneous?

[Jamie Orchard-Hays]

Looks like I solved this. Since I last created Ubuntu images on Rackspace, they've changed the default behavior of their images to *not* create swap space. Once I created a swap space on the web server instance, Passenger compilation and installation succeeded.

Cheers,

Jamie