Cassandra - config-related issue

148 views

Skip to first unread message

nagaedadm

unread,

Feb 27, 2021, 6:47:12 PM2/27/21

to Canvas LMS Users

Hi,

I have successfully launched a self-hosted instance of Canvas in AWS.

I am now exploring the instructure analytics package.

I don't have enough experience with Cassandra and have stood up an ubuntu cassandra server in AWS.

I've checked the following ports are open in my security group: (as per the datastax article- https://docs.datastax.com/en/cassandra-oss/3.0/cassandra/configuration/secureFireWall.html )

9042

9160

9142

after following the instructions on

ubu...@ip-XXX.XXX.XXX.XXX:/var/canvas$ sudo bundle exec rake db:migrate

/var/canvas/vendor/bundle/ruby/2.6.0/gems/soap4r-ruby1.9-2.0.5/lib/soap/mapping/encodedregistry.rb:150: warning: constant ::Fixnum is deprecated

/var/canvas/vendor/bundle/ruby/2.6.0/gems/soap4r-ruby1.9-2.0.5/lib/soap/mapping/encodedregistry.rb:216: warning: constant ::Fixnum is deprecated

rake aborted!

ActiveRecord::AdapterNotSpecified: 'development' database is not configured. Available: ["production"]

/var/canvas/vendor/bundle/ruby/2.6.0/gems/activerecord-5.2.4.4/lib/active_record/connection_adapters/connection_specification.rb:260:in `resolve_symbol_connection'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/activerecord-5.2.4.4/lib/active_record/connection_adapters/connection_specification.rb:241:in `resolve_connection'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/activerecord-5.2.4.4/lib/active_record/connection_adapters/connection_specification.rb:143:in `resolve'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/activerecord-5.2.4.4/lib/active_record/connection_handling.rb:57:in `establish_connection'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/activerecord-5.2.4.4/lib/active_record/railtie.rb:136:in `block (2 levels) in <class:Railtie>'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/activesupport-5.2.4.4/lib/active_support/lazy_load_hooks.rb:71:in `instance_eval'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/activesupport-5.2.4.4/lib/active_support/lazy_load_hooks.rb:71:in `block in execute_hook'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/activesupport-5.2.4.4/lib/active_support/lazy_load_hooks.rb:62:in `with_execution_control'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/activesupport-5.2.4.4/lib/active_support/lazy_load_hooks.rb:67:in `execute_hook'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/activesupport-5.2.4.4/lib/active_support/lazy_load_hooks.rb:43:in `block in on_load'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/activesupport-5.2.4.4/lib/active_support/lazy_load_hooks.rb:42:in `each'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/activesupport-5.2.4.4/lib/active_support/lazy_load_hooks.rb:42:in `on_load'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/activerecord-5.2.4.4/lib/active_record/railtie.rb:132:in `block in <class:Railtie>'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/railties-5.2.4.4/lib/rails/initializable.rb:32:in `instance_exec'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/railties-5.2.4.4/lib/rails/initializable.rb:32:in `run'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/railties-5.2.4.4/lib/rails/initializable.rb:61:in `block in run_initializers'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/railties-5.2.4.4/lib/rails/initializable.rb:60:in `run_initializers'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/railties-5.2.4.4/lib/rails/application.rb:361:in `initialize!'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/railties-5.2.4.4/lib/rails/railtie.rb:190:in `public_send'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/railties-5.2.4.4/lib/rails/railtie.rb:190:in `method_missing'

/var/canvas/config/environment.rb:28:in `<top (required)>'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/activesupport-5.2.4.4/lib/active_support/dependencies.rb:291:in `require'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/activesupport-5.2.4.4/lib/active_support/dependencies.rb:291:in `block in require'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/activesupport-5.2.4.4/lib/active_support/dependencies.rb:257:in `load_dependency'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/activesupport-5.2.4.4/lib/active_support/dependencies.rb:291:in `require'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/railties-5.2.4.4/lib/rails/application.rb:337:in `require_environment!'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/railties-5.2.4.4/lib/rails/application.rb:520:in `block in run_tasks_blocks'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/rake-13.0.1/exe/rake:27:in `<top (required)>'

Tasks: TOP => db:migrate => db:load_config => environment

(See full trace by running task with --trace)

----

My confusion is: why is the rake db:migrate command insisting on setting this up for development when my cassandra.yml only includes a directive for 'production'?

I have wiped out the development and test sections and have just this in cassandra.yml:

production:

page_views:

servers:

- XXX.XXX.XXX.XXX:9160

keyspace: page_views

auditors:

servers:

- XXX.XXX.XXX.XXX:9160

keyspace: auditors

All of this was run after creating the equivalent keyspaces in cassandra :

CREATE KEYSPACE page_views WITH REPLICATION = { 'class' : 'SimpleStrategy', 'replication_factor' : 1 };

# CREATE KEYSPACE page_views_test WITH REPLICATION = { 'class' : 'SimpleStrategy', 'replication_factor' : 1 };

# CREATE KEYSPACE auditors WITH REPLICATION = { 'class' : 'SimpleStrategy', 'replication_factor' : 1 };

# CREATE KEYSPACE auditors_test WITH REPLICATION = { 'class' : 'SimpleStrategy', 'replication_factor' : 1 };

Would anyone have any advice on their experience setting up Cassandra?

NOTE:

my dynamic_settings.yml only has the directives for the Rich Content Editor.

Do I need to configure anything there?

Also, I have enabled redis_cache_store in the cache_store.yml

Ralph

unread,

Feb 27, 2021, 7:03:47 PM2/27/21

to Canvas LMS Users

bundle exec rake db:migrate will attempt to use the development block. You should prefix the command as follows:

RAILS_ENV=production bundle exec rake db:migrate

nagaedadm

unread,

Feb 27, 2021, 8:33:23 PM2/27/21

to Canvas LMS Users

Ralph,

Thank you for the hint - I clearly need to learn a bit more about rails.

I got a little further but now have the issue where I am still encountering a migrate issue - trace is below:

sysa...@xxx.xxx.xxx.xxx:/var/canvas$ sudo RAILS_ENV=production bundle exec rake db:migrate

/var/canvas/vendor/bundle/ruby/2.6.0/gems/soap4r-ruby1.9-2.0.5/lib/soap/mapping/encodedregistry.rb:150: warning: constant ::Fixnum is deprecated

/var/canvas/vendor/bundle/ruby/2.6.0/gems/soap4r-ruby1.9-2.0.5/lib/soap/mapping/encodedregistry.rb:216: warning: constant ::Fixnum is deprecated

1: production:public

== AddCassandraPageViewTables: migrating =====================================

rake aborted!

StandardError: An error has occurred, this and all later migrations canceled:

undefined method `db' for nil:NilClass

/var/canvas/db/migrate/20121010191027_add_cassandra_page_view_tables.rb:28:in `up'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/activerecord-5.2.4.4/lib/active_record/migration.rb:777:in `up'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/activerecord-5.2.4.4/lib/active_record/migration.rb:817:in `exec_migration'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/activerecord-5.2.4.4/lib/active_record/migration.rb:798:in `block (2 levels) in migrate'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/activerecord-5.2.4.4/lib/active_record/migration.rb:797:in `block in migrate'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/activerecord-5.2.4.4/lib/active_record/connection_adapters/abstract/connection_pool.rb:416:in `with_connection'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/switchman-2.0.2/lib/switchman/connection_pool_proxy.rb:15:in `with_connection'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/activerecord-5.2.4.4/lib/active_record/migration.rb:796:in `migrate'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/switchman-inst-jobs-3.1.0/lib/switchman_inst_jobs/active_record/migration.rb:16:in `migrate'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/activerecord-5.2.4.4/lib/active_record/migration.rb:608:in `migrate'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/activerecord-5.2.4.4/lib/active_record/migration.rb:977:in `migrate'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/activerecord-5.2.4.4/lib/active_record/migration.rb:1292:in `block in execute_migration_in_transaction'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/activerecord-5.2.4.4/lib/active_record/migration.rb:1343:in `block in ddl_transaction'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/activerecord-5.2.4.4/lib/active_record/connection_adapters/abstract/database_statements.rb:267:in `block in transaction'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/activerecord-5.2.4.4/lib/active_record/connection_adapters/abstract/transaction.rb:239:in `block in within_new_transaction'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/activerecord-5.2.4.4/lib/active_record/connection_adapters/abstract/transaction.rb:236:in `within_new_transaction'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/activerecord-5.2.4.4/lib/active_record/connection_adapters/abstract/database_statements.rb:267:in `transaction'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/activerecord-5.2.4.4/lib/active_record/transactions.rb:212:in `transaction'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/switchman-2.0.2/lib/switchman/active_record/base.rb:51:in `transaction'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/activerecord-5.2.4.4/lib/active_record/migration.rb:1343:in `ddl_transaction'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/activerecord-5.2.4.4/lib/active_record/migration.rb:1291:in `execute_migration_in_transaction'

/var/canvas/config/initializers/active_record.rb:1460:in `execute_migration_in_transaction'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/activerecord-5.2.4.4/lib/active_record/migration.rb:1263:in `block in migrate_without_lock'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/activerecord-5.2.4.4/lib/active_record/migration.rb:1262:in `each'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/activerecord-5.2.4.4/lib/active_record/migration.rb:1262:in `migrate_without_lock'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/activerecord-5.2.4.4/lib/active_record/migration.rb:1210:in `block in migrate'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/activerecord-5.2.4.4/lib/active_record/migration.rb:1363:in `with_advisory_lock'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/activerecord-5.2.4.4/lib/active_record/migration.rb:1210:in `migrate'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/activerecord-5.2.4.4/lib/active_record/migration.rb:1036:in `up'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/activerecord-5.2.4.4/lib/active_record/migration.rb:1011:in `migrate'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/activerecord-5.2.4.4/lib/active_record/tasks/database_tasks.rb:172:in `migrate'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/activerecord-5.2.4.4/lib/active_record/railties/databases.rake:60:in `block (2 levels) in <top (required)>'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/switchman-2.0.2/lib/tasks/switchman.rake:87:in `block (6 levels) in shardify_task'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/switchman-2.0.2/lib/tasks/switchman.rake:87:in `each'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/switchman-2.0.2/lib/tasks/switchman.rake:87:in `block (5 levels) in shardify_task'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/switchman-2.0.2/lib/switchman/database_server.rb:109:in `unguard'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/switchman-2.0.2/lib/tasks/switchman.rake:86:in `block (4 levels) in shardify_task'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/switchman-2.0.2/app/models/switchman/shard.rb:378:in `block (2 levels) in with_each_shard'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/switchman-2.0.2/app/models/switchman/shard.rb:630:in `block in activate'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/switchman-2.0.2/app/models/switchman/shard.rb:98:in `activate'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/switchman-2.0.2/app/models/switchman/shard.rb:629:in `activate'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/switchman-2.0.2/app/models/switchman/shard.rb:376:in `block in with_each_shard'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/activerecord-5.2.4.4/lib/active_record/relation/delegation.rb:71:in `each'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/switchman-2.0.2/app/models/switchman/shard.rb:372:in `with_each_shard'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/switchman-2.0.2/lib/tasks/switchman.rake:71:in `block (3 levels) in shardify_task'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/switchman-2.0.2/lib/switchman/database_server.rb:109:in `unguard'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/switchman-2.0.2/lib/tasks/switchman.rake:68:in `block (2 levels) in shardify_task'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/switchman-2.0.2/lib/switchman/guard_rail.rb:24:in `activate'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/switchman-inst-jobs-3.1.0/lib/switchman_inst_jobs/guard_rail.rb:8:in `activate'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/switchman-2.0.2/lib/tasks/switchman.rake:67:in `block in shardify_task'

/var/canvas/vendor/bundle/ruby/2.6.0/gems/rake-13.0.1/exe/rake:27:in `<top (required)>'

Caused by:

NoMethodError: undefined method `db' for nil:NilClass