Announcing Ironwood release candidate: Ironwood.1rc1 We need your help!

[Ned Batchelder]

Hey everyone,

I'm pleased to announce that we have a first release candidate for the next Open edX release: Ironwood.1rc1.  To install it, use the tag open-release/ironwood.1rc1

Things to know:

• We don't yet have release notes for Ironwood.  We are in the process of pulling those together.
  
• If you discover issues during your testing, please let us know.  There are a few ways you can provide feedback:
  
• We have an #ironwood-beta Slack channel.
• You can add notes to the Ironwood wiki page.
• You can respond to this thread.
• Note that the installation instructions have changed slightly. The password generation step is now required.

Our goal is to release Ironwood in two weeks.  In order to do that, I need to hear back from you about how testing is going.  Even if everything is fine (especially if everything is fine?), pop into the Slack channel and tell us that.  It helps us decide how to move forward.

Thanks, I'm looking forward to hearing from you.

--Ned.

[JITHIN SHA]

Hello Ned,

I tried installing the new version, but getting an error message at the end. But the web portal is partly active. Let me know, you need to more information.

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

PLAY RECAP *********************************************************************

localhost                  : ok=318  changed=131  unreachable=0    failed=1   

INFO:/var/tmp/configuration/playbooks/callback_plugins/task_timing: gather static assets with paver [1] ------------------------------------------- 738.84s

INFO:/var/tmp/configuration/playbooks/callback_plugins/task_timing: install production requirements ----------------------------------------------- 629.71s

INFO:/var/tmp/configuration/playbooks/callback_plugins/task_timing: restart edxapp_workers [0] ---------------------------------------------------- 450.99s

INFO:/var/tmp/configuration/playbooks/callback_plugins/task_timing: migrate database -------------------------------------------------------------- 117.13s

INFO:/var/tmp/configuration/playbooks/callback_plugins/task_timing: create service worker users [0] ----------------------------------------------- 110.28s

INFO:/var/tmp/configuration/playbooks/callback_plugins/task_timing: install node dependencies [1] ------------------------------------------------- 104.93s

INFO:/var/tmp/configuration/playbooks/callback_plugins/task_timing: migrate [1] -------------------------------------------------------------------- 96.52s

INFO:/var/tmp/configuration/playbooks/callback_plugins/task_timing: create service worker users [1] ------------------------------------------------ 95.88s

INFO:/var/tmp/configuration/playbooks/callback_plugins/task_timing: migrate [0] -------------------------------------------------------------------- 90.58s

INFO:/var/tmp/configuration/playbooks/callback_plugins/task_timing: install node dependencies [0] -------------------------------------------------- 90.42s

INFO:/var/tmp/configuration/playbooks/callback_plugins/task_timing:

Playbook Configure instance(s) finished: 2019-02-05 08:23:14.330208, 824 total tasks.  0:58:36.010777 elapsed. 

 

========================================

Ansible failed!

----------------------------------------

If you need help, see https://open.edx.org/getting-help .

When asking for help, please provide as much information as you can.

These might be helpful:

    Your log file is at logs/install-20190205-135303.log

    Your environment:

        OPENEDX_RELEASE=open-release/ironwood.1rc1

========================================

Installation finished at 2019-02-05 14:53:37

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Thanks and regards

--
You received this message because you are subscribed to the Google Groups "General Open edX discussion" group.
To view this discussion on the web visit https://groups.google.com/d/msgid/edx-code/CAGtJPNNc%2BMV3nw_9JLzV90MLsdy16JFx6wLDYKoxA6y4xvLUgQ%40mail.gmail.com.

--

JITHINSHA
ജിതിന്‍ഷാ കെ എസ്

[Ned Batchelder]

Jithin,

It looks like you have run this installation before.  Does it always fail at the same spot?  For some reason it can't clone the analytics api git repo.

--Ned.

To view this discussion on the web visit https://groups.google.com/d/msgid/edx-code/CANtXGwcx0%3D-sojZzDuKKEY30tPFKY2XkGmGdQ6%2BKFnDz9JGZKQ%40mail.gmail.com.

[JITHIN SHA]

Ned,

Yes bro, I have been working on open edx since past few weeks. I have successfully installed Hawthorn.2 and now trying to separate app and db services. Have partly succeeded in the same, few errors still negotiating. If you have found similar error pls let me know.

/edx/var/log/lms/edx.log

Trying again in 32.00 seconds...

Feb  5 18:43:21 edx-lms [service_variant=lms][celery.worker.consumer][env:sandbox] ERROR [edx-lms  2345] [consumer.py:366] - consumer: Cannot connect to amqp://celery:**@127.0.0.1:5672//: [Errno 111] Connection refused.

Trying again in 32.00 seconds...

Feb  5 18:43:21 edx-lms [service_variant=lms][celery.worker.consumer][env:sandbox] ERROR [edx-lms  2333] [consumer.py:366] - consumer: Cannot connect to amqp://celery:**@127.0.0.1:5672//: [Errno 111] Connection refused.

Trying again in 32.00 seconds...

Feb  5 18:43:21 edx-lms [service_variant=lms][celery.worker.consumer][env:sandbox] ERROR [edx-lms  2364] [consumer.py:366] - consumer: Cannot connect to amqp://celery:**@127.0.0.1:5672//: [Errno 111] Connection refused.

Trying again in 32.00 seconds...

Feb  5 18:43:21 edx-lms [service_variant=lms][celery.worker.consumer][env:sandbox] ERROR [edx-lms  2363] [consumer.py:366] - consumer: Cannot connect to amqp://celery:**@127.0.0.1:5672//: [Errno 111] Connection refused.

Trying again in 32.00 seconds...

Thanks

To view this discussion on the web visit https://groups.google.com/d/msgid/edx-code/CAGtJPNMq1MnfGg63LvjySnv91SvRoxkDs317TG%2Bf4%3DSqx_yJdA%40mail.gmail.com.

[Lupus Furyo]

Hi Ned and Jithin,

This is a third attempt to install Ironwood on fresh Ubuntu Server 16.04.5 (earlier, I have tried master branch twice without any success, I always end up with an incomplete system - where half of the components are missing).

Partial LOG

.................................................................................................................

TASK [security : Configure periodic unattended-upgrades] ***********************
skipping: [localhost]

TASK [security : Disable unattended-upgrades if Xenial (16.04)] ****************
skipping: [localhost] => (item=systemctl disable apt-daily.service)
skipping: [localhost] => (item=systemctl disable apt-daily-upgrade.timer)
skipping: [localhost] => (item=systemctl disable apt-daily.timer)

TASK [security : Disable unattended-upgrades] **********************************
skipping: [localhost]

TASK [security : Only unattended-upgrade from security repo] *******************
skipping: [localhost]

TASK [security : Disable security only updates on unattended-upgrades] *********
skipping: [localhost]

TASK [security : Take security updates during ansible runs] ********************
skipping: [localhost] => (item=unattended-upgrade)
skipping: [localhost] => (item=unattended-upgrade --dry-run)

TASK [security : Install security packages] ************************************
skipping: [localhost] => (item=[])

TASK [security : Enable automatic start for update service] ********************
skipping: [localhost]

TASK [security : Update all system packages] ***********************************
skipping: [localhost]

TASK [security : Configure security auto-updates] ******************************
skipping: [localhost] => (item={u'regexp': u'^apply_updates', u'line': u'apply_updates = yes'})
skipping: [localhost] => (item={u'regexp': u'^update_cmd', u'line': u'update_cmd = security'})

TASK [security : Take security updates during ansible runs] ********************
skipping: [localhost] => (item=yum check-update --security)
skipping: [localhost] => (item=yum update --security -y)

TASK [automated : Create automated user] ***************************************

TASK [automated : Create sudoers file from template] ***************************

TASK [automated : Create .ssh directory] ***************************************

TASK [automated : Build authorized_keys file] **********************************

TASK [automated : Build known_hosts file] **************************************

TASK [add_user : create user groups] *******************************************
changed: [localhost] => (item=ecommerce)

TASK [add_user : create application user] **************************************
changed: [localhost]

TASK [add_user : ensure correct ownership of home directory] *******************
ok: [localhost]

TASK [add_user : create dirs for the user] *************************************

TASK [git_clone : Set git fetch.prune to ignore deleted remote refs] ***********
changed: [localhost]

TASK [git_clone : Validate git protocol] ***************************************
skipping: [localhost] => (item=(censored due to no_log))

TASK [git_clone : Install read-only ssh key] ***********************************
skipping: [localhost] => (item=(censored due to no_log))

TASK [git_clone : Check that working tree is clean] ****************************
changed: [localhost] => (item=/edx/app/ecommerce/ecommerce)

TASK [git_clone : Require a clean working tree] ********************************
skipping: [localhost] => (item={'_ansible_parsed': True, u'changed': True, u'stdout': u'', '_ansible_no_log': False, u'warnings': [], '_ansible_item_result': True, u'rc': 0, u'end': u'2019-02-05 13:08:05.457789', u'start': u'2019-02-05 13:08:05.455174', u'cmd': u'test ! -e "/edx/app/ecommerce/ecommerce" || git -C "/edx/app/ecommerce/ecommerce" status --porcelain --untracked-files=no', 'item': u'/edx/app/ecommerce/ecommerce', u'delta': u'0:00:00.002615', 'invocation': {'module_name': u'command', u'module_args': {u'creates': None, u'executable': None, u'_uses_shell': True, u'_raw_params': u'test ! -e "/edx/app/ecommerce/ecommerce" || git -C "/edx/app/ecommerce/ecommerce" status --porcelain --untracked-files=no', u'removes': None, u'warn': True, u'chdir': None}}, 'stdout_lines': [], u'stderr': u''})

TASK [git_clone : Checkout code over ssh] **************************************
skipping: [localhost] => (item=(censored due to no_log))

TASK [git_clone : Checkout code over https] ************************************
failed: [localhost] (item=(censored due to no_log)) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result"}
    to retry, use: --limit @/var/tmp/configuration/playbooks/edx_sandbox.retry

PLAY RECAP *********************************************************************
localhost                  : ok=272  changed=172  unreachable=0    failed=1  

INFO:/var/tmp/configuration/playbooks/callback_plugins/task_timing: install python requirements [0] ----------------------------------------------- 587.89s
INFO:/var/tmp/configuration/playbooks/callback_plugins/task_timing: checkout edx-platform repo into /edx/app/edxapp/edx-platform [0] -------------- 505.01s
INFO:/var/tmp/configuration/playbooks/callback_plugins/task_timing: migrate [0] ------------------------------------------------------------------- 464.26s
INFO:/var/tmp/configuration/playbooks/callback_plugins/task_timing: gather static assets with paver [1] ------------------------------------------- 399.13s
INFO:/var/tmp/configuration/playbooks/callback_plugins/task_timing: code sandbox | Install base sandbox requirements and create sandbox virtualenv [0]  168.51s
INFO:/var/tmp/configuration/playbooks/callback_plugins/task_timing: Create Diffie-Hellman parameters to prevent weak key exchange ----------------- 115.67s
INFO:/var/tmp/configuration/playbooks/callback_plugins/task_timing: Install system packages [1] ---------------------------------------------------- 74.55s
INFO:/var/tmp/configuration/playbooks/callback_plugins/task_timing: install node dependencies [0] -------------------------------------------------- 57.89s
INFO:/var/tmp/configuration/playbooks/callback_plugins/task_timing: create service worker users [1] ------------------------------------------------ 42.14s
INFO:/var/tmp/configuration/playbooks/callback_plugins/task_timing: migrate [1] -------------------------------------------------------------------- 40.89s
INFO:/var/tmp/configuration/playbooks/callback_plugins/task_timing:
Playbook Configure instance(s) finished: 2019-02-05 21:08:13.837695, 668 total tasks.  0:50:55.105953 elapsed.

 
========================================
Ansible failed!
----------------------------------------
If you need help, see https://open.edx.org/getting-help .
When asking for help, please provide as much information as you can.
These might be helpful:

    Your log file is at logs/install-20190205-121626.log
    Your environment:
        OPENEDX_RELEASE=open-release/ironwood.1rc1
========================================
root@ubuntu:~# Installation finished at 2019-02-05 13:08:14

Best, L.

To view this discussion on the web visit https://groups.google.com/d/msgid/edx-code/CANtXGwfxPPYY5t6Pwt7CUoUV%2BEeudT-M-HR4g8umzKTjsPca3g%40mail.gmail.com.

[Lupus Furyo]

P.S. The last time it was Ironwood.1rc1.

[Lupus Furyo]

P.P.S. please see the complete log attached to this email/post.

[JITHIN SHA]

Hello Lupus,

Yes there are some issues in ironwood and its about the same, that we were discussing. I too had similar sort of issue. 

########################################

For me the cloning of analytics failed

TASK [git_clone : Check that working tree is clean] ****************************

changed: [localhost] => (item=/edx/app/analytics_api/analytics_api)

TASK [git_clone : Require a clean working tree] ********************************

skipping: [localhost] => (item={'_ansible_parsed': True, u'changed': True, u'stdout': u'', '_ansible_no_log': False, u'warnings': [], '_ansible_item_result': True, u'rc': 0, u'end': u'2019-02-05 14:53:03.645931', u'start': u'2019-02-05 14:53:03.640365', u'cmd': u'test ! -e "/edx/app/analytics_api/analytics_api" || git -C "/edx/app/analytics_api/analytics_api" status --porcelain --untracked-files=no', 'item': u'/edx/app/analytics_api/analytics_api', u'delta': u'0:00:00.005566', 'invocation': {'module_name': u'command', u'module_args': {u'creates': None, u'executable': None, u'_uses_shell': True, u'_raw_params': u'test ! -e "/edx/app/analytics_api/analytics_api" || git -C "/edx/app/analytics_api/analytics_api" status --porcelain --untracked-files=no', u'removes': None, u'warn': True, u'chdir': None}}, 'stdout_lines': [], u'stderr': u''}) 

TASK [git_clone : Checkout code over ssh] **************************************

skipping: [localhost] => (item=(censored due to no_log)) 

TASK [git_clone : Checkout code over https] ************************************

failed: [localhost] (item=(censored due to no_log)) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result"}

RUNNING HANDLER [nginx : reload nginx] *****************************************

to retry, use: --limit @/var/tmp/configuration/playbooks/edx_sandbox.retry

PLAY RECAP *********************************************************************

localhost                  : ok=318  changed=131  unreachable=0    failed=1   

########################################

FOR you i guess its from here that you get the issue

TASK [git_clone : Set git fetch.prune to ignore deleted remote refs] ***********

changed: [localhost]

TASK [git_clone : Validate git protocol] ***************************************

skipping: [localhost] => (item=(censored due to no_log)) 

TASK [git_clone : Install read-only ssh key] ***********************************

skipping: [localhost] => (item=(censored due to no_log)) 

TASK [git_clone : Check that working tree is clean] ****************************

changed: [localhost] => (item=/edx/app/ecommerce/ecommerce)

TASK [git_clone : Require a clean working tree] ********************************

skipping: [localhost] => (item={'_ansible_parsed': True, u'changed': True, u'stdout': u'', '_ansible_no_log': False, u'warnings': [], '_ansible_item_result': True, u'rc': 0, u'end': u'2019-02-05 13:08:05.457789', u'start': u'2019-02-05 13:08:05.455174', u'cmd': u'test ! -e "/edx/app/ecommerce/ecommerce" || git -C "/edx/app/ecommerce/ecommerce" status --porcelain --untracked-files=no', 'item': u'/edx/app/ecommerce/ecommerce', u'delta': u'0:00:00.002615', 'invocation': {'module_name': u'command', u'module_args': {u'creates': None, u'executable': None, u'_uses_shell': True, u'_raw_params': u'test ! -e "/edx/app/ecommerce/ecommerce" || git -C "/edx/app/ecommerce/ecommerce" status --porcelain --untracked-files=no', u'removes': None, u'warn': True, u'chdir': None}}, 'stdout_lines': [], u'stderr': u''}) 

TASK [git_clone : Checkout code over ssh] **************************************

skipping: [localhost] => (item=(censored due to no_log)) 

TASK [git_clone : Checkout code over https] ************************************

failed: [localhost] (item=(censored due to no_log)) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result"}

    to retry, use: --limit @/var/tmp/configuration/playbooks/edx_sandbox.retry

############################################################

Still not sure, why the issue.... need to sort it out.

Thanks

To view this discussion on the web visit https://groups.google.com/d/msgid/edx-code/CA%2BaB0d-V-Loj65B%3D%2BG%2B-KDTbS-%3DyRbYwMtaxLoFYn8AGp%3DjdeQ%40mail.gmail.com.

[JITHIN SHA]

Hello Ned,

I have successfully separated DB and APP to run perfectly. Currently just MongoDB and MySQL is separated from the APP. I want to separate the RabbitMQ as well. And make App and Srv (Services) VMs. 

Hi all, If anybody needs help in separating, just let me know. Am planning to make a doc on this, as i find free time and will share here.

Thanks all and Cheers.... 

On Tue, Feb 5, 2019 at 6:49 PM Ned Batchelder <n...@edx.org> wrote:

To view this discussion on the web visit https://groups.google.com/d/msgid/edx-code/CAGtJPNMq1MnfGg63LvjySnv91SvRoxkDs317TG%2Bf4%3DSqx_yJdA%40mail.gmail.com.