Trying to upgrade but getting: UserWarning: Unknown distribution option: 'zip_safe'..

[Edwardo Hanna]

Hi, I have a Fullstack virtual machine, and I am trying to do an upgrade.  However in general I get this error message bellow.  I tried upgrading pip, but still get the same message.  I am hoping to solve this and thanks for any advice.

TASK: [edxapp | install python pre-requirements] ****************************** 

<localhost> REMOTE_MODULE pip requirements="/edx/app/edxapp/edx-platform/requirements/edx/pre.txt" virtualenv="/edx/app/edxapp/venvs/edxapp" state=present extra_args="-i https://pypi.python.org/simple --exists-action w"

<localhost> EXEC ['/bin/sh', '-c', 'mkdir -p /tmp/ansible-tmp-1436742342.65-6461631609209 && chmod a+rx /tmp/ansible-tmp-1436742342.65-6461631609209 && echo /tmp/ansible-tmp-1436742342.65-6461631609209']

<localhost> PUT /tmp/tmpqhRxtK TO /tmp/ansible-tmp-1436742342.65-6461631609209/pip

<localhost> EXEC ['/bin/sh', '-c', u'chmod a+r /tmp/ansible-tmp-1436742342.65-6461631609209/pip']

<localhost> EXEC /bin/sh -c 'sudo -k && sudo -H -S -p "[sudo via ansible, key=tdazxvtfesahosnsbwlvhmdyymaxbiez] password: " -u edxapp /bin/sh -c '"'"'echo BECOME-SUCCESS-tdazxvtfesahosnsbwlvhmdyymaxbiez; LANG=en_US.UTF-8 SKIP_WS_MIGRATIONS=1 LC_CTYPE=en_US.UTF-8 GEM_HOME=/edx/app/edxapp/.gem RBENV_ROOT=/edx/app/edxapp/.rbenv NO_PREREQ_INSTALL=1 PATH=/edx/app/edxapp/venvs/edxapp/bin:/edx/app/edxapp/edx-platform/bin:/edx/app/edxapp/.rbenv/bin:/edx/app/edxapp/.rbenv/shims:/edx/app/edxapp/.gem/bin:/edx/app/edxapp/edx-platform/node_modules/.bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin EDX_PLATFORM_SETTINGS=aws GEM_PATH=/edx/app/edxapp/.gem CONFIG_ROOT=/edx/app/edxapp /usr/bin/python /tmp/ansible-tmp-1436742342.65-6461631609209/pip'"'"''

<localhost> EXEC ['/bin/sh', '-c', 'rm -rf /tmp/ansible-tmp-1436742342.65-6461631609209/ >/dev/null 2>&1']

failed: [localhost] => {"cmd": "/edx/app/edxapp/venvs/edxapp/bin/pip install -i https://pypi.python.org/simple --exists-action w -r /edx/app/edxapp/edx-platform/requirements/edx/pre.txt", "failed": true}

msg: stdout: You are using pip version 6.0.8, however version 7.1.0 is available.

You should consider upgrading via the 'pip install --upgrade pip' command.

Collecting setuptools==18.0.1 (from -r /edx/app/edxapp/edx-platform/requirements/edx/pre.txt (line 9))

  Using cached setuptools-18.0.1-py2.py3-none-any.whl

Requirement already satisfied (use --upgrade to upgrade): numpy==1.6.2 in /edx/app/edxapp/venvs/edxapp/lib/python2.7/site-packages (from -r /edx/app/edxapp/edx-platform/requirements/edx/pre.txt (line 13))

Requirement already satisfied (use --upgrade to upgrade): pip==6.0.8 in /edx/app/edxapp/venvs/edxapp/lib/python2.7/site-packages (from -r /edx/app/edxapp/edx-platform/requirements/edx/pre.txt (line 16))

Collecting Cython==0.21.2 (from -r /edx/app/edxapp/edx-platform/requirements/edx/pre.txt (line 19))

  Using cached Cython-0.21.2.tar.gz

    /usr/lib/python2.7/distutils/dist.py:267: UserWarning: Unknown distribution option: 'entry_points'

      warnings.warn(msg)

    /usr/lib/python2.7/distutils/dist.py:267: UserWarning: Unknown distribution option: 'zip_safe'

      warnings.warn(msg)

    Compiling module Cython.Plex.Scanners ...

    Compiling module Cython.Plex.Actions ...

    Compiling module Cython.Compiler.Lexicon ...

    Compiling module Cython.Compiler.Scanning ...

    Compiling module Cython.Compiler.Parsing ...

    Compiling module Cython.Compiler.Visitor ...

    Compiling module Cython.Compiler.FlowControl ...

    Compiling module Cython.Compiler.Code ...

    Compiling module Cython.Runtime.refnanny ...

    Compiling module Cython.Tempita._tempita ...

    usage: -c [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]

       or: -c --help [cmd1 cmd2 ...]

       or: -c --help-commands

       or: -c cmd --help

    error: invalid command 'egg_info'

    Complete output from command python setup.py egg_info:

    /usr/lib/python2.7/distutils/dist.py:267: UserWarning: Unknown distribution option: 'entry_points'

    

      warnings.warn(msg)

    

    /usr/lib/python2.7/distutils/dist.py:267: UserWarning: Unknown distribution option: 'zip_safe'

    

      warnings.warn(msg)

    

    Compiling module Cython.Plex.Scanners ...

    

    Compiling module Cython.Plex.Actions ...

    

    Compiling module Cython.Compiler.Lexicon ...

    

    Compiling module Cython.Compiler.Scanning ...

    

    Compiling module Cython.Compiler.Parsing ...

    

    Compiling module Cython.Compiler.Visitor ...

    

    Compiling module Cython.Compiler.FlowControl ...

    

    Compiling module Cython.Compiler.Code ...

    

    Compiling module Cython.Runtime.refnanny ...

    

    Compiling module Cython.Tempita._tempita ...

    

    usage: -c [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]

    

       or: -c --help [cmd1 cmd2 ...]

    

       or: -c --help-commands

    

       or: -c cmd --help

    

    

    

    error: invalid command 'egg_info'

    

    ----------------------------------------

    Command "python setup.py egg_info" failed with error code 1 in /tmp/pip-build-cop48d/Cython

FATAL: all hosts have already failed -- aborting

PLAY RECAP ******************************************************************** 

           to retry, use: --limit @/home/vagrant/edxapp.retry

localhost                  : ok=151  changed=35   unreachable=0    failed=1   

[Edwardo Hanna]

My fullstack is Birch, this is important to mention.

[Marco Re]

I can confirm the issue.

Same problem while upgrading from Birch to Cypress (RC3)

[David Baumgold]

Have you looked at the Confluence page documenting potential problems when migrating from Birch to Cypress? This problem sounds like it's due to the upgrade from distribute to setuptools. Try deleting the virtualenv and running the migration again.

David Baumgold

[Marco Re]

Thanks.....deleting the virtualenv solve that issues....BTW the migration fails in a further task: sync db on social auth

Running migrations for default:

 - Migrating forwards to 0001_initial.

 > default:0001_initial

 ! Error found during real run of migration! Aborting.

 ! Since you have a database that does not support running

 ! schema-altering statements in transactions, we have had 

 ! to leave it in an interim state between migrations.

! You *might* be able to recover with:   - no dry run output for delete_unique_column() due to dynamic DDL, sorry

   - no dry run output for delete_unique_column() due to dynamic DDL, sorry

   = DROP TABLE `social_auth_usersocialauth` CASCADE; []

   = DROP TABLE `social_auth_nonce` CASCADE; []

   = DROP TABLE `social_auth_association` CASCADE; []

   = DROP TABLE `social_auth_code` CASCADE; []

 ! The South developers regret this has happened, and would

 ! like to gently persuade you to consider a slightly

 ! easier-to-deal-with DBMS (one that supports DDL transactions)

 ! NOTE: The error which caused the migration to fail is further up.

Error in migration: default:0001_initial

[Marco Re]

Ok ...reply to my self....

Found useful information on this in https://github.com/edx/edx-platform/pull/8262  :

Upgrade Issue
When merged, this PR does cause a problem for existing installations: python-social-auth at one point converted from syncdb to south/django migrations, and bumping the version of python-social-auth that we use will result in this error next time paver update_db is run:

django.db.utils.DatabaseError: table "social_auth_usersocialauth" already exists

To fix this (on devstack), the user must manually run this command:

./manage.py lms migrate default 0001_initial --fake --settings=devstack

Unfortunately, I'm not aware of any way to avoid this issue other than this manual fix. New installs are not affected.

[David Baumgold]

Marco, can you update that Confluence page with the problem you encountered and the resolution to it?

David

[Marco Re]

Ok...I just saved the new version of that page! 

Maybe could be useful  give more visibility to this wiki page with a specific thread?

Marco

On Wednesday, July 29, 2015 at 7:33:02 PM UTC+2, David Baumgold wrote:

Marco, can you update that Confluence page with the problem you encountered and the resolution to it?

David