Incompatible ssh peer (no acceptable kex algorithm)

[Kushal Kumar]

Hi,

I am trying to start using cloudify manager with cloudify-hello-world-example. Now i have uploaded the blueprint to cloudify-management-server using the command :
(my_virtualenv) stack@abhi:~/cloudify-manager/cloudify-hello-world-example$ cfy blueprints upload -b hello-world -p blueprint.yaml

I also created a deployment using this command : cfy deployments create -b hello-world -d hello-world-test --inputs inputs.yaml. This was successful.

Now when I start the execution using this command " cfy executions start -w install -d hello-world-test", the cloudify agent installer operation keeps on retrying. as shown below.

2016-12-28T14:51:31 CFY <hello-world-test> [vm_24096.start] Sending task 'nova_plugin.server.start'
2016-12-28T14:51:31 CFY <hello-world-test> [vm_24096.start] Task started 'nova_plugin.server.start'
2016-12-28T14:51:33 CFY <hello-world-test> [vm_24096.start] Task rescheduled 'nova_plugin.server.start' -> Waiting for server to be in ACTIVE state but is in BUILD:spawning state. Retrying... [retry_after=30]
2016-12-28T14:52:03 CFY <hello-world-test> [vm_24096.start] Sending task 'nova_plugin.server.start' [retry 1]
2016-12-28T14:52:03 CFY <hello-world-test> [vm_24096.start] Task started 'nova_plugin.server.start' [retry 1]
2016-12-28T14:52:07 CFY <hello-world-test> [vm_24096.start] Task succeeded 'nova_plugin.server.start' [retry 1]
2016-12-28T14:52:07 CFY <hello-world-test> [vm_24096] Creating Agent
2016-12-28T14:52:07 CFY <hello-world-test> [vm_24096.create] Sending task 'cloudify_agent.installer.operations.create'
2016-12-28T14:52:08 CFY <hello-world-test> [vm_24096.create] Task started 'cloudify_agent.installer.operations.create'
2016-12-28T14:52:11 CFY <hello-world-test> [vm_24096.create] Task rescheduled 'cloudify_agent.installer.operations.create' -> Low level socket error connecting to host 172.16.0.4 on port 22: Connection refused (tried 1 time)
2016-12-28T14:52:41 CFY <hello-world-test> [vm_24096.create] Sending task 'cloudify_agent.installer.operations.create' [retry 1]
2016-12-28T14:52:41 CFY <hello-world-test> [vm_24096.create] Task started 'cloudify_agent.installer.operations.create' [retry 1]
2016-12-28T14:52:42 CFY <hello-world-test> [vm_24096.create] Task rescheduled 'cloudify_agent.installer.operations.create' -> 1 [retry 1]

2016-12-28T14:53:12 CFY <hello-world-test> [vm_24096.create] Task started 'cloudify_agent.installer.operations.create' [retry 2]
2016-12-28T14:53:12 CFY <hello-world-test> [vm_24096.create] Task started 'cloudify_agent.installer.operations.create' [retry 2]
2016-12-28T14:53:13 CFY <hello-world-test> [vm_24096.create] Task rescheduled 'cloudify_agent.installer.operations.create' -> 1 [retry 2]
2016-12-28T14:53:44 CFY <hello-world-test> [vm_24096.create] Sending task 'cloudify_agent.installer.operations.create' [retry 3]
2016-12-28T14:53:44 CFY <hello-world-test> [vm_24096.create] Task started 'cloudify_agent.installer.operations.create' [retry 3]
2016-12-28T14:53:45 CFY <hello-world-test> [vm_24096.create] Task rescheduled 'cloudify_agent.installer.operations.create' -> 1 [retry 3]
2016-12-28T14:54:15 CFY <hello-world-test> [vm_24096.create] Sending task 'cloudify_agent.installer.operations.create' [retry 4]
2016-12-28T14:54:15 CFY <hello-world-test> [vm_24096.create] Task started 'cloudify_agent.installer.operations.create' [retry 4]
2016-12-28T14:54:32 CFY <hello-world-test> [vm_24096.create] Task rescheduled 'cloudify_agent.installer.operations.create' -> 1 [retry 4]
2016-12-28T14:55:02 CFY <hello-world-test> [vm_24096.create] Sending task 'cloudify_agent.installer.operations.create' [retry 5]
2016-12-28T14:55:02 CFY <hello-world-test> [vm_24096.create] Task started 'cloudify_agent.installer.operations.create' [retry 5]

I looked at the logs kept at /var/log/cloudify/mgmtworker/logs/hello-world-test.log and found this error. (in bold black below)

2016-12-28 14:53:44,996 [DEBUG] Removing callback #0: {'callback': <bound method BlockingChannel._on_rpc_complete of <pika.adapters.blocking_connection.BlockingChannel object at 0x7f070cbd4950>>, 'only': None, 'one_shot': True, 'arguments': None, 'calls': 0}
2016-12-28 14:53:44,996 [DEBUG] Calling <bound method BlockingChannel._on_rpc_complete of <pika.adapters.blocking_connection.BlockingChannel object at 0x7f070cbd4950>> for "1:Basic.Ack"
2016-12-28 14:53:44,995 [DEBUG] Validating SSH connection
2016-12-28 14:53:45,015 [ERROR] Exception: Incompatible ssh peer (no acceptable kex algorithm)
2016-12-28 14:53:45,016 [ERROR] Traceback (most recent call last):
2016-12-28 14:53:45,017 [ERROR]   File "/opt/mgmtworker/env/lib/python2.7/site-packages/paramiko/transport.py", line 1431, in run
2016-12-28 14:53:45,017 [ERROR]     self._handler_table[ptype](self, m)
2016-12-28 14:53:45,017 [ERROR]   File "/opt/mgmtworker/env/lib/python2.7/site-packages/paramiko/transport.py", line 1513, in _negotiate_keys
2016-12-28 14:53:45,017 [ERROR]     self._parse_kex_init(m)
2016-12-28 14:53:45,017 [ERROR]   File "/opt/mgmtworker/env/lib/python2.7/site-packages/paramiko/transport.py", line 1628, in _parse_kex_init
2016-12-28 14:53:45,017 [ERROR]     raise SSHException('Incompatible ssh peer (no acceptable kex algorithm)')
2016-12-28 14:53:45,017 [ERROR] SSHException: Incompatible ssh peer (no acceptable kex algorithm)
2016-12-28 14:53:45,017 [ERROR]
2016-12-28 14:53:45,020 [DEBUG] Closing amqp channel of thread <_MainThread(Dispatch-operation, started 139668256143168)>
2016-12-28 14:53:45,020 [INFO] Channel.close(0, Normal Shutdown)
2016-12-28 14:53:45,020 [DEBUG] Incremented callback reference counter: {'callback': <bound method BlockingChanne

Can somebody please help me fix this issue.

Regards,

Kushal Kumar
TATA CONSULTANCY SERVICES
GURGAON, HARYANA

[Tadej Borovšak]

On Wed, Dec 28, 2016 at 07:14:33AM -0800, Kushal Kumar wrote:
> Hi,
>

> I am trying to start using cloudify manager with *cloudify-hello-world-example.
> <https://github.com/cloudify-cosmo/cloudify-hello-world-example>*Now i have

> uploaded the blueprint to cloudify-management-server using the command :

> *(my_virtualenv)
> stack@abhi:~/cloudify-manager/cloudify-hello-world-example$ cfy blueprints
> upload -b hello-world -p blueprint.yaml*
>
> I also created a deployment using this command :* cfy deployments create -b
> hello-world -d hello-world-test --inputs inputs.yaml*. This was successful.
>
> Now when I start the execution using this command " *cfy executions start
> -w install -d hello-world-test"*, the cloudify agent installer operation

This error is caused by outdated paramiko python package that is used by
Cloudify's management worker. I encountered this when I tried to create agent
for Ubuntu 16.04, but management worker did not manage to ssh into machine
because of the error you encountered.

I quickly checked out what would take to create new, updated management
worker, but since my time allocated to this task was fairly limited, I gave up
on that plan and used CentOS 7.2 that contains old enough ssh server instead.

Cheers,
Tadej

--
Tadej Borovšak
tade...@gmail.com
tadej.b...@gmail.com

[dew...@gigaspaces.com]

I reported this in a JIRA some time ago: CFY-3295.  It's a known (but not well publicized) limitation.