[Installation] Openstack Neat don't support to install on Ubuntu?

452 views
Skip to first unread message

tuan...@vccorp.vn

unread,
Nov 6, 2013, 2:55:42 AM11/6/13
to opensta...@googlegroups.com

Dear Anton Beloglazor,

The first, Thanks to you, Anton
I want using Openstack-Neat to automation migrate (or arrange ) instances in compute servers..
I read your books/slides (thesis, openstack-neat-blueprint,..)  and I decided to install Openstack-Neat on my lab

I did the following steps:

On Controller node: (using Ubuntu 12.4-LTS):
+ git clone git://github.com/beloglazov/openstack-neat.git
+ sudo python setup.py install
+ edit the neat.conf file (fill the compute nodes,...)
+ ./compute-clone-deps.py
+ ./compute-install-neat.py
+ ./compute-copy-conf.py
and: ./all-start.sh

/etc/init.d/openstack-neat-data-collector: 24: .: Can't open /etc/rc.d/init.d/functions
/etc/init.d/openstack-neat-db-cleaner: 22: .: Can't open /etc/rc.d/init.d/functions

I checked openstack-neat-data-collector file on Compute node, and see they be only run on redhat environment (/etc/rc.d/init.d/functions, /etc/sysconfig/,,/) but not for Ubuntu.
More important is bin files don't exist ( /usr/bin/neat-* ).

Please guide me!
Thank you so much!
--
tuantaba
Ta Ba Tuan




Anton Beloglazov

unread,
Nov 10, 2013, 4:44:54 AM11/10/13
to opensta...@googlegroups.com
Hi Ta Ba Tuan,

Thanks for your interest in the project! Unfortunately, I haven't had a chance to test it on Ubuntu (it's been tested on Centos). Since the all-start.sh script uses Centos interface, it won't work on Ubuntu. However, Python's distribute module should correctly handle various Linux distributions; therefore, neat-* executables should still be installed somewhere when you run `sudo python setup.py install`. Can you please try to search for neat-* files? They might be in /bin or wherever they get installed in Ubuntu by default. If you can't find them, you can use the start-data-collector.py, start-global-manager.py, and start-local-manager.py scripts in the project's root to start up the services. Please let me know how it goes.

Best regards,
Anton


--
You received this message because you are subscribed to the Google Groups "OpenStack Neat" group.
To unsubscribe from this group and stop receiving emails from it, send an email to openstack-nea...@googlegroups.com.
Visit this group at http://groups.google.com/group/openstack-neat.
For more options, visit https://groups.google.com/groups/opt_out.

Message has been deleted
Message has been deleted

tuan...@vccorp.vn

unread,
Nov 15, 2013, 12:34:30 AM11/15/13
to opensta...@googlegroups.com

Hi Anton and everyone,

My environment use the SSL for every connections,
When the Global_manager receied requests from compute nodes AND Global_manager prcocess these requests, appear the following error:

2013-11-15 12:21:32,339 DEBUG    neat.globals.manager Request parameters validated
2013-11-15 12:21:32,339 INFO     neat.globals.manager Received a request from 10.10.10.12: {'username': 'd033e22ae348aeb5660fc2140aec35850c4da997', 'host': 'compute02', 'password': '5baa61e4c9b93f3f0682250b6cf8331b7ee68fd8', 'reason': 0, 'time': 1384492894.74}
2013-11-15 12:21:32,339 INFO     neat.globals.manager Processing an underload of a host compute02
2013-11-15 12:21:32,340 INFO     neat.globals.manager Started processing an underload request
2013-11-15 12:21:32,342 INFO     urllib3.connectionpool Starting new HTTPS connection (56): 10.10.10.10
2013-11-15 12:20:27,042 ERROR    neat.globals.manager Exception during request processing:
Traceback (most recent call last):
 
File "/usr/local/lib/python2.7/dist-packages/openstack_neat-0.1-py2.7.egg/neat/globals/manager.py", line 231, in service
   
params['host'])
 
File "<string>", line 2, in execute_underload
 
File "/usr/local/lib/python2.7/dist-packages/contracts/main.py", line 296, in contracts_checker
    result
= function_(*args, **kwargs)
 
File "/usr/local/lib/python2.7/dist-packages/openstack_neat-0.1-py2.7.egg/neat/globals/manager.py", line 306, in execute_underload
    hosts_to_vms
= vms_by_hosts(state['nova'], state['compute_hosts'])
 
File "<string>", line 2, in vms_by_hosts
 
File "/usr/local/lib/python2.7/dist-packages/contracts/main.py", line 296, in contracts_checker
    result
= function_(*args, **kwargs)
 
File "/usr/local/lib/python2.7/dist-packages/openstack_neat-0.1-py2.7.egg/neat/globals/manager.py", line 709, in vms_by_hosts
   
for vm in nova.servers.list():
 
File "/usr/lib/python2.7/dist-packages/novaclient/v1_1/servers.py", line 404, in list
   
return self._list("/servers%s%s" % (detail, query_string), "servers")
 
File "/usr/lib/python2.7/dist-packages/novaclient/base.py", line 61, in _list
    _resp
, body = self.api.client.get(url)
 
File "/usr/lib/python2.7/dist-packages/novaclient/client.py", line 229, in get
   
return self._cs_request(url, 'GET', **kwargs)
 
File "/usr/lib/python2.7/dist-packages/novaclient/client.py", line 202, in _cs_request
   
self.authenticate()
 
File "/usr/lib/python2.7/dist-packages/novaclient/client.py", line 329, in authenticate
    auth_url
= self._v2_auth(auth_url)
 
File "/usr/lib/python2.7/dist-packages/novaclient/client.py", line 411, in _v2_auth
 
File "/usr/lib/python2.7/dist-packages/novaclient/client.py", line 411, in _v2_auth
   
return self._authenticate(url, body)
 
File "/usr/lib/python2.7/dist-packages/novaclient/client.py", line 423, in _authenticate
   
**kwargs)
 
File "/usr/lib/python2.7/dist-packages/novaclient/client.py", line 195, in _time_request
    resp
, body = self.request(url, method, **kwargs)
 
File "/usr/lib/python2.7/dist-packages/novaclient/client.py", line 166, in request
   
**kwargs)
 
File "/usr/lib/python2.7/dist-packages/requests/sessions.py", line 335, in request
    resp
= self.send(prep, **send_kwargs)
 
File "/usr/lib/python2.7/dist-packages/requests/sessions.py", line 438, in send
    r
= adapter.send(request, **kwargs)
 
File "/usr/lib/python2.7/dist-packages/requests/adapters.py", line 331, in send
   
raise SSLError(e)
SSLError: [Errno 1] _ssl.c:504: error:14090086:SSL routines:SSL3_GET_SERVER_CERTIFICATE:certificate verify failed


Ofcource, I configured neat.conf file with "os_auth_url = https://controller:5000/v2.0/"
How to use Openstack-Neat  when using them in SSL environment.

Thank you!
--tuantaba
Ta Ba Tuan


On Friday, November 15, 2013 11:01:14 AM UTC+7, tuan...@vccorp.vn wrote:

sorry, The above errors relates to keystone service :D,
I'm debuging them!

Thank you

--
tuantaba
TA BA TUAN



On Friday, November 15, 2013 10:46:50 AM UTC+7, tuan...@vccorp.vn wrote:
Hi Anton Beloglazor and everyone,

I installed Openstack-Neat on my Openstack Topology (using Ubuntu), and run the following commands:

 - On Controller:
   /usr/local/bin/neat-data-collector &>/var/log/neat/data-collector-service.log & echo $! > /var/run/neat/neat-data-collector.pid
   /usr/local/bin/neat-local-manager &>/var/log/neat/local-manager-service.log & echo $! > /var/run/neat/neat-local-manager.pid

- On Compute nodes:
   /usr/local/bin/neat-data-collector &>/var/log/neat/data-collector-service.log & echo $! > /var/run/neat/neat-data-collector.pid
   /usr/local/bin/neat-local-manager &>/var/log/neat/local-manager-service.log & echo $! > /var/run/neat/neat-local-manager.pid

and have some logging of local_mnager on Compute nodes :

2013-11-15 03:08:51,564 INFO     neat.locals.manager Started underload detection
2013-11-15 03:08:51,565 INFO     neat.locals.manager Completed underload detection
2013-11-15 03:08:51,565 INFO     neat.locals.manager Started overload detection
2013-11-15 03:09:02,670 DEBUG    neat.locals.overload.mhod.core MHOD utilization:[0.00734375, 0.00734375, 0.0075, 0.0075, 0.0075, 0.0075, 0.0075, 0.0075, 0.0075, 0.0075, 0.0075, 0.0075, 0.0075, 0.0075, 0.0075, 0.00765625, 0.0075, 0.0075, 0.0075, 0.00734375, 0.0075, 0.0075, 0.00765625, 0.0075, 0.00765625, 0.0075, 0.0075, 0.0075, 0.0075, 0.0075, 0.0075, 0.00734375, 0.15140625, 0.10453125, 0.09828125, 0.09828125, 0.17140625, 0.1521875, 0.11359375]
2013-11-15 03:09:02,670 DEBUG    neat.locals.overload.mhod.core MHOD time_in_states:4
2013-11-15 03:09:02,670 DEBUG    neat.locals.overload.mhod.core MHOD time_in_state_n:0
2013-11-15 03:09:02,671 DEBUG    neat.locals.overload.mhod.core MHOD p:[[1.0, 0.0], [0.0, 0.0]]
2013-11-15 03:09:02,671 DEBUG    neat.locals.overload.mhod.core MHOD current_state:0
2013-11-15 03:09:02,671 DEBUG    neat.locals.overload.mhod.core MHOD p[current_state]:[1.0, 0.0]
2013-11-15 03:09:02,671 INFO     neat.locals.manager Completed overload detection
2013-11-15 03:09:02,671 INFO     neat.locals.manager Underload detected
2013-11-15 03:09:02,671 INFO     urllib3.connectionpool Starting new HTTP connection (1): controller

on Controller host, received requests about underload/overload, but appear errors when processing:

2013-11-15 10:07:51,444 DEBUG    neat.globals.manager Request parameters validated
2013-11-15 10:07:51,444 INFO     neat.globals.manager Received a request from 10.10.10.11: {'username': 'd033e22ae348aeb5660fc2140aec35850c4da997
'
, 'host': 'compute', 'password': '5baa61e4c9b93f3f0682250b6cf8331b7ee68fd8', 'reason': 0, 'time': 1384484871.46}
2013-11-15 10:07:51,444 INFO     neat.globals.manager Processing an underload of a host compute
2013-11-15 10:07:51,444 INFO     neat.globals.manager Started processing an underload request
2013-11-15 10:07:51,446 INFO     urllib3.connectionpool Starting new HTTP connection (5): 10.10.10.10
2013-11-15 10:07:51,471 ERROR    neat.globals.manager Exception during request processing:
Traceback (most recent call last):
 
File "/usr/local/lib/python2.7/dist-packages/openstack_neat-0.1-py2.7.egg/neat/globals/manager.py", line 231, in service
   
params['host'])
 
File "<string>", line 2, in execute_underload
 
File "/usr/local/lib/python2.7/dist-packages/contracts/main.py", line 296, in contracts_checker
    result
= function_(*args, **kwargs)
 
File "/usr/local/lib/python2.7/dist-packages/openstack_neat-0.1-py2.7.egg/neat/globals/manager.py", line 306, in execute_underload
    hosts_to_vms
= vms_by_hosts(state['nova'], state['compute_hosts'])
 
File "<string>", line 2, in vms_by_hosts
 
File "/usr/local/lib/python2.7/dist-packages/contracts/main.py", line 296, in contracts_checker
    result
= function_(*args, **kwargs)
 
File "/usr/local/lib/python2.7/dist-packages/openstack_neat-0.1-py2.7.egg/neat/globals/manager.py", line 709, in vms_by_hosts
   
for vm in nova.servers.list():
 
File "/usr/lib/python2.7/dist-packages/novaclient/v1_1/servers.py", line 404, in list
   
return self._list("/servers%s%s" % (detail, query_string), "servers")
 
File "/usr/lib/python2.7/dist-packages/novaclient/base.py", line 61, in _list
    _resp
, body = self.api.client.get(url)
 
File "/usr/lib/python2.7/dist-packages/novaclient/client.py", line 229, in get
   
return self._cs_request(url, 'GET', **kwargs)
 
File "/usr/lib/python2.7/dist-packages/novaclient/client.py", line 202, in _cs_request
   
self.authenticate()
 
File "/usr/lib/python2.7/dist-packages/novaclient/client.py", line 329, in authenticate
    auth_url
= self._v2_auth(auth_url)
 
File "/usr/lib/python2.7/dist-packages/novaclient/client.py", line 411, in _v2_auth
   
return self._authenticate(url, body)
 
File "/usr/lib/python2.7/dist-packages/novaclient/client.py", line 423, in _authenticate
   
**kwargs)
 
File "/usr/lib/python2.7/dist-packages/novaclient/client.py", line 195, in _time_request
    resp
, body = self.request(url, method, **kwargs)
 
File "/usr/lib/python2.7/dist-packages/novaclient/client.py", line 166, in request
   
**kwargs)
 
File "/usr/lib/python2.7/dist-packages/requests/sessions.py", line 335, in request
    resp
= self.send(prep, **send_kwargs)
 
File "/usr/lib/python2.7/dist-packages/requests/sessions.py", line 438, in send
    r
= adapter.send(request, **kwargs)
 
File "/usr/lib/python2.7/dist-packages/requests/adapters.py", line 327, in send
   
raise ConnectionError(e)

ConnectionError: HTTPConnectionPool(host='10.10.10.10', port=5000): Max retries exceeded with url: /v2.0/tokens (Caused by <class 'socket.error'>
: [Errno 104] Connection reset by peer)


but, port 5000 on  controller is listening, and the global manager established this connection.

root@controller:~# netstat -anlpe|grep 5000
tcp        
0      0 0.0.0.0:5000            0.0.0.0:*               LISTEN      109        3226390     7230/python tcp        0      0 10.10.10.10:52217       10.10.10.10:5000        ESTABLISHED 0          6562707     11780/python

root@controller
:~# ps -ax|grep 11780
11780 pts/9    S      0:00 /usr/bin/python /usr/local/bin/neat-global-manage


Please guide me to debug them.
Thank you SO MUCH!

--
tabatuan
TA BA TUAN

tuan...@vccorp.vn

unread,
Nov 15, 2013, 2:18:16 AM11/15/13
to opensta...@googlegroups.com


When that, appear errors of local_manager on Compute nodes :

2013-11-15 14:13:30,428 INFO     neat.locals.manager Underload detected
2013-11-15 14:13:30,429 INFO     requests.packages.urllib3.connectionpool Starting new HTTP connection (1): controller
2013-11-15 14:13:30,443 DEBUG    requests.packages.urllib3.connectionpool "PUT / HTTP/1.1" 500 743
2013-11-15 14:13:30,443 INFO     neat.locals.manager Received response: [500]
   
<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">
   
<html>
       
<head>
           
<title>Error: 500 Internal Server Error</title>
            <style type="text/
css">
              html {background-color: #eee; font-family: sans;}
              body {background-color: #fff; border: 1px solid #ddd;
                    padding: 15px; margin: 15px;}
              pre {background-color: #eee; border: 1px solid #ddd; padding: 5px;}
            </style>
        </head>
        <body>
            <h1>Error: 500 Internal Server Error</h1>
            <p>Sorry, the requested URL <tt>&#039;http://controller:60080/&#039;</tt>
               caused an error:</p>
            <pre>Internal Server Error</pre>
        </body>
    </html>

2013-11-15 14:13:30,443 INFO     neat.locals.manager Completed an iteration


--tuantaba
Ta Ba Tuan

Anton Beloglazov

unread,
Nov 18, 2013, 7:13:07 AM11/18/13
to opensta...@googlegroups.com
Hi Ta Ba Tuan,

Do you still have that problem? The log of the local manager shows that the request has failed on the global manager. The global managers fails due to the SSL issue you wrote about in the previous email. Is it possible to test it without SSL in your environment? 

Best regards,
Anton
Reply all
Reply to author
Forward
0 new messages