some questions about github project

28 views
Skip to first unread message

peter zhu

unread,
Sep 5, 2016, 12:53:26 AM9/5/16
to scrapy-users
hi,guys!
 i followed this project and want to get some newest datas.so i clone the project with this steps:
1. pip install -r requirements.txt (but i find something need to upgrade and then install one by one.)
this warning which i get from install process,maybe not important
pip install Cython warning:

warning
: no files found matching '*.pyx' under directory 'Cython/Debugger/Tests'
    warning
: no files found matching '*.pxd' under directory 'Cython/Debugger/Tests'
    warning
: no files found matching '*.h' under directory 'Cython/Debugger/Tests'
    warning
: no files found matching '*.pxd' under directory 'Cython/Utility'
   
Installing cython script to /usr/bin
   
Installing cygdb script to /usr/bin
   
Installing cythonize script to /usr/bin
 
Could not find .egg-info directory in install record for Cython
Successfully installed Cython
Cleaning up...


pip install gunicorn warning
:
Downloading/unpacking gunicorn
 
Downloading gunicorn-19.6.0.tar.gz (404kB): 404kB downloaded
 
Running setup.py egg_info for package gunicorn
   
    warning
: no previously-included files matching '__pycache__' found under directory '*'
    warning
: no previously-included files matching '*.py[co]' found under directory '*'
Installing collected packages: gunicorn
 
Running setup.py install for gunicorn
   
    warning
: no previously-included files matching '__pycache__' found under directory '*'
    warning
: no previously-included files matching '*.py[co]' found under directory '*'
     
File "/usr/lib/python2.7/site-packages/gunicorn/workers/_gaiohttp.py", line 84
       
yield from self.wsgi.close()
                 
^
   
SyntaxError: invalid syntax
   
   
Installing gunicorn_paster script to /usr/bin
   
Installing gunicorn script to /usr/bin
   
Installing gunicorn_django script to /usr/bin
 
Could not find .egg-info directory in install record for gunicorn
Successfully installed gunicorn
Cleaning up...

2,i follow this guide to install and config
StatsD
this is my statsd config file(config.js) content( others default ):
{
 port
: 8125,
 mgmt_port
: 8126,
 backends
: [ "./backends/console" ]
}


3,
with command "node stats.js config.js"(run statsd) and get this info:
[zjhxmjl@localhost statsd]$ node stats.js config.js
5 Sep 12:43:16 - [21059] reading config file: config.js
5 Sep 12:43:16 - server is up
Flushing stats at  Mon Sep 05 2016 12:43:26 GMT+0800 (CST)
{ counters:
   
{ 'statsd.bad_lines_seen': 0,
     
'statsd.packets_received': 0,
     
'statsd.metrics_received': 0 },
  timers
: {},
  gauges
: {},
  timer_data
: {},
  counter_rates
:
   
{ 'statsd.bad_lines_seen': 0,
     
'statsd.packets_received': 0,
     
'statsd.metrics_received': 0 },
  sets
: {},
  pctThreshold
: [ 90 ] }

4, run command "gunicorn --workers=1 --bind=127.0.0.1:9999 --config=config.py server:falcon.API" and get this info:
[zjhxmjl@localhost phoneregion]$ gunicorn --workers=1 --bind=127.0.0.1:9999 --config=config.py server:falcon.API
[2016-09-05 12:44:35 +0000] [21066] [INFO] Starting gunicorn 19.6.0
[2016-09-05 12:44:35 +0000] [21066] [INFO] Listening at: http://127.0.0.1:9999 (21066)
[2016-09-05 12:44:35 +0000] [21066] [INFO] Using worker: gevent
[2016-09-05 12:44:35 +0000] [21071] [INFO] Booting worker with pid: 21071

5,now i run "python main.py" but no respond? i had change the config.py with my personal info,but not succeed.maybe something is wrong,thanks for advance.
config.py modify content:
INFOBRIGHT = {
   
"host": "127.0.0.1",
   
"user": "root",
   
"password": "mypasswd",
   
"database": "phonenum",
   
"local_infile": 1,
}





Reply all
Reply to author
Forward
0 new messages