Error while setting up taiga-celery service

[Amruta Vispute]

Hi ,

   I am following production setup document for setting up taiga celery service.

   

   Successfully completed below steps :

1.     Setup of rabbitmq and redis server
   
2.     local.py settings changes for celery as per given document
   
3.     celery configurations added in circus.ini 
   
4.     reloading config changes and restarting taiga

    But facing issue while i am trying to start taiga-celery service 

     :~$ circusctl start taiga-celery

error: program taiga-celery not found

    I could not figure out reason.

    Also tried with taiga virtual environment activated (after workon taiga)

Regards, 

 Amruta 

[Alejandro Alonso]

Hello Amruta,

Could you paste here your circus config file please? (~/circus.ini)

Regards,

--
You received this message because you are subscribed to the Google Groups "taigaio" group.
To unsubscribe from this group and stop receiving emails from it, send an email to taigaio+u...@googlegroups.com.
To post to this group, send email to tai...@googlegroups.com.
To view this discussion on the web, visit https://groups.google.com/d/msgid/taigaio/add43581-6e79-4215-aaac-f7bf3489dd9d%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Alejandro Alonso Fernández   CIO & Co-founder alejandr...@kaleidos.net  | Tel: (+34) 627263808 | (+34) 913562995 www.kaleidos.net/FC8EAC/

[Amruta Vispute]

Hi

   Below is my circus.ini file

[circus]
check_delay = 5
endpoint = tcp://127.0.0.1:5555
pubsub_endpoint = tcp://127.0.0.1:5556
statsd = true

[watcher:taiga]
working_dir = ${HOME}/taiga-back
cmd = gunicorn
args = -w 3 -t 60 --pythonpath=. -b 0.0.0.0:8001 taiga.wsgi
uid = rgaurava
numprocesses = 1
autostart = true
send_hup = true
stdout_stream.class = FileStream
stdout_stream.filename = ${HOME}/logs/gunicorn.stdout.log
stdout_stream.max_bytes = 10485760
stdout_stream.backup_count = 4
stderr_stream.class = FileStream
stderr_stream.filename = ${HOME}/logs/gunicorn.stderr.log
stderr_stream.max_bytes = 10485760
stderr_stream.backup_count = 4

[env:taiga]
PATH = ${HOME}/.virtualenvs/taiga/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/usr/lib/jvm/java-7-oracle/bin:/usr/lib/jvm/java-7-oracle/db/bin:/usr/lib/jvm/java-7-oracle/jre/bin:/usr/lib/jvm/java-7-oracle/bin:/usr/share/maven/bin:${HOME}/.virtualenvs/taiga/bin
TERM=rxvt-256color
SHELL=/bin/bash
USER=taiga
LANG=en_US.UTF-8
HOME=${HOME}
PYTHONPATH=${HOME}/.local/lib/python3.4/site-packages

[watcher:taiga-celery]
working_dir = ${HOME}/taiga-back
cmd = celery
args = -A taiga worker -c 4
uid = taiga
numprocesses = 1
autostart = true
send_hup = true
stdout_stream.class = FileStream
stdout_stream.filename = ${HOME}/logs/celery.stdout.log
stdout_stream.max_bytes = 10485760
stdout_stream.backup_count = 4
stderr_stream.class = FileStream
stderr_stream.filename = ${HOME}/logs/celery.stderr.log
stderr_stream.max_bytes = 10485760
stderr_stream.backup_count = 4

[env:taiga-celery]
PATH = ${HOME}/.virtualenvs/taiga/bin:$PATH
TERM=rxvt-256color
SHELL=/bin/bash
USER=taiga
LANG=en_US.UTF-8
HOME=${HOME}
PYTHONPATH=${HOME}/.virtualenvs/taiga/lib/python3.4/site-packages

[Alejandro Alonso]

It seems that circus can't find that entry, did you execute the "circusctl reloadconfig" for reloading the config file?

Regards,

To view this discussion on the web, visit https://groups.google.com/d/msgid/taigaio/8b734af5-5391-464c-a32c-1ae8dd339763%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

[Alejandro Alonso]

And what's the output if you execute just "circusctl"?

2015-04-16 13:17 GMT+02:00 Amruta Vispute <ami.v...@gmail.com>:

Yes i have reloaded config changes and restarted taiga before starting celery

[Alejandro Alonso]

I think circus wasn't updating correctly the configuration  from the file but it seems to be working. If you execute circusctl again it should show:

taiga-celery: active

If not you should check your log files to see what is happening.

Regards,

2015-04-16 13:29 GMT+02:00 Amruta Vispute <ami.v...@gmail.com>:

I have not tried it so

First when i tried it now it was showing : (taiga)
$ circusctl

circusctl 0.11.1
circusd-stats: active
taiga: active

(circusctl) quit

ok

After i types quit now it is showing :
 
$ circusctl

circusctl 0.11.1
circusd-stats: stopped
taiga: active
taiga-celery: starting

(circusctl)

[Alejandro Alonso]

Hello Amruta,

All the taiga logs are under ~/logs. You could also try to execute manually the celery command to check whats happening with:

celery worker -A taiga.celery -l debug

Under your virtualenv and from your taiga-back path.

Regards,

2015-04-16 14:26 GMT+02:00 Amruta Vispute <ami.v...@gmail.com>:

Hi alejandro ,
 

    I have tried starting and stoping taiga-celery watcher from command line.

    it is not activating , showing starting status always.

    You mentioned to check log files, I am really naive user for ubuntu system too.

    Can you point me location where i can get logs for circus utility .

    Checking in default /var/logs where i could not find any logs.

Thanks,

 Amruta

   

[Amruta Vispute]

Hi Alejandro ,
  
    Basically here i am able to activate taiga-celery watcher.
    Error was due to uid which is set as taiga in Watcher in circus.ini.
    I have changed uid with my user.
    So now taiga-celery watcher is active.
 
    In taiga default logs file i.e. in ~/logs directory there are log files for gunicorn , nginx and now for celery.
    where i am not able to find any error previously.

    My first problem is i guess resolved now.
    After starting taiga-celery , now there is error while connecting .
    Celery logs are showing :
       [2015-04-16 13:05:24,068: ERROR/MainProcess] consumer: Cannot connect to amqp://guest:**@127.0.0.1:5672//: [Errno 111] Connection refused.
     Trying again in 8.00 seconds...

    is the other setting which is done in local.py is correct ? can i change port here or is it a default port for celery service ?

[Amruta Vispute]

  Above mentioned problem is also resolved.
  It is due to rabbitmq server setup is not done properly.

  Followed this LINK for rabbitmq-server setup.

Thanks ,
 Amruta

[Alejandro Alonso]

Great!,

Did you detect any concrete failure in the doc?

Regards,

To view this discussion on the web, visit https://groups.google.com/d/msgid/taigaio/918024f3-3d68-4ca1-9220-5c0c50fc82f9%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

[Amruta Vispute]

Hi
   Following can be possible updates in taiga-celery setup documentation :

  1> uid attribute in watcher :
          In setup documentation , we can add explanation about circus ini configuration setup.
        Specifically for uid attribute in any watcher should be set to ${USER}.
         The same value is set by taiga-scripts in watcher taiga.
         While doing setup i copied taiga-celery watcher as it is , and took some time to find out exact error.
        So update would be : uid attribute to be set as ${USER} according to user system

  2> Rabbitmq-server setup on ubuntu :
          On my system , Rabbitmq package setup  is not up-dated for ubuntu so

         For setup i followed these steps (Reference : https://www.digitalocean.com/community/tutorials/how-to-install-and-manage-rabbitmq ):
           1. Update system's default application toolset (optional)
               apt-get update
               apt-get -y upgrade
           2.Enable RabbitMQ application repository
               echo "deb http://www.rabbitmq.com/debian/ testing main" >> /etc/apt/sources.list 
           3. Add the verification key for the package
               curl http://www.rabbitmq.com/rabbitmq-signing-key-public.asc | sudo apt-key add -
           4. Update the sources with our new addition from above
               apt-get update
           5. download and install RabbitMQ
               sudo apt-get install rabbitmq-server
           
Thanks and Regards,
 Amruta