Web3py

[John Bannister]

Hi All,

Had a first real 'play' with web3py' today and have a few questions the biggest of which I am hoping the gurus will be able to answer:-

1: Is there any way to not to have to restart the app every time changes are made to actions in the controller or new actions added etc? I understand that controllers are basically being imported when the app fires up but is any there any way to occasionally reload instead of having to restart the app? This is a fairly big one for me as sometimes tweaks will need to be made in production and restarting the web server is not really an option so hopefully I am missing something really simple.

Thanks in advance

John

 

[Massimo Di Pierro]

yes. There is a button on the top/right of the dashboard "reload apps"

[黄祥]

test 'reload apps' on http://localhost:8000/_dashboard return an error on terminal and also on browser http://localhost:8000/_dashboard when click superheroes installed applications

[FAILED] loading superheroes    
    Traceback (most recent call last):
      File "/Users/sugizo/learn/python/web3py/web3py/core.py", line 577, in import_apps
        reloader.reload(module)
      File "/Users/sugizo/miniconda3/envs/python3_test/lib/python3.7/site-packages/reloader.py", line 147, in reload
        _reload(m, set())
      File "/Users/sugizo/miniconda3/envs/python3_test/lib/python3.7/site-packages/reloader.py", line 135, in _reload
        imp.reload(m)
      File "/Users/sugizo/miniconda3/envs/python3_test/lib/python3.7/imp.py", line 314, in reload
        return importlib.reload(module)
      File "/Users/sugizo/miniconda3/envs/python3_test/lib/python3.7/importlib/__init__.py", line 169, in reload
        _bootstrap._exec(spec, module)
      File "<frozen importlib._bootstrap>", line 630, in _exec
      File "<frozen importlib._bootstrap_external>", line 728, in exec_module
      File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
      File "/Users/sugizo/learn/python/web3py/apps/superheroes/__init__.py", line 28, in <module>
        db.person.insert(name='Clark Kent', job='Journalist')
      File "/Users/sugizo/miniconda3/envs/python3_test/lib/python3.7/site-packages/pydal/objects.py", line 762, in insert
        ret = self._db._adapter.insert(self, row.op_values())
      File "/Users/sugizo/miniconda3/envs/python3_test/lib/python3.7/site-packages/pydal/adapters/base.py", line 487, in insert
        raise e
      File "/Users/sugizo/miniconda3/envs/python3_test/lib/python3.7/site-packages/pydal/adapters/base.py", line 482, in insert
        self.execute(query)
      File "/Users/sugizo/miniconda3/envs/python3_test/lib/python3.7/site-packages/pydal/adapters/__init__.py", line 67, in wrap
        return f(*args, **kwargs)
      File "/Users/sugizo/miniconda3/envs/python3_test/lib/python3.7/site-packages/pydal/adapters/base.py", line 413, in execute
        rv = self.cursor.execute(command, *args[1:], **kwargs)
    sqlite3.OperationalError: database is locked

the strange things also occured

1st. when first run server the route for apps : _scaffold and myapp are appears on http://localhost:8000/_dashboard, after hit 'reload apps' the route for apps are disappears. yet that still have the route for apps are _dashboard, examples, todo

2nd. yet the edited apps didn't take an effect

e.g.

1. ./web3py-start apps

2. edit apps/myapp/controllers.py

change 

def helloworld(): return dict(name=request.forms.get('name', 'visitor'))

into

def helloworld(): return dict(name=request.forms.get('name', 'visitorsadf'))

3. hit 'reload apps' on http://localhost:8000/_dashboard

4. refresh http://localhost:8000/myapp/helloworld

expected result on browser:

Hello Dear visitorsadf

got result on browser:

Hello Dear visitor

expected result 'Hello Dear visitorsadf' can be achieved after stop and start the server again

best regards,

stifan

[John Bannister]

Hi Massimo,

 

I have tried that but it has no effect. It seems to be doing something for a while but the only way I can get changes to appear is to restart the server.

 

Basically what I did was to copy and rename the helloworld action a few times so helloworld1 …….helloworld7 (all in same controller.py)  giving appropriate return messages.

 

If I reload using the dashboard button I still only see helloworld (the rest give me 404 errors) but if I restart the server I can access myapp/helloworld1 to myapp/helloworld7.

 

Also it seems that the reload apps button is reloading all the apps in the applications directory. Is this intentional or is there a way to just reload the app currently being developed?

 

BR

John

--
Resources:
- http://web2py.com
- http://web2py.com/book (Documentation)
- http://github.com/web2py/web2py (Source code)
- https://code.google.com/p/web2py/issues/list (Report Issues)
---
You received this message because you are subscribed to the Google Groups "web2py-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to web2py+un...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/web2py/c33707df-ec41-4574-a6a6-54c2905ff10e%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Massimo Di Pierro]

I fixed the database locking problem. missing db.commit()

Editing apps and reloading forks for me. Please try again and let's try figure out why does not work for you.

It is intentionally reloading all apps but this can easily be changed. I will change it.

Massimo

To unsubscribe from this group and stop receiving emails from it, send an email to web2py+unsubscribe@googlegroups.com.

[John Bannister]

Hi Massimo,

 

I have downloaded latest web3py and same thing is happening. I can see in the console that it is reloading all the apps but for me updates are not happening until I restart the server.

 

I am running web3py in a python3 venv  on windows/linux (Ubuntu 18) python 3.6.

 

Myapp/controller.py

 

from web3py import action, request, redirect, abort

from . models import db

 

@action('helloworld') # exposes http://127.0.0.1:8000/myapp/helloworld

@action.uses(db, 'helloworld.html')

def helloworld(): return dict(name=request.forms.get('name', 'visitor'))

 

@action('helloworld1') # exposes http://127.0.0.1:8000/myapp/helloworld1

@action.uses(db, 'helloworld.html')

def helloworld1(): return dict(name=' 1 '+ request.forms.get('name', 'visitor'))

 

@action('helloworld2') # exposes http://127.0.0.1:8000/myapp/helloworld2

@action.uses(db, 'helloworld.html')

def helloworld2(): return dict(name=' 2 ' +request.forms.get('name', 'visitor'))

 

@action('helloworld3') # exposes http://127.0.0.1:8000/myapp/helloworld3

@action.uses(db, 'helloworld.html')

def helloworld3(): return dict(name=' 3 ' + request.forms.get('name', 'visitor'))  

 

After reload apps only helloworld accessible. After server restart all are.

 

BR

John

To unsubscribe from this group and stop receiving emails from it, send an email to web2py+un...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/web2py/c33707df-ec41-4574-a6a6-54c2905ff10e%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Resources:
- http://web2py.com
- http://web2py.com/book (Documentation)
- http://github.com/web2py/web2py (Source code)
- https://code.google.com/p/web2py/issues/list (Report Issues)
---
You received this message because you are subscribed to the Google Groups "web2py-users" group.

To unsubscribe from this group and stop receiving emails from it, send an email to web2py+un...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/web2py/84b51eaa-209e-45fa-88a3-d4f986f7a441%40googlegroups.com.

[黄祥]

problem still exist (in commits 110) only superheroes app traceback error is gone when hit 'reload apps':
1. 'routes for <app_name>' disappears after hit 'reload apps' for : 

- scaffold

- myapp

but for _dashboard, example, todo still exist (appears as expected)

2. editing and adding new function in controller apps/myapp/controller.py

@action('helloworld') # exposes http://127.0.0.1:8000/myapp/helloworld
@action.uses(db, 'helloworld.html')

def helloworld(): return dict(name=request.forms.get('name', 'visitoras'))

@action('helloworld1') # exposes http://127.0.0.1:8000/myapp/helloworld
@action.uses(db, 'helloworld.html')
def helloworld1(): return dict(name=request.forms.get('name', 'visitorasd'))

result (not expected) when hit : http://localhost:8000/myapp/helloworld

Hello Dear visitor

result (not expected) when hit : http://localhost:8000/myapp/helloworld1

404

not found

steps

rm -rf web3py
git clone https://github.com/web2py/web3py
cd web3py
source activate python3_test
pip install -U -r requirements.txt
./web3py-start apps

also seen you've had mailer.py, is still not tested yet, no example or no doc available

best regards,

stifan

[John Bannister]

Update on this :-

Just tried it on native windows10  python3.7 and same results. New functions return error 404 until server restart.

BR

John

[黄祥]

Editing apps and reloading forks for me. Please try again and let's try figure out why does not work for you.

after tried latest commit (110), guess when it's work on you, but not work on us, perhaps related with module installed (python or js via npm) on your side, but not installed on us. not sure just guess.

best regards,

stifan 

[John Bannister]

For me I have not installed any npm or other. Clean python 3 virtual environment into which I installed web3py on Ubuntu. Base install on windows 10 as well same. All works fine apart from the reloading. I can try to set up on one of my Centos 7 servers later tomorrow but am pretty sure its gonna be the same.

Best Regards

John

[Massimo Di Pierro]

Does it print this when you press [reload]?

[OK] reloaded _dashboard    
[OK] reloaded myapp    
[OK] reloaded todo    
[OK] reloaded superheroes    
[OK] reloaded examples    
[OK] reloaded _scaffold

[Massimo Di Pierro]

Also, web3py uses this:

https://pypi.org/project/reloader/

The docs have an example. Does this module work for you?

[黄祥]

Does it print this when you press [reload]?

yes it is

$ ./web3py-start apps
 _______  ____________  ____  ______  __

|  ____/ / / ____/ __ |/___ \/ __ \ \/ /

| |     / / /_  / /_/ /___/ / /_/ /\  /

| | /| / / __/ / __  //__  / ____/ / /

| |/ |/ / /___/ /_/ /___/ / / ____/ /

|___/|_/_____/_____/_____/_/ /_____/

It is still experimental...

Dashboard is at: http://127.0.0.1:8000/_dashboard
[OK] loaded _dashboard      
[OK] loaded _scaffold      
[OK] loaded examples      
[OK] loaded myapp      
[OK] loaded superheroes      
[OK] loaded todo      
Bottle v0.12.16 server starting up (using TornadoServer())...
Listening on http://127.0.0.1:8000/
Hit Ctrl-C to quit.

WARNING:tornado.access:404 GET /myapp/static/favicon.ico (127.0.0.1) 2.32ms
WARNING:tornado.access:404 GET /examples/static/favicon.ico (127.0.0.1) 2.35ms
WARNING:tornado.access:404 GET /todo/static/favicon.ico (127.0.0.1) 2.07ms
WARNING:tornado.access:404 GET /_scaffold/static/favicon.ico (127.0.0.1) 1.89ms
WARNING:tornado.access:404 GET /superheroes/static/favicon.ico (127.0.0.1) 1.65ms
WARNING:tornado.access:404 GET /favicon.ico (127.0.0.1) 1.57ms
[OK] reloaded _dashboard      
[OK] reloaded _scaffold      
[OK] reloaded examples      
[OK] reloaded myapp      
[OK] reloaded superheroes      
[OK] reloaded todo

but 
- 'routes for <my_app>'
- edit or add new function on web apps
is not work

best regards,

stifan 

[黄祥]

Also, web3py uses this:

https://pypi.org/project/reloader/

The docs have an example. Does this module work for you?

yes reloader already installed, since it's written on requirements.txt

git clone https://github.com/web2py/web3py
cd web3py
pip install -r requirements.txt

perhaps some files on your side not commited on github because of .gitignore
not sure just guess

best regards,

stifan

[John Bannister]

I am getting the below reload console output when I fire up tornado as well as when I hit the reload all button on both windows and Ubuntu installations.

BR

John

 

 

From: web...@googlegroups.com [mailto:web...@googlegroups.com] On Behalf Of Massimo Di Pierro
Sent: 18 May 2019 07:20
To: web2py-users
Subject: Re: [web2py] Re: Web3py

 

Also, web3py uses this:

--

Resources:
- http://web2py.com
- http://web2py.com/book (Documentation)
- http://github.com/web2py/web2py (Source code)
- https://code.google.com/p/web2py/issues/list (Report Issues)
---
You received this message because you are subscribed to the Google Groups "web2py-users" group.

To unsubscribe from this group and stop receiving emails from it, send an email to web2py+un...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/web2py/456b6c96-fac7-456f-bcdb-8df87464af31%40googlegroups.com.

[Massimo Di Pierro]

what if you do not user tornado and replace

bottle.run(server='tornado', host=host, port=int(port))

with

bottle.run(host=host, port=int(port))

it is very strange. Please try test the reloader module on its own.

[John Bannister]

Same result unfortunately

[John Bannister]

Running reload manually works as advertised on PyPi

[John Bannister]

Hi Stifan,

 

What OS are you testing on?

 

BR

John

 

From: web...@googlegroups.com [mailto:web...@googlegroups.com] On Behalf Of ??
Sent: 18 May 2019 08:14
To: web2py-users
Subject: Re: [web2py] Re: Web3py

 

Also, web3py uses this:

--

Resources:
- http://web2py.com
- http://web2py.com/book (Documentation)
- http://github.com/web2py/web2py (Source code)
- https://code.google.com/p/web2py/issues/list (Report Issues)
---
You received this message because you are subscribed to the Google Groups "web2py-users" group.

To unsubscribe from this group and stop receiving emails from it, send an email to web2py+un...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/web2py/46e203b8-b11d-4abd-96b9-99a26ef2b802%40googlegroups.com.

[黄祥]

web3py/web3py/core.py

tried

bottle.run(server='tornado', host=host, port=int(port), reloader=True)

and 

bottle.run(host=host, port=int(port), reloader=True)

got same result, edit and add new function, routes for <myapp> not work

tested work for edit and add new function (but still routes for <myapp> still not work)

web3py/web3py/core.py

bottle.run(server='gevent', host=host, port=int(port), reloader=True)

but the log run strangely (loaded web apps twice):

$ ./web3py-start apps

Bottle v0.12.16 server starting up (using GeventServer())...

Listening on http://127.0.0.1:8000/
Hit Ctrl-C to quit.

@john, perhaps you can share how to run reloader manually ?

thx n best regards,

stifan

[黄祥]

What OS are you testing on?

mac, linux via docker (ubuntu, debian, centos or fedora) 

btw, seems not related with os, like root cause is in the web server module (parameter to run web server perhaps (not sure just guess) ), see previous message 

best regards,

stifan

[黄祥]

test reload apps with gunicorn server and reloader=True, can run at first, but when hit 'reload apps' it return an error on terminal

web3py/web3py/core.py

bottle.run(server='gunicorn', host=host, port=int(port), reloader=True)

[2019-05-18 18:43:48 +0700] [47687] [INFO] Starting gunicorn 19.9.0
[2019-05-18 18:43:48 +0700] [47687] [INFO] Listening at: http://127.0.0.1:8000 (47687)
[2019-05-18 18:43:48 +0700] [47687] [INFO] Using worker: sync
[2019-05-18 18:43:48 +0700] [47691] [INFO] Booting worker with pid: 47691
[2019-05-18 18:44:13 +0700] [47687] [INFO] Handling signal: int

Traceback (most recent call last):

  File "/Users/sugizo/miniconda3/envs/python3_test/lib/python3.7/site-packages/gunicorn/workers/base.py", line 190, in handle_quit
    time.sleep(0.1)
  File "/Users/sugizo/miniconda3/envs/python3_test/lib/python3.7/site-packages/gevent/hub.py", line 159, in sleep
    hub.wait(t)
  File "src/gevent/_hub_primitives.py", line 46, in gevent.__hub_primitives.WaitOperationsGreenlet.wait
  File "src/gevent/_hub_primitives.py", line 55, in gevent.__hub_primitives.WaitOperationsGreenlet.wait
  File "src/gevent/_waiter.py", line 151, in gevent.__waiter.Waiter.get
  File "src/gevent/_greenlet_primitives.py", line 60, in gevent.__greenlet_primitives.SwitchOutGreenletWithLoop.switch
  File "src/gevent/_greenlet_primitives.py", line 60, in gevent.__greenlet_primitives.SwitchOutGreenletWithLoop.switch
  File "src/gevent/_greenlet_primitives.py", line 63, in gevent.__greenlet_primitives.SwitchOutGreenletWithLoop.switch
  File "src/gevent/_greenlet_primitives.py", line 66, in gevent.__greenlet_primitives.SwitchOutGreenletWithLoop.switch_out
  File "src/gevent/_greenlet_primitives.py", line 67, in gevent.__greenlet_primitives.SwitchOutGreenletWithLoop.switch_out
gevent.exceptions.BlockingSwitchOutError: Impossible to call blocking function in the event loop callback
2019-05-18T11:44:13Z
[2019-05-18 18:44:13 +0700] [47691] [ERROR] Exception in worker process

Traceback (most recent call last):

  File "/Users/sugizo/miniconda3/envs/python3_test/lib/python3.7/site-packages/gunicorn/arbiter.py", line 583, in spawn_worker
    worker.init_process()
  File "/Users/sugizo/miniconda3/envs/python3_test/lib/python3.7/site-packages/gunicorn/workers/base.py", line 134, in init_process
    self.run()
  File "/Users/sugizo/miniconda3/envs/python3_test/lib/python3.7/site-packages/gunicorn/workers/sync.py", line 124, in run
    self.run_for_one(timeout)
  File "/Users/sugizo/miniconda3/envs/python3_test/lib/python3.7/site-packages/gunicorn/workers/sync.py", line 83, in run_for_one
    self.wait(timeout)
  File "/Users/sugizo/miniconda3/envs/python3_test/lib/python3.7/site-packages/gunicorn/workers/sync.py", line 35, in wait
    ret = select.select(self.wait_fds, [], [], timeout)
  File "/Users/sugizo/miniconda3/envs/python3_test/lib/python3.7/site-packages/gevent/select.py", line 169, in select
    return result.select(rlist, wlist, timeout)
  File "/Users/sugizo/miniconda3/envs/python3_test/lib/python3.7/site-packages/gevent/select.py", line 110, in select
    self.event.wait(timeout=timeout)
  File "src/gevent/event.py", line 127, in gevent._event.Event.wait
  File "src/gevent/_abstract_linkable.py", line 192, in gevent.__abstract_linkable.AbstractLinkable._wait
  File "src/gevent/_abstract_linkable.py", line 165, in gevent.__abstract_linkable.AbstractLinkable._wait_core
  File "src/gevent/_abstract_linkable.py", line 169, in gevent.__abstract_linkable.AbstractLinkable._wait_core
  File "src/gevent/_greenlet_primitives.py", line 60, in gevent.__greenlet_primitives.SwitchOutGreenletWithLoop.switch
  File "src/gevent/_greenlet_primitives.py", line 60, in gevent.__greenlet_primitives.SwitchOutGreenletWithLoop.switch
  File "src/gevent/_greenlet_primitives.py", line 64, in gevent.__greenlet_primitives.SwitchOutGreenletWithLoop.switch
  File "src/gevent/__greenlet_primitives.pxd", line 35, in gevent.__greenlet_primitives._greenlet_switch
gevent.exceptions.BlockingSwitchOutError: Impossible to call blocking function in the event loop callback
[2019-05-18 18:44:13 +0700] [47691] [INFO] Worker exiting (pid: 47691)
[2019-05-18 18:44:14 +0700] [47687] [INFO] Shutting down: Master

best regards,

stifan

[John Bannister]

Hi Stifan,

I basically followed the example on the PyPi site which works fine. NB I did not manage to reload the modules in apps/myapp manually (from shell).

Have not had too much time today to get into it deeply as have other commitments.

I did however try to force the load_app to load as opposed to reload when the button is clecked but still same result.

Really weird.

BR

John

[黄祥]

already checked : https://pypi.org/project/reload

did you test :

reload ./web3py-start apps

?

want to learning about reload, but not sure how to do it

best regards,

stifan

[John Bannister]

No I initally tried from web3py folder to import apps.myapp.controllers.py but paths are relative and globals like evrirnment/gloabls like 'WEB3PY_APPS_FOLDER' are not available in the shell. (also tried from apps and myapp folder but same). Probably need to write a little script.

So .. I literally created a example.py with a print statement .. loaded it, changed it and reloaded it .. changes were there which tends to indicate that reloader is working.

I am also not too familiar at all with reloader unfortunately but am sure we will find the solution.

BR

John

[Massimo Di Pierro]

 Wait. You should not change that. Web3py does not uses the bottle bult-in reloader.  You should NOT have run(... reloader=True) I know that does not work well because of the order of imports.

Also reloader is not supposed to work if you set --number_workers. Could that be the problem?

[Massimo Di Pierro]

As mentioned before. Do not use the bottle built-in reloader. It is for a different use case. Also the reloader is not meant to with with gunicorn (because multiprocess). only this should work:

bottle.run(server='tornado', host=host, port=int(port))

[Massimo Di Pierro]

I do not think this helps. This would conflict with the fact web3py internally imports reloader.

[黄祥]

understood, my bad, just test it n report it what think related with the problem

@massimo

should this thing address an issue in github, so that you can focus release the first version of web3py ?

best regards,

stifan

[John Bannister]

Hi Guys,

Couple of things.

1: I added a print('Dependancies %s ' % reloader.get_dependencies(module)) just before the output to console in web3py/core.py.

Here is the output (not formatted):-

Dashboard is at: http://127.0.0.1:8000/_dashboard

[  ] loading examples ...
Dependancies None
[A[OK] loaded examples
[  ] loading myapp ...
Dependancies None
[A[OK] loaded myapp
[  ] loading superheroes ...
Dependancies None
[A[OK] loaded superheroes
[  ] loading todo ...
Dependancies None
[A[OK] loaded todo
[  ] loading _dashboard ...
Dependancies None
[A[OK] loaded _dashboard
[  ] loading _scaffold ...
Dependancies None
[A[OK] loaded _scaffold

Bottle v0.12.16 server starting up (using TornadoServer())...

Listening on http://127.0.0.1:8010/
Hit Ctrl-C to quit.

As expected no dependancies on initial load

After reload :-

[  ] reloading examples ...
Dependancies [<module 'os' from 'C:\\Users\\johhb\\AppData\\Local\\Programs\\Python\\Python3\\lib\\os.py'>, <module 'web3py' from 'C:\\Users\\johhb\\web3py\\web3py\\__init__.py'>, <module 'web3py.utils.form' from 'C:\\Users\\johhb\\web3py\\web3py\\utils\\form.py'>, <module 'pydal.validators' from 'C:\\Users\\johhb\\AppData\\Local\\Programs\\Python\\Python3\\lib\\site-packages\\pydal\\validators.py'>, <module 'yatl.helpers' from 'C:\\Users\\johhb\\AppData\\Local\\Programs\\Python\\Python3\\lib\\site-packages\\yatl\\helpers.py'>, <module 'pydal.drivers' from 'C:\\Users\\johhb\\AppData\\Local\\Programs\\Python\\Python3\\lib\\site-packages\\pydal\\drivers.py'>, <module 'pydal.adapters' from 'C:\\Users\\johhb\\AppData\\Local\\Programs\\Python\\Python3\\lib\\site-packages\\pydal\\adapters\\__init__.py'>, <module 'pydal.dialects' from 'C:\\Users\\johhb\\AppData\\Local\\Programs\\Python\\Python3\\lib\\site-packages\\pydal\\dialects\\__init__.py'>, <module 'pydal.parsers' from 'C:\\Users\\johhb\\AppData\\Local\\Programs\\Python\\Python3\\lib\\site-packages\\pydal\\parsers\\__init__.py'>, <module 'pydal.representers' from 'C:\\Users\\johhb\\AppData\\Local\\Programs\\Python\\Python3\\lib\\site-packages\\pydal\\representers\\__init__.py'>, <module 'pydal.base' from 'C:\\Users\\johhb\\AppData\\Local\\Programs\\Python\\Python3\\lib\\site-packages\\pydal\\base.py'>]
[A[OK] reloaded examples
[  ] reloading myapp ...
Dependancies [<module 'apps.myapp' from 'C:\\Users\\johhb\\web3py\\apps\\myapp\\__init__.py'>, <module 'apps.myapp' from 'C:\\Users\\johhb\\web3py\\apps\\myapp\\__init__.py'>]
[A[OK] reloaded myapp
[  ] reloading superheroes ...
Dependancies [<module 'os' from 'C:\\Users\\johhb\\AppData\\Local\\Programs\\Python\\Python3\\lib\\os.py'>, <module 'web3py' from 'C:\\Users\\johhb\\web3py\\web3py\\__init__.py'>, <module 'pydal.drivers' from 'C:\\Users\\johhb\\AppData\\Local\\Programs\\Python\\Python3\\lib\\site-packages\\pydal\\drivers.py'>, <module 'pydal.adapters' from 'C:\\Users\\johhb\\AppData\\Local\\Programs\\Python\\Python3\\lib\\site-packages\\pydal\\adapters\\__init__.py'>, <module 'pydal.dialects' from 'C:\\Users\\johhb\\AppData\\Local\\Programs\\Python\\Python3\\lib\\site-packages\\pydal\\dialects\\__init__.py'>, <module 'pydal.parsers' from 'C:\\Users\\johhb\\AppData\\Local\\Programs\\Python\\Python3\\lib\\site-packages\\pydal\\parsers\\__init__.py'>, <module 'pydal.representers' from 'C:\\Users\\johhb\\AppData\\Local\\Programs\\Python\\Python3\\lib\\site-packages\\pydal\\representers\\__init__.py'>, <module 'pydal.base' from 'C:\\Users\\johhb\\AppData\\Local\\Programs\\Python\\Python3\\lib\\site-packages\\pydal\\base.py'>, <module 'pydal.base' from 'C:\\Users\\johhb\\AppData\\Local\\Programs\\Python\\Python3\\lib\\site-packages\\pydal\\base.py'>, <module 'pydal.base' from 'C:\\Users\\johhb\\AppData\\Local\\Programs\\Python\\Python3\\lib\\site-packages\\pydal\\base.py'>, <module 'pydal.base' from 'C:\\Users\\johhb\\AppData\\Local\\Programs\\Python\\Python3\\lib\\site-packages\\pydal\\base.py'>]
[A[OK] reloaded superheroes
[  ] reloading todo ...
Dependancies [<module 'os' from 'C:\\Users\\johhb\\AppData\\Local\\Programs\\Python\\Python3\\lib\\os.py'>, <module 'web3py' from 'C:\\Users\\johhb\\web3py\\web3py\\__init__.py'>, <module 'pydal.drivers' from 'C:\\Users\\johhb\\AppData\\Local\\Programs\\Python\\Python3\\lib\\site-packages\\pydal\\drivers.py'>, <module 'pydal.adapters' from 'C:\\Users\\johhb\\AppData\\Local\\Programs\\Python\\Python3\\lib\\site-packages\\pydal\\adapters\\__init__.py'>, <module 'pydal.dialects' from 'C:\\Users\\johhb\\AppData\\Local\\Programs\\Python\\Python3\\lib\\site-packages\\pydal\\dialects\\__init__.py'>, <module 'pydal.parsers' from 'C:\\Users\\johhb\\AppData\\Local\\Programs\\Python\\Python3\\lib\\site-packages\\pydal\\parsers\\__init__.py'>, <module 'pydal.representers' from 'C:\\Users\\johhb\\AppData\\Local\\Programs\\Python\\Python3\\lib\\site-packages\\pydal\\representers\\__init__.py'>, <module 'pydal.base' from 'C:\\Users\\johhb\\AppData\\Local\\Programs\\Python\\Python3\\lib\\site-packages\\pydal\\base.py'>]
[A[OK] reloaded todo
[  ] reloading _dashboard ...
Dependancies [<module 'os' from 'C:\\Users\\johhb\\AppData\\Local\\Programs\\Python\\Python3\\lib\\os.py'>, <module 'datetime' from 'C:\\Users\\johhb\\AppData\\Local\\Programs\\Python\\Python3\\lib\\datetime.py'>, <module 'web3py' from 'C:\\Users\\johhb\\web3py\\web3py\\__init__.py'>, <module 'web3py.core' from 'C:\\Users\\johhb\\web3py\\web3py\\core.py'>, <module 'yatl.helpers' from 'C:\\Users\\johhb\\AppData\\Local\\Programs\\Python\\Python3\\lib\\site-packages\\yatl\\helpers.py'>]
[A[OK] reloaded _dashboard
[  ] reloading _scaffold ...
Dependancies [<module 'apps._scaffold' from 'C:\\Users\\johhb\\web3py\\apps\\_scaffold\\__init__.py'>, <module 'apps._scaffold.models' from 'C:\\Users\\johhb\\web3py\\apps\\_scaffold\\models.py'>]
[A[OK] reloaded _scaffold

I was actually expecting to see the models and controllers as dependancies as they are imported via __init__.py but they are not listed (dont know if this is taken care of by __init__.py. @Massimo ??

So for the sake of completeness I add a print() message to the last line of myapp/__init__.py and to controllers.py and on reload I see the output from __init__.py but not the print() I put in controllers.py which to me indicates that neither the controllers.py nor the models.py are being reloaded.

Hope this helps

BR

John

[John Bannister]

Just an update to the below.

It seems that the from . import 'whatever' is where the issue is with the reloader as if I do for example import os  or import datetime in the __init__.py they both show up in the list of dependencies. Anything with a from . import 'whatever'  just lists the apps/myapp as a dependency

BR

John

[黄祥]

tested latest commit (115) about recent tickets

- recent tickets can be deleted but when refresh the browser, http://localhost:8000/_dashboard it will appears again

- recent tickets can be edited, not sure why the ticket can be edited ?

- when click create, it show forms, but can't be saved, not sure, why the button 'create' appears, should be tickets automatically generate when error occured, can't be created manually

best regards,

stifan

[黄祥]

after hit 'reload' affect the '_dashboard', when do crud for 'recent tickets' (before hit 'reload', no error occured on terminal)

[OK] reloaded _dashboard    
[OK] reloaded _scaffold    
[OK] reloaded examples    
[OK] reloaded myapp    
[OK] reloaded superheroes    
[OK]

reloaded todo    
ERROR:root:Traceback (most recent call last):
  File "/Users/sugizo/learn/python/web3py/web3py/core.py", line 385, in wrapper
    ret = func(*func_args, **func_kwargs)
  File "/Users/sugizo/learn/python/web3py/apps/_dashboard/__init__.py", line 145, in api
    data = RestAPI(db, ALLOW_ALL_POLICY)(request.method, args[2], id, request.query, request.json)
  File "/Users/sugizo/miniconda3/envs/python3_test/lib/python3.7/site-packages/pydal/restapi.py", line 27, in wrapper
    data = func(*args, **kwargs)
  File "/Users/sugizo/miniconda3/envs/python3_test/lib/python3.7/site-packages/pydal/restapi.py", line 170, in __call__
    deleted = self.db(table.id == id).delete()
  File "/Users/sugizo/miniconda3/envs/python3_test/lib/python3.7/site-packages/pydal/objects.py", line 2422, in delete
    ret = db._adapter.delete(table, self.query)
  File "/Users/sugizo/miniconda3/envs/python3_test/lib/python3.7/site-packages/pydal/adapters/sqlite.py", line 87, in delete
    counter = super(SQLite, self).delete(table, query)
  File "/Users/sugizo/miniconda3/envs/python3_test/lib/python3.7/site-packages/pydal/adapters/base.py", line 541, in delete
    self.execute(sql)
  File "/Users/sugizo/miniconda3/envs/python3_test/lib/python3.7/site-packages/pydal/adapters/__init__.py", line 67, in wrap
    return f(*args, **kwargs)
  File "/Users/sugizo/miniconda3/envs/python3_test/lib/python3.7/site-packages/pydal/adapters/base.py", line 413, in execute
    rv = self.cursor.execute(command, *args[1:], **kwargs)
sqlite3.OperationalError: database is locked

best regards,

stifan

[Massimo Di Pierro]

ok you are right. reloader it broken. Please try the latest version I posted. I dicthed reloader but we may have some side effects.

[Massimo Di Pierro]

right we should not be able to edit those. Will fix.

[Massimo Di Pierro]

db.commit() is missing. fixing it later today.

[黄祥]

in latest commit (116) 

for reload fixed:

- edit, add and delete function on controllers take effects after hit reload button

- route for <my_app> is refreshed after hit reload button (last reported dissapear in some webapp)

btw, the button said 'Reaload Apps' is it intention or correct one is 'Reload Apps' typo problem no error occured

for recent tickets fixed:

- deleted recent tickets not shown after refresh the http://localhost:8000/_dashboard

but some is not fixed yet :

- still can edit and add new error ticket

- after hit reload button the error appears again

best regards,

stifan

[John Bannister]

Hi All,

Finally gotten round to playing again on the latest Web3py.

On _scaffold app .. if I add new tables to model file and then reload from the dashboard .. I get errors as follows:-

File "C:\Users\johhb\py3\lib\site-packages\pydal\base.py", line 581, in define_table
    raise SyntaxError('table already defined: %s' % tablename)
  File "<string>", line None
SyntaxError: table already defined: auth_user_tag_groups

Only way around it seems to be to delete contents of database folder and restart.

Dashboard app hangs on reload sometimes (I think it has to do the with same issue above) and only way to get round it is to restart the server and refresh the _dashboard app.

I really want to start using it to create a few new apps I am due to start working on shortly even though I am well aware that it is not yet production ready so will keep testing and assist wherever I can. Thanks again for all the hard work put in so far I am sure its gonna be a really cool solution.

Best Regards

John

On Thursday, 16 May 2019 17:15:44 UTC+2, John Bannister wrote:

Hi All,

Had a first real 'play' with web3py' today and have a few questions the biggest of which I am hoping the gurus will be able to answer:-

1: Is there any way to not to have to restart the app every time changes are made to actions in the controller or new actions added etc? I understand that controllers are basically being imported when the app fires up but is any there any way to occasionally reload instead of having to restart the app? This is a fairly big one for me as sometimes tweaks will need to be made in production and restarting the web server is not really an option so hopefully I am missing something really simple.

Thanks in advance

John

 

[黄祥]

face same error too on mac python3.7

steps

./web3py-start -p password.txt -a 0.0.0.0:8000 apps
cat << EOF >> apps/_scaffold/models.py
db.define_table('thing', Field('name') )
db.commit()
db.define_table('think', Field('name') )
db.commit()
EOF
open http://localhost:8000/_dashboard

error traceback on terminal (appears when 'reload apps' button hit)

[FAILED] loading _scaffold    

Traceback (most recent call last):

  File "/Users/sugizo/learn/python/web3py/web3py/core.py", line 614, in import_apps
    importlib.reload(sys.modules[name])
  File "/Users/sugizo/miniconda3/envs/python3_test/lib/python3.7/importlib/__init__.py", line 169, in reload
    _bootstrap._exec(spec, module)
  File "<frozen importlib._bootstrap>", line 630, in _exec
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/Users/sugizo/learn/python/web3py/apps/_scaffold/common.py", line 37, in <module>
    groups = Tags(db.auth_user, 'groups')
  File "/Users/sugizo/learn/python/web3py/web3py/utils/tags.py", line 14, in __init__
    Field('record_id', table))
  File "/Users/sugizo/miniconda3/envs/python3_test/lib/python3.7/site-packages/pydal/base.py", line 581, in define_table
    raise SyntaxError('table already defined: %s' % tablename)

  File "<string>", line None
SyntaxError: table already defined: auth_user_tag_groups

strange things, error traceback above not occured on _dashboard (recent tickets), no ticket id shown yet on terminal

after hit 'reload apps' sometimes stuck in gears animation not in previous _dashboard content (installed applications, recent tickets, system)

best regards,

stifan

[Massimo Di Pierro]

try a db.commit() after your define_table(s).

[黄祥]

try a db.commit() after your define_table(s).

 already tried, same result (tested on different os), reported on previous message in this thread

best regards,

stifan

[John Bannister]

I tried  both with and without. Same or very similar result. It is only complaining about the auth_user_tag table which is defined in the auth module.

--

Resources:
- http://web2py.com
- http://web2py.com/book (Documentation)
- http://github.com/web2py/web2py (Source code)
- https://code.google.com/p/web2py/issues/list (Report Issues)
---
You received this message because you are subscribed to the Google Groups "web2py-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to web2py+un...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/web2py/33476d6d-05dd-4452-a67b-e919b06d08b6%40googlegroups.com.

[Massimo Di Pierro]

please try delete everything in apps/_scaffold/databases/* I was not able to reproduce after I did that

To unsubscribe from this group and stop receiving emails from it, send an email to web2py+unsubscribe@googlegroups.com.