[Mail list Bots EDI software] Release Candidate for bots 2.0 is out

[hjeb...@gmail.com]

I released bots 2.0.RC (release candidate).

Main reason for having this as a release candidate is to get feedback:
existing configurations should work.

To migrate existing configurations: make a configuration plugin of your
existing configuration.
Read the configuration plugin in bots 2.0
(as a lot has changed in the database, there is no direct database
conversion).

Existing plugins can be read and work.
(there is a glitch however: 1.5.* plugins have an index file where the
name is equal to the name of the plugin.
Change this name to botsindex.py and it works)

the windows installer includes all depencies.
Dependencies for *nix:
- django > 1.1.0
- cherrypy > 3.1.0
- kid (only for html-templates)
- SQLalchemy (only for direct database communication)
There might be conflicts in the libraries, s bots 1* used cherrypy 2.*;
bots 2.0.RC uses cherrypy > 3.1

Changes:

*

Use Django instead of Turbogears.

o

Django is much better supported (linux repositories) than
TurboGears.

o

Bots code base is reduced; eg by using Django admin interface.

o

More options for users and user rights. To change the
configuration, user has to have 'staff status'. For system
tasks user needs 'superuser' status. More fine-grained
options are available; this is default djanog-stuff; I did
not test this.

o

Using django 'settings' file for configuration. This is
simpler than TurboGears configuration. The connection
parameters for the database are quite different; good
examples are provided in config/setting.py of the installer.

*

Changes in bots.ini:

o

the local port where bots is served is added, default this
is still 8080

*

Command-line utilities have gone to menu: bots-plugout, bots-unlockdb.

*

Windows: no *.exe files for bots-webserver and bots-engine; so
startup as eg c:\python26\python bots-webserver.py

*

startup parameters of bots-engine:

o

changed: default is now '--new'.

o

added: 'Retry of Last run' (when database is locked).

*

newer version of pysqlite is needed. Windows: OK, in bots
installer; linux: OK for python2.6; python 2.4 and 2.5: install
newer version of pysqlite.

*

Error reports use Django-machinery now. The error-report plugin is
not longer needed. Also error-reports can be tested using GUI-menu.

*

Less dependencies (eg setuptools not longer needed.)

*

Archives now have subdirectories per day.

*

Improved the 'database lock' handling. However, this can still
occur in case of crashes. There is now a possibility to retry the
last run: bots-engine will try to finish the last run.

*

Internationalisation: translations can be made for Bots. Only
translation provided for now is Dutch.

*

Performance: Django is faster than TurboGears, so the GUI is much
'snappier'.

*

Interface:

o

Of course a lot of 'layout' changes.

o

New 'document' screen. Purpose of this screen:

+

Show document numbers eg order number: key to the ERP
system

+

Display acknowledgement status

o

More cross-links: eg jump for outgoing screen to detail screen.

o

Added 'show all' menu without having to go through the
selection screen.

o

Selections are kept between eg incoming and outgoing screens.

o

Sorting not only work for the items on a screen, but for all
items (in the database).

o

Configuration screens:

+

more text that explains.

+

often a description/notes can be given for eg a route.

+

Eg when starting a new route, the communication
channel can be made in a pop-up screen. This is a more
'natural' way of working. This feature is used in a
lot of configuration screen.

+

Improvements in file-viewer. Eg conformation status
can be seen.

+

less-used options are hidden/folded.

*

What has not changed ;-): the most important stuff:

o

mappings, grammars, user scripts can be used unchanged.

o

existing plugins all work; sometimes a file rename is needed
for plugins < 1.6.0

o

edi file handling, mapping, communication modules etc are
not changed.

o

directory layout is very much the same.


kind regards,
henk-jan

[Mellerbeck]

Sounds awesome!

[Claudiu A. Secara]

Hi Henk-Jen,

 

I am sorry to have to ask you, but trying to run the new release, I am getting this message: “Setup program invalid or damaged.”

 

I am using the same configuration bots-2.0.RC.win32-py2.6 as before

 

By the way, does it work with Python 3.1.2 ?

 

Claudio

 

 

Algora Publishing

Tel: (212) 678-0232

Fax: (212) 666-3682

www.algora.com

cla...@algora.com

[henk-jan ebbers]

Claudiu A. Secara wrote:
>
> Hi Henk-Jen,
>
> I am sorry to have to ask you, but trying to run the new release, I am

> getting this message: �Setup program invalid or damaged.�

>
> I am using the same configuration bots-2.0.RC.win32-py2.6 as before
>
> By the way, does it work with Python 3.1.2 ?
>

hi claudio,
no. this is for python2.6
(I never tried this with python >3; python 3.0 is quite different.
bots libraries are not on this version, as are a lot of python stuff)

henk-jan
>
> Claudio

[Claudiu A. Secara]

Unfortunately, when I tried to run the setup I am still getting the same
error message: "Setup program invalid or damaged."

Claudiu

Algora Publishing
Tel: (212) 678-0232
Fax: (212) 666-3682
www.algora.com
cla...@algora.com


-----Original Message-----
From: henk-jan ebbers [mailto:hjeb...@gmail.com]
Sent: Friday, May 21, 2010 2:40 PM
To: bots...@googlegroups.com
Subject: Re: [Mail list Bots EDI software] Release Candidate for bots 2.0 is
out

Claudiu A. Secara wrote:
>
> Hi Henk-Jen,
>
> I am sorry to have to ask you, but trying to run the new release, I am

> getting this message: "Setup program invalid or damaged."

[henk-jan ebbers]

Hi Claudio,

yes, you are right.
something must have gone wrong uploading the installer.
I uploaded again, should be OK now.

Thanks,
henk-jan

[Claudiu A. Secara]

Hi Henk-Jan,

 

We still have some kind of problem here. Now, I can install 2.0 but when I try to run bots-webserver.exe it briefly runs and then it goes away. I tried to print the screen (see below) and it seems that it stops at the line AttributeError: Tree instance has no attribute “graft”.

 

Could you kindly look into it?

 

Thank you,

Claudio

 

[henk-jan ebbers]

hi Claudio,

this happens when cherrypy 2.* is used.

bots 2.* needs cherrypy 3.*; it did install cherrypy 3.*.
but somehow cherrypy 2.* takes precedence over cherrypy 3.*

big danger here is that bots 1.* uses cherrypy 2.*.
(I guess you do want to keep bots 1.* running).
I usually solve this by doing some renaming in c:\python26\Lib\site-packages
(but mind&remember what you do, as you want to be able to 'undo' this)

kind regards,

henk-jan


Claudiu A. Secara wrote:
>
> Hi Henk-Jan,
>
> We still have some kind of problem here. Now, I can install 2.0 but
> when I try to run bots-webserver.exe it briefly runs and then it goes
> away. I tried to print the screen (see below) and it seems that it

> stops at the line AttributeError: Tree instance has no attribute �graft�.

>
> Could you kindly look into it?
>
> Thank you,
>
> Claudio
>

[Claudiu A. Secara]

Hi Henk-Jan,

I did a fully clean reinstallation of Python 2.6.5 and Bots. All were
installed successfully. This way I got rid of the cherry2, but Scripts has
only a few entries:

1. postinstallation
2. django-admin
3. cherry
4. bots-webserver
5. bots-engine



Worse, when I run bots-webserver.py I now have a blank screen, but the only
command http://localhost:8080/home is now not executed.

Sorry for all the trouble, but I am afraid that I am the first one testing
the new system and there might be further snags or some missing elements
that might need your attention.

Thank you,

> stops at the line AttributeError: Tree instance has no attribute "graft".

[henk-jan ebbers]

Hai Claudio,

Claudiu A. Secara wrote:
> Hi Henk-Jan,
>

> I did a fully clean reinstallation of Python 2.6.5 and Bots. All were
> installed successfully. This way I got rid of the cherry2, but Scripts has
> only a few entries:
>
> 1. postinstallation
> 2. django-admin
> 3. cherry
> 4. bots-webserver
> 5. bots-engine
>

6that is what I expect.

>
>
> Worse, when I run bots-webserver.py I now have a blank screen, but the only
>

yes, that is right.

> command http://localhost:8080/home is now not executed.
>

I will check on this.

henk-jan

[henk-jan ebbers]

Hai Claudio,

did a clean install, installed bots.
when running bots-webserver (either from shortcut in 'programs' or from
Script-directory as c:\python26\python bots-webserver.py)
I get a login page at http://localhost:8080/home

(I use windowsXP)

can you see what is in bots/botssys/logging?


henk-jan

(thank you for you patience)

[BikeMike]

Hi Henk-jan,
Having trouble loading plugins...

If I try loading my config from 1.6 i just get a connection reset page
after a few seconds.
The connection was reset
The connection to the server was reset while the page was loading.
(yes I renamed myplugin.py to botsindex.py)

If I save the config plugin from 2.0 then try to reload it, I get...
Traceback (most recent call last):
File "Z:\Python26\lib\site-packages\cherrypy\wsgiserver
\__init__.py", line 1174, in communicate
req.respond()
File "Z:\Python26\lib\site-packages\cherrypy\wsgiserver
\__init__.py", line 544, in respond
self._respond()
File "Z:\Python26\lib\site-packages\cherrypy\wsgiserver
\__init__.py", line 556, in _respond
response = self.wsgi_app(self.environ, self.start_response)
File "Z:\Python26\lib\site-packages\cherrypy\_cptree.py", line 239,
in __call__
return app(environ, start_response)
File "Z:\Python26\lib\site-packages\django\core\servers
\basehttp.py", line 651, in __call__
return self.application(environ, start_response)
File "Z:\Python26\lib\site-packages\django\core\handlers\wsgi.py",
line 241, in __call__
response = self.get_response(request)
File "Z:\Python26\lib\site-packages\django\core\handlers\base.py",
line 134, in get_response
return self.handle_uncaught_exception(request, resolver, exc_info)
File "Z:\Python26\lib\site-packages\django\core\handlers\base.py",
line 166, in handle_uncaught_exception
return callback(request, **param_dict)
File "Z:\Python26\lib\site-packages\django\views\defaults.py", line
23, in server_error
t = loader.get_template(template_name) # You need to create a
500.html template.
File "Z:\Python26\lib\site-packages\django\template\loader.py", line
81, in get_template
source, origin = find_template_source(template_name)
File "Z:\Python26\lib\site-packages\django\template\loader.py", line
74, in find_template_source
raise TemplateDoesNotExist, name
TemplateDoesNotExist: 500.html

Kind Regards,
Mike

[BikeMike]

Is python 2.6 a requirement?

I have 2.5 and had previously tested bots 2.0 a few weeks back so
perhaps there's some version conflict?

[henk-jan ebbers]

hi Mike,

thanks for having a look.
is it possible to set in bots.ini:
environment = development

this shoudl give a beter eeror.

kind regards,
henk-jan

[henk-jan ebbers]

only difference ids that a newer version of pysqlite is needed.
(python 2.5 contains an older version of pysqlite)

kind regards,
henk-jan

henk-jan

[BikeMike]

with development setting and loading 1.6 config...

OSError at /plugin

[Errno 2] No such file or directory: 'Z:\\Python26\\Lib\\site-packages\
\bots\\bots\\botssys/pluginsuploaded\\mbyw_s.upload'

Request Method: POST
Request URL: http://localhost:8080/plugin
Exception Type: OSError
Exception Value:

[Errno 2] No such file or directory: 'Z:\\Python26\\Lib\\site-packages\
\bots\\bots\\botssys/pluginsuploaded\\mbyw_s.upload'

Exception Location: Z:\Python26\lib\tempfile.py in _mkstemp_inner,
line 228
Python Executable: Z:\Python26\python.exe
Python Version: 2.6.5
Python Path: ['Z:\\Python26\\Lib\\site-packages\\bots', 'C:\\Windows\
\system32\\python26.zip', 'Z:\\Python26\\DLLs', 'Z:\\Python26\\lib',
'Z:\\Python26\\lib\\plat-win', 'Z:\\Python26\\lib\\lib-tk', 'Z:\
\Python26', 'Z:\\Python26\\lib\\site-packages']

Plus lots more I can post if you need it!
Off to sleep now anyway... will look at it more tomorrow.

I'm looking forward to eventually upgrading our production
environment, the new document screen will be a big help for us.

Kind regards,
Mike

[Claudiu A. Secara]

Hi Henk-Jan,

I have Windows Vista, and I had no problem running any of the previous
versions of Python or Bots.

Here is what I am getting in webserver.log:

Bots web server started.
Python version: "2.6.5 (r265:79096, Mar 19 2010, 21:48:26) [MSC v.1500 32
bit (Intel)]".
Django version: "(1, 1, 1, 'final', 0)".

Claudiu

[henk-jan ebbers]

Hi Mike,

this points in the direction of an older setting for temporary file for
plugins.
(either in setting.py or botsinit.py)
but I changed that as I used other logic for this.

might this be interference with older code?

henk-jan

[BikeMike]

It could be... I will test a clean install in a new folder when I get
time.

[Claudiu A. Secara]

Hi Henk-Jan,

Not much luck. I spent 4 days and tried everything that I thought of. I
uninstalled everything Python 2.5, and Bots 1.3.4, 1.6.3, etc.

I even installed it on another computer (Windows 7) and it worked on that
computer, but I need to make it work on this computer Windows Vista.

What info would help you debug it?

Thanks,

[BikeMike]

Hi Henk-jan,
I did a clean install of python 2.6 then Bots 2.0 and it all seems ok
now. I have imported my test configurations from 1.6 ok.

Only problem I noticed so far is my modified charset (UNOA extended
with a couple of changes) was not imported, so I copied it manually.
In fact the alternate charsets sub-folder is missing in Bots 2.0.

Processed a batch of assorted files and it all looks good. :-) I
haven't checked all my user scripts yet though.

My production environment is still Bots 1.5.4. How will the
configuration go importing from that? I guess now I really need to set
up a comprehensive test suite of all the files we process so I can do
a full test, checking user scripts etc.

Regarding Botskey values, can these be set by queries in the grammars?

Kind regards,
Mike

[henk-jan ebbers]

BikeMike wrote:
> Hi Henk-jan,
> I did a clean install of python 2.6 then Bots 2.0 and it all seems ok
> now. I have imported my test configurations from 1.6 ok.
>
> Only problem I noticed so far is my modified charset (UNOA extended
> with a couple of changes) was not imported, so I copied it manually.
> In fact the alternate charsets sub-folder is missing in Bots 2.0.
>

I will update that!
I dropped the alternate charsets in 1.6*
this stuff is on the website now.
(but nothing has chanded)

> Processed a batch of assorted files and it all looks good. :-) I
> haven't checked all my user scripts yet though.
>
> My production environment is still Bots 1.5.4. How will the
> configuration go importing from that? I guess now I really need to set
> up a comprehensive test suite of all the files we process so I can do
> a full test, checking user scripts etc.
>

in bots 1.5* there is a command-line utility called bots-plugout.
(but you do have to rename the index-fiel name in the plugin.

> Regarding Botskey values, can these be set by queries in the grammars?
>

yes.
> Kind regards,
> Mike
>
>

[BikeMike]

I notice the filter dropdown on codelists screen... I like that.

Just a general comment on the screen layouts (and probably you are
just using django defaults) but there seem to be a lot of different
styled controls rather than one cohesive "look and feel". It just sort
of makes the interface look a bit of a patchwork. Also I would prefer
those controls that get positioned to the far right not to be, as they
are so far away from everything else (I usually have my browser full
screen).

Regarding confirm rules, I have not looked at this before... I would
like to configure EDIFACT CONTRL documents but that is not an option
in the dropdown list. Would this be a possibility? I know I could
probably do it with a chained translation.

[henk-jan ebbers]

BikeMike wrote:
> I notice the filter dropdown on codelists screen... I like that.
>
> Just a general comment on the screen layouts (and probably you are
> just using django defaults) but there seem to be a lot of different
> styled controls rather than one cohesive "look and feel". It just sort
> of makes the interface look a bit of a patchwork. Also I would prefer
> those controls that get positioned to the far right not to be, as they
> are so far away from everything else (I usually have my browser full
> screen).
>

I wiil check that.

> Regarding confirm rules, I have not looked at this before... I would
> like to configure EDIFACT CONTRL documents but that is not an option
> in the dropdown list. Would this be a possibility? I know I could
> probably do it with a chained translation.
>

yes, would be relatively easy....easier.
I did not bould in in because CONTRL is not used that much over here...
997 in X12 is used a lot....

henk-jan

[henk-jan ebbers]

BikeMike wrote:
> I notice the filter dropdown on codelists screen... I like that.
>
> Just a general comment on the screen layouts (and probably you are
> just using django defaults) but there seem to be a lot of different
> styled controls rather than one cohesive "look and feel". It just sort
> of makes the interface look a bit of a patchwork.

yes, it does.
the configuration screens are default django stuff
the 'view' screens are indeed different.

.

> Also I would prefer
> those controls that get positioned to the far right not to be, as they
> are so far away from everything else (I usually have my browser full
> screen).
>

what screens do you have in mind?

henk-jan

[BikeMike]

> what screens do you have in mind?

For example, the "Routes" screen...
The Action dropdown is a standard looking control, with a standard Go
button next to it. Then the filter dropdown is a nice shaded menu (but
different to the menu-bar menus). Then the Add button is a rounded end
dark button that changes colour. Both the filter and add buttons are
right across on the right of screen.

I think (though not sure how easy it is to do) that Action, Go, Filter
and Add controls should all be next to each other and all in the same
style.

The various maintenance screens are similar, for example "Change
Route" has...
History button (rounded button, top right)
Delete (red X and text no actual button, bottom left)
Save as new, save and continue editing, standard looking buttons,
bottom right.
Save, a blue button with white text.

I think all these buttons should be grouped together in one location,
and the same style. Also it's a bit confusing having 3 different save
buttons, I don't understand the need for this.

Please don't take this as criticism of Bots, it is still perfectly
functional, but I think a consistent and clean looking user interface
is important too.

Kind regards,
Mike

[henk-jan ebbers]

Hi Mike,

yes, this is dreadful....
I worked on changing this, but ran into editing a lot of stuff.....
(this is the reason development of bots 2.0 took much more time than I
expected).
a lot can be changed in the default django interface, but this 'look and
feel' is not easy to change.
(change forms, html, css, javascript is interacting....)

So I decided to 'just' use the admin interface as a given thing.

henk-jan

[BikeMike]

On May 26, 8:13 pm, henk-jan ebbers <hjebb...@gmail.com> wrote:
> So I decided to 'just' use the admin interface as a given thing.

That's ok, as I said it would be nice to make it all consistent, but
it works as-is.

I have another problem... Timezone. It looks like all reported times
are UTC. I remember Bots 1.x was originally like this and was fixed,
but can't remember what we did exactly, can we make this local time
somehow in Bots 2.0?

Kind Regards,
Mike

[henk-jan ebbers]

I will add this trigger in the sqlite dtabase.

henk-jan

[BikeMike]

Ah yes, "trigger" was the reminder I needed!

I added...
CREATE TRIGGER uselocaltime AFTER INSERT ON ta
BEGIN
UPDATE ta SET ts = datetime('now','localtime')
WHERE idta = new.idta ;
END

and it works now. Thankyou.

[henk-jan ebbers]

that was a good trigger ;-)

[BikeMike]

Hi Henk-jan,
A small problem I just noticed...

I have some routes with multiple sequence numbered steps (10, 20, 30
etc).
The sequence numbers are not displayed in sequence... I can sort by
route, or sort by sequence, but can't sort by route then sequence.

Kind regards,
Mike

[BikeMike]

Also when adding a route, the dropdown lists for incoming and outgoing
channels are not sorted.

[henk-jan ebbers]

Hi Mike,

yes.
I can indicate the field that are used for the sorting...but the doc
says: only the first field is used, rest is ignored.
I really hate this, but for the moment....

henk-jan

[henk-jan ebbers]

I'll check that out.

kind regards,
henk-jan