Being less Google dependent

29 views
Skip to first unread message

Cédric Krier

unread,
Aug 26, 2011, 7:36:54 PM8/26/11
to tryton
Hi,

With a recent mistake with the Google Account of Nicolas, it remembers me that
we are in some part of Tryton development process depending on Google
especially for codereview with the Google Account. And more over, there are
some rules on Google Account that could introduce difficulty like permanent
link with gmail account, overrule of XMPP by Talk (I'm personnaly affected by
those rules) etc.

So I had a quick look at the implemenation of the codereview of Python which
is running on django. They did a interesting work by merging user account
management between roundup and rietveld [1].
If we want to go this way there is some steps to do:

- migrate current roundup from sqlite to postgresql
- setup and link a codereview (on django) with roundup
- migrate existing codereview to the new one

The next thing for which we depend on Google is the wiki on google code. I
think we could move some part of it into the doc and others into a new wiki.
We could use moinmoin [2] for that. And let's seen if it is possible to merge
the authentication with roundup but that not a big requirement.

There is some external libs (like vatnumber) that are hosted on Google Code,
we could let them there or just get a hg directories for them and add
component to the roundup.

And finally, there will be still this mailing list. I think we should keep it
because it is not a strong link with Google Account and for me it is the best
compromise between mailing list and forum.

So I'm looking for some help to work on this migration. I think we will use a
repositories to store all the customizations of each softwares. So the
development could be distributed and I could provide some "annonymized data"
from the bugtracker and codereview.


PS: an other point to move out of Google App is that we have a lot of 500
error when uploading the patches. I think it is due to the fact that we are
using the free version and we don't have enought traffic to keep the instances
warm.

[1] http://svn.python.org/view/tracker/instances/python-dev/
[2] http://moinmo.in/

--
Cédric Krier

B2CK SPRL
Rue de Rotterdam, 4
4000 Liège
Belgium
Tel: +32 472 54 46 59
Email/Jabber: cedric...@b2ck.com
Website: http://www.b2ck.com/

Sasa Ostrouska

unread,
Aug 26, 2011, 10:02:53 PM8/26/11
to tryto...@googlegroups.com

Hi, just as a question, why don't you go with sourceforge.net ? They
have a trac service and also moinmoin
and other services. I think its worth a look.

Rgds
Saxa

Cédric Krier

unread,
Aug 27, 2011, 3:57:04 AM8/27/11
to tryto...@googlegroups.com
On 26/08/11 23:02 -0300, Sasa Ostrouska wrote:
> Hi, just as a question, why don't you go with sourceforge.net ?

First, it is the same issue: depending on external organisation/company.
I find it has more advertising than in google services :-)

> They
> have a trac service

trac doesn't fit our requirements because we have many repositories (with
series).

> and also moinmoin
> and other services. I think its worth a look.

Also I find sf.net really slow.

Cédric Krier

unread,
Aug 27, 2011, 6:33:12 AM8/27/11
to tryton
On 27/08/11 01:36 +0200, Cédric Krier wrote:
> Hi,
>
> With a recent mistake with the Google Account of Nicolas, it remembers me that
> we are in some part of Tryton development process depending on Google
> especially for codereview with the Google Account. And more over, there are
> some rules on Google Account that could introduce difficulty like permanent
> link with gmail account, overrule of XMPP by Talk (I'm personnaly affected by
> those rules) etc.
>
> So I had a quick look at the implemenation of the codereview of Python which
> is running on django. They did a interesting work by merging user account
> management between roundup and rietveld [1].
> If we want to go this way there is some steps to do:
>
> - migrate current roundup from sqlite to postgresql
> - setup and link a codereview (on django) with roundup
> - migrate existing codereview to the new one
>
> The next thing for which we depend on Google is the wiki on google code. I
> think we could move some part of it into the doc and others into a new wiki.
> We could use moinmoin [2] for that. And let's seen if it is possible to merge
> the authentication with roundup but that not a big requirement.
>
> There is some external libs (like vatnumber) that are hosted on Google Code,
> we could let them there or just get a hg directories for them and add
> component to the roundup.

I forgot Blogger. It should be removed when all the website will be migrated
to sphinx.

Douglas Morato

unread,
Aug 27, 2011, 12:17:15 PM8/27/11
to tryto...@googlegroups.com

So I had a quick look at the implemenation of the codereview of Python which
is running on django. They did a interesting work by merging user account
management between roundup and rietveld [1].
If we want to go this way there is some steps to do:
ReviewBoard [1] [2] seams interesting. Have you considered it ?

   - migrate current roundup from sqlite to postgresql
I think this is a great idea

   - setup and link a codereview (on django) with roundup
I also think this is a very good idea

   - migrate existing codereview to the new one
Does that include all past codereviews ? I think the old ones could be left on Rietveld and just bring the "Open" code reviews

We could use moinmoin [2] for that. And let's seen if it is possible to merge
the authentication with roundup but that not a big requirement.

Moinmoin looks good, specially when a good theme is applied, like the ubuntu wiki [3] and mercurial wiki [4]


And finally, there will be still this mailing list. I think we should keep it
because it is not a strong link with Google Account and for me it is the best
compromise between mailing list and forum.
I think the benefits of the Google mailing list outnumber any disadvantages 

So I'm looking for some help to work on this migration. I think we will use a
repositories to store all the customizations of each softwares. So the
development could be distributed and I could provide some "annonymized data"
from the bugtracker and codereview.
I would love to help, just tell me how could I assist

Cédric Krier

unread,
Aug 27, 2011, 12:55:47 PM8/27/11
to tryto...@googlegroups.com
On 27/08/11 12:17 -0400, Douglas Morato wrote:
>
> > So I had a quick look at the implemenation of the codereview of Python which
> > is running on django. They did a interesting work by merging user account
> > management between roundup and rietveld [1].
> > If we want to go this way there is some steps to do:
> ReviewBoard [1] [2] seams interesting. Have you considered it ?

Not really but I find rietveld good for our needs.
And I would like to keep the history of reviews.

> > - migrate current roundup from sqlite to postgresql
> I think this is a great idea
> > - setup and link a codereview (on django) with roundup
> I also think this is a very good idea
> > - migrate existing codereview to the new one
> Does that include all past codereviews ? I think the old ones could be left on Rietveld and just bring the "Open" code reviews

We must try to keep itas it is possible to retrieve data from App Engine [1].

>
> > We could use moinmoin [2] for that. And let's seen if it is possible to merge
> > the authentication with roundup but that not a big requirement.
>
> Moinmoin looks good, specially when a good theme is applied, like the ubuntu wiki [3] and mercurial wiki [4]
>

> > So I'm looking for some help to work on this migration. I think we will use a
> > repositories to store all the customizations of each softwares. So the
> > development could be distributed and I could provide some "annonymized data"
> > from the bugtracker and codereview.
> I would love to help, just tell me how could I assist

So the first step is to have a script to convert a roundup sqlite database
into a postgresql. Perhaps there is already existing script if so it needs to be
tested. I can give you a database dump (user password are crypted with SHA :-)


[1]
https://code.google.com/appengine/docs/python/tools/uploadingdata.html#Downloading_Data_from_App_Engine

Sasa Ostrouska

unread,
Aug 27, 2011, 3:22:15 PM8/27/11
to tryto...@googlegroups.com
On Sat, Aug 27, 2011 at 4:57 AM, Cédric Krier <cedric...@b2ck.com> wrote:
> On 26/08/11 23:02 -0300, Sasa Ostrouska wrote:
>> Hi, just as a question, why don't you go with sourceforge.net ?
>
> First, it is the same issue: depending on external organisation/company.
> I find it has more advertising than in google services :-)
>
In that case of course the best solution is to do all "at home".

>> They
>> have a trac service
>
> trac doesn't fit our requirements because we have many repositories (with
> series).
>

Didn't knew that.

>> and also moinmoin
>> and other services. I think its worth a look.
>
> Also I find sf.net really slow.
>

I agree , sf.net really is slow, especially if you have a lot of files.

Rgds
Saxa

Gustavo Andres Angulo

unread,
Aug 27, 2011, 3:51:45 PM8/27/11
to tryto...@googlegroups.com
Hi,

> On 27/08/11 01:36 +0200, Cédric Krier wrote:
> > Hi,
> >
> > With a recent mistake with the Google Account of Nicolas, it remembers me that
> > we are in some part of Tryton development process depending on Google
> > especially for codereview with the Google Account. And more over, there are
> > some rules on Google Account that could introduce difficulty like permanent
> > link with gmail account, overrule of XMPP by Talk (I'm personnaly affected by
> > those rules) etc.
> >
> > So I had a quick look at the implemenation of the codereview of Python which
> > is running on django. They did a interesting work by merging user account
> > management between roundup and rietveld [1].
> > If we want to go this way there is some steps to do:
> >
> >     - migrate current roundup from sqlite to postgresql
> >     - setup and link a codereview (on django) with roundup
> >     - migrate existing codereview to the new one
> >
> > The next thing for which we depend on Google is the wiki on google code. I
> > think we could move some part of it into the doc and others into a new wiki.
> > We could use moinmoin [2] for that. And let's seen if it is possible to merge
> > the authentication with roundup but that not a big requirement.
> >

I could help migrate the information from google to moinmoin, or maybe I could
help with the installation,

> > There is some external libs (like vatnumber) that are hosted on Google Code,
> > we could let them there or just get a hg directories for them and add
> > component to the roundup.

We can use Indefero [3] is something like google code, and supports Mercurial,
and Git, tickets for project and issues. Could use code.tryton.org or something
like that.

[3] http://www.indefero.net/open-source/


>
> I forgot Blogger. It should be removed when all the website will be migrated
> to sphinx.
>

> > And finally, there will be still this mailing list. I think we should keep it
> > because it is not a strong link with Google Account and for me it is the best
> > compromise between mailing list and forum.
> >

> > So I'm looking for some help to work on this migration. I think we will use a
> > repositories to store all the customizations of each softwares. So the
> > development could be distributed and I could provide some "annonymized data"
> > from the bugtracker and codereview.
> >

I help in this migration, I think the best to have our own platform without
using googlecode, sourceforge or other third party application.

> >
> > PS: an other point to move out of Google App is that we have a lot of 500
> > error when uploading the patches. I think it is due to the fact that we are
> > using the free version and we don't have enought traffic to keep the instances
> > warm.
> >
> > [1] http://svn.python.org/view/tracker/instances/python-dev/
> > [2] http://moinmo.in/
> >

regards.

signature.asc

Cédric Krier

unread,
Aug 27, 2011, 8:59:21 PM8/27/11
to tryto...@googlegroups.com
On 27/08/11 14:51 -0500, Gustavo Andres Angulo wrote:
> Hi,
> > On 27/08/11 01:36 +0200, Cédric Krier wrote:
> > > Hi,
> > >
> > > With a recent mistake with the Google Account of Nicolas, it remembers me that
> > > we are in some part of Tryton development process depending on Google
> > > especially for codereview with the Google Account. And more over, there are
> > > some rules on Google Account that could introduce difficulty like permanent
> > > link with gmail account, overrule of XMPP by Talk (I'm personnaly affected by
> > > those rules) etc.
> > >
> > > So I had a quick look at the implemenation of the codereview of Python which
> > > is running on django. They did a interesting work by merging user account
> > > management between roundup and rietveld [1].
> > > If we want to go this way there is some steps to do:
> > >
> > >     - migrate current roundup from sqlite to postgresql
> > >     - setup and link a codereview (on django) with roundup
> > >     - migrate existing codereview to the new one
> > >
> > > The next thing for which we depend on Google is the wiki on google code. I
> > > think we could move some part of it into the doc and others into a new wiki.
> > > We could use moinmoin [2] for that. And let's seen if it is possible to merge
> > > the authentication with roundup but that not a big requirement.
> > >
>
> I could help migrate the information from google to moinmoin, or maybe I could
> help with the installation,

I'm not sure if moinmoin is the right tool.
I would prefer a kind of wiki that could be used by delivering static pages.

> > > There is some external libs (like vatnumber) that are hosted on Google Code,
> > > we could let them there or just get a hg directories for them and add
> > > component to the roundup.
>
> We can use Indefero [3] is something like google code, and supports Mercurial,
> and Git, tickets for project and issues. Could use code.tryton.org or something
> like that.

I don't think we need such tools. The libs are pretty simple and I think they
can be managed in the same bugtracker because after all Tryton is the main
usage of those libs.

> > I forgot Blogger. It should be removed when all the website will be migrated
> > to sphinx.
> >
> > > And finally, there will be still this mailing list. I think we should keep it
> > > because it is not a strong link with Google Account and for me it is the best
> > > compromise between mailing list and forum.
> > >
> > > So I'm looking for some help to work on this migration. I think we will use a
> > > repositories to store all the customizations of each softwares. So the
> > > development could be distributed and I could provide some "annonymized data"
> > > from the bugtracker and codereview.
> > >
>
> I help in this migration, I think the best to have our own platform without
> using googlecode, sourceforge or other third party application.

Let's see if we find a better tool than moinmoin.

Gustavo Andres Angulo

unread,
Aug 27, 2011, 9:35:03 PM8/27/11
to tryto...@googlegroups.com


moinmoin has the possibility of all site dump to static pages with
moinmoin-dump [1]
that could be a possible way

[1] http://moinmo.in/MoinDump

>> > > There is some external libs (like vatnumber) that are hosted on Google Code,
>> > > we could let them there or just get a hg directories for them and add
>> > > component to the roundup.
>>
>> We can use Indefero [3] is something like google code, and supports Mercurial,
>> and Git, tickets for project and issues. Could use code.tryton.org or something
>> like that.
>
> I don't think we need such tools. The libs are pretty simple and I think they
> can be managed in the same bugtracker because after all Tryton is the main
> usage of those libs.
>

Maybe only for projects like vatnumber, in replace for google-code.

Cédric Krier

unread,
Sep 2, 2011, 4:14:21 AM9/2/11
to tryton
On 27/08/11 01:36 +0200, Cédric Krier wrote:
> So I had a quick look at the implemenation of the codereview of Python which
> is running on django. They did a interesting work by merging user account
> management between roundup and rietveld [1].

One more reason to go out of AppEngine [1] as the free quotas have been
lowered.

[1] http://www.google.com/enterprise/cloud/appengine/pricing.html

Jan Grasnick | grasbauer ug

unread,
Sep 2, 2011, 4:37:56 AM9/2/11
to tryto...@googlegroups.com
Am 02.09.2011 10:14, schrieb Cédric Krier:
> On 27/08/11 01:36 +0200, Cédric Krier wrote:
>> So I had a quick look at the implemenation of the codereview of Python which
>> is running on django. They did a interesting work by merging user account
>> management between roundup and rietveld [1].
> One more reason to go out of AppEngine [1] as the free quotas have been
> lowered.
>
> [1] http://www.google.com/enterprise/cloud/appengine/pricing.html
>

1+++ to stay without the omnipotence of google
If i can help with something, feel free to ask.

One suggestion to all the community:
It would be nice to have a central place for all the local communities.
For example the german community is placed at origo. For me it seems
more practical for a global knowledge management to have one forum for
all the languages. A good example is http://isp-control.net/ - i always
have found a solution for a problem anywhere at this page.

Jan (hoRn)

Cédric Krier

unread,
Sep 30, 2011, 3:48:22 PM9/30/11
to tryto...@googlegroups.com
On 27/08/11 18:55 +0200, Cédric Krier wrote:
> On 27/08/11 12:17 -0400, Douglas Morato wrote:
> > > So I'm looking for some help to work on this migration. I think we will use a
> > > repositories to store all the customizations of each softwares. So the
> > > development could be distributed and I could provide some "annonymized data"
> > > from the bugtracker and codereview.
> > I would love to help, just tell me how could I assist
>
> So the first step is to have a script to convert a roundup sqlite database
> into a postgresql. Perhaps there is already existing script if so it needs to be
> tested. I can give you a database dump (user password are crypted with SHA :-)

Have you done any progress on this topic?

Cédric Krier

unread,
Oct 9, 2011, 2:36:25 AM10/9/11
to tryto...@googlegroups.com
On 30/09/11 21:48 +0200, Cédric Krier wrote:
> On 27/08/11 18:55 +0200, Cédric Krier wrote:
> > On 27/08/11 12:17 -0400, Douglas Morato wrote:
> > > > So I'm looking for some help to work on this migration. I think we will use a
> > > > repositories to store all the customizations of each softwares. So the
> > > > development could be distributed and I could provide some "annonymized data"
> > > > from the bugtracker and codereview.
> > > I would love to help, just tell me how could I assist
> >
> > So the first step is to have a script to convert a roundup sqlite database
> > into a postgresql. Perhaps there is already existing script if so it needs to be
> > tested. I can give you a database dump (user password are crypted with SHA :-)
>
> Have you done any progress on this topic?

I check it. I think I could write a script that fill the PostgreSQL database
with the SQLite data.

By the way, I will try to make it generic like that it could be used to
migrate Tryton database also.

Cédric Krier

unread,
Oct 9, 2011, 9:23:33 AM10/9/11
to tryto...@googlegroups.com
On 09/10/11 08:36 +0200, Cédric Krier wrote:
> On 30/09/11 21:48 +0200, Cédric Krier wrote:
> > On 27/08/11 18:55 +0200, Cédric Krier wrote:
> > > On 27/08/11 12:17 -0400, Douglas Morato wrote:
> > > > > So I'm looking for some help to work on this migration. I think we will use a
> > > > > repositories to store all the customizations of each softwares. So the
> > > > > development could be distributed and I could provide some "annonymized data"
> > > > > from the bugtracker and codereview.
> > > > I would love to help, just tell me how could I assist
> > >
> > > So the first step is to have a script to convert a roundup sqlite database
> > > into a postgresql. Perhaps there is already existing script if so it needs to be
> > > tested. I can give you a database dump (user password are crypted with SHA :-)
> >
> > Have you done any progress on this topic?
>
> I check it. I think I could write a script that fill the PostgreSQL database
> with the SQLite data.

Here is my script.
It seems to work, I will make some more tests and if everything works I will
migrate roundup.

> By the way, I will try to make it generic like that it could be used to
> migrate Tryton database also.

There is some hack in the script that are specific to roundup schema but the
basis should work for Tryton database. I did not test it but if someone wants
to test it, I will appreciate feedback.

roundup_sqlite2pg.py

Cédric Krier

unread,
Oct 9, 2011, 10:23:08 AM10/9/11
to tryto...@googlegroups.com

I forgot to update the sequences.

roundup_sqlite2pg.py

Cédric Krier

unread,
Oct 9, 2011, 3:58:28 PM10/9/11
to tryto...@googlegroups.com

Done.

Cédric Krier

unread,
Oct 10, 2011, 2:28:24 PM10/10/11
to tryton
On 27/08/11 01:36 +0200, Cédric Krier wrote:
> Hi,
>
> With a recent mistake with the Google Account of Nicolas, it remembers me that
> we are in some part of Tryton development process depending on Google
> especially for codereview with the Google Account. And more over, there are
> some rules on Google Account that could introduce difficulty like permanent
> link with gmail account, overrule of XMPP by Talk (I'm personnaly affected by
> those rules) etc.
>
> So I had a quick look at the implemenation of the codereview of Python which
> is running on django. They did a interesting work by merging user account
> management between roundup and rietveld [1].
> If we want to go this way there is some steps to do:
>
> - migrate current roundup from sqlite to postgresql
> - setup and link a codereview (on django) with roundup
> - migrate existing codereview to the new one
>
> The next thing for which we depend on Google is the wiki on google code. I
> think we could move some part of it into the doc and others into a new wiki.
> We could use moinmoin [2] for that. And let's seen if it is possible to merge
> the authentication with roundup but that not a big requirement.

I create a global issue to link all those tasks and follow the progress on
roundup.

https://bugs.tryton.org/issue2177

Cédric Krier

unread,
Nov 29, 2011, 7:19:45 PM11/29/11
to tryton
On 02/09/11 10:14 +0200, Cédric Krier wrote:
> On 27/08/11 01:36 +0200, Cédric Krier wrote:
> > So I had a quick look at the implemenation of the codereview of Python which
> > is running on django. They did a interesting work by merging user account
> > management between roundup and rietveld [1].
>
> One more reason to go out of AppEngine [1] as the free quotas have been
> lowered.

I succeed to download the data from GAE. But now it is stored in a
sqlite database with a Blob per objects.
So it is needed to write an exporter for each objects like explain here
[1].


[1]
https://code.google.com/appengine/docs/python/tools/uploadingdata.html

Reply all
Reply to author
Forward
0 new messages