OpenXdata developer infrastructure

[Jørn Klungsøyr]

Dear all,

 

The developer infrastructure of OpenXdata is hosted as range of virtual servers running at the University of Bergen.

It has served us well so far, but it is time to make the move to some other hosted/cloud solution for the core development services and tools (trac/svn/nexus/Jenkins/+++).  My personal reason for wanting a switch is to reduce our maintenance cost/time on the core infrastructure and rather focus on development and new ideas!

 

Ideally I would prefer that we “outsource” as much as possible of the current infrastructure.
We can also consider other alternatives for the website and documentation as well as demo servers.
The servers at UiB will be available for as long as they are needed.

 

One option is that we apply to get free “open source” hosting through Atlassian and use Jira/Bamboo/Bitbucket/Confluence etc.

https://www.atlassian.com/software/views/open-source-license-request

 

Please way in with your suggestions on what solutions/approaches we can use.

 

Have a great weekend!

Best

Jørn

 

__________________________________________________________
Jørn Klungsøyr – www.zegeba.com - mobile: +4791365731, chat: jornklung
--------------------

 

[Shashank Garg]

Hi Jørn,

It would be a good idea to out-source hosting to a free provider. We could also consider Source Forge. Does GitHub charge for open source projects? GitHub could be an excellent repo.

Best regards,

Shashank

--
You received this message because you are subscribed to the Google Groups "openXdata Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to openxdata-de...@googlegroups.com.
To post to this group, send email to openxd...@googlegroups.com.
Visit this group at http://groups.google.com/group/openxdata-dev.
For more options, visit https://groups.google.com/d/optout.

[Jørn Klungsøyr]

Hi Shashank,

 

Thanx for the input!

 

GitHub is a great tool.

SourceForge feels disorganized and overloaded with ads.

GoogleCode is also an alternative.

 

Do you know if they have cloud offering for build servers for open source projects?

One option could be: https://travis-ci.org/ - but I’ve never tried it.

 

The key things we need to find a cloud replacement for to is:

a)      Source code repository (currently subversion)

b)      Issue/ticket handling (currently trac)

c)       Build server (currently Jenkins)

d)      Dependency/Maven repository (currently Nexus)

 

 

Best

Jørn

 

__________________________________________________________
Jørn Klungsøyr – www.zegeba.com - mobile: +4791365731, chat: jornklung
--------------------

 

[Shashank Garg]

Hi Jørn,

Yes, Google Code could be a good alternative. Redmine is another tool that integrates source code control, issue / ticket management, wiki, calendar, documents, GANTT etc. Repository management interface of Redmine provides access to code repositories through SVN and Git.

Bitnami offers a free cloud VM solution with Redmine and Jenkins built-in. Redmine provides unified interface to multiple source code control systems like SVN, Git etc. Redmine also has trac like functionality for ticket handling. It also has a bolg and wiki built-in.

In fact, we are using the Bitnami Redmine VM on our intranet quite successfully. It is also available for cloud based hosting. Here's a link to Bitnami in the cloud: https://bitnami.com/cloud. 

However, in the cloud the Bitnami VM runs on top of Amazon AWS and that is usually not free. 

If some free virtual private server could be found, then setting up different VMs will not be a problem. The cheapest cloud hosting service that we have found is Digital Ocean (https://www.digitalocean.com/). We are using this as a virtual private server for our production servers at half the cost of a GoDaddy VPS of the same configuration.

My fear is that since our build servers are likely to be quite large (8GB or more), we may not get free hosting that easily.

Best,

Shashank

[Dagmar Timler]

Thanks for bringing this up Jørn.

I think we should go with Github unless there is good reason not to. Bitbucket is also good, but it seems Github is now the standard. Github comes with a wiki and a issue tracking system. We should investigate if it's possible to migrate our existing trac over. There is also the Wordpress site with very valuable information. 

That would just leave the build server and nexus (sorry have no suggestions). I googled a bit quickly and found snap-ci which might be of interest. It would be interesting to see how dependent we are on Nexus. Are there a lot of 3rd party libraries that cannot be found elsewhere used for the build, or do we just use it to manage our releases?

Btw, the Atlassian link you sent regarding the open source license still requires that you have a server on which to install their software. I assume we are wanting to move away from hosting our own services?

Thanks

Dagmar

[Jørn Klungsøyr]

Hi again,

 

Redmine/Bitnami are great products and solutions, but they don’t solve my headache.

 

The issue is really not hosting vm’s (as we do that for free at Univ.ofBergen) but maintaining them and keeping them up to date as well as secured against attacks (which is a growing problem) and also keeping costs at a minimum.

 

My aim is to replace these vm’s  and their services with free cloud services for open source projects and thus reduce the number of vm’s we run/manage ourselves to a bare minimum (or none if possible).

 

Best,

[Jørn Klungsøyr]

Hi Dagmar,

 

Thanx for the inputs!

 

I’m fine with GitHub – does much the same as Bitbucket – though Jira++ has more features. GitHub is something inbetween BitBucket + Jira.  Both use git as underlying tech.

 

The link for Atlassian was for both hosted (OnDemand) and running on own infrastructure (Download).

And correct, I do not want to run Bitbucket/Jira/Bamboo or other systems own infrastructure.

 

Snap-CI looks good.

 

For Nexus I believe they “mirror” libraries that we depend on (as a backup) – other than that it is primarily our own stuff there.

 

Discovered that Sonatype provides free Nexus hosting for OSS projects:
https://oss.sonatype.org/#view-repositories

 

Maybe that could solve that part of the puzzle.

 

So maybe github + snap-ci + oss.sonatype could solve most things?

 

I suggest we focus on transforming the developer infrastructure first, and then the remainder e.g. wordpress/demo etc.

 

Jørn

 

__________________________________________________________
Jørn Klungsøyr – www.zegeba.com - mobile: +4791365731, chat: jornklung
--------------------

 

[Jørn Klungsøyr]

Interesting suggestions regarding trac-github here:

http://stackoverflow.com/questions/6671584/how-to-export-trac-to-github-issues

 

Jørn

 

__________________________________________________________
Jørn Klungsøyr – www.zegeba.com - mobile: +4791365731, chat: jornklung
--------------------

 

From: Jørn Klungsøyr [mailto:jorn.kl...@zegeba.com]
Sent: 29. september 2014 09:57
To: 'openxd...@googlegroups.com'
Subject: RE: [openXdata-dev] OpenXdata developer infrastructure

 

Hi Dagmar,

 

Thanx for the inputs!

 

I’m fine with GitHub – does much the same as Bitbucket – though Jira++ has more features. GitHub is something inbetween BitBucket + Jira.  Both use git as underlying tech.

 

The link for Atlassian was for both hosted (OnDemand) and running on own infrastructure (Download).

And correct, I do not want to run Bitbucket/Jira/Bamboo or other systems own infrastructure.

 

Snap-CI looks good.

 

For Nexus I believe they “mirror” libraries that we depend on (as a backup) – other than that it is primarily our own stuff there.

 

Discovered that Sonatype provides free Nexus hosting for OSS projects:
https://oss.sonatype.org/#view-repositories

 

Maybe that could solve that part of the puzzle.

 

So maybe github + snap-ci + oss.sonatype could solve most things?

 

I suggest we focus on transforming the developer infrastructure first, and then the remainder e.g. wordpress/demo etc.

 

Jørn

 

__________________________________________________________
Jørn Klungsøyr – www.zegeba.com - mobile: +4791365731, chat: jornklung
--------------------

 

From: openxd...@googlegroups.com [mailto:openxd...@googlegroups.com] On Behalf Of Dagmar Timler

Sent: 29. september 2014 08:51
To: openXdata Developers

[Dagmar Timler]

Hi

I found the same stackoverflow article earlier - it looked really promising - quite a few solutions to migrating from Trac to Github. Automatically migrating the issues would be top priority for me. The rest of the wiki could probably do with a clean-up, so it wouldn't be a bad thing if we had to do that manually.

I agree with your plan. We could start with getting some code on github and then seeing if snap-ci free package can work for us.

I didn't realise that Atlassian supported a hosted environment besides Bitbucket.

Thanks

Dagmar

[Jørn Klungsøyr]

Hi,

 

Sounds like a good idea to test a repo or two.

I’ve created the organization at https://github.com/openxdata

 

I have not created a repo for protocol-providers as I’m wondering if we should split it so that each provider is a separate git repo. Will likely be easier to manage over time.

 

Core devs, please send an email with your github account to con...@openxdata.org

 

The workflow of incorporating changes etc would have be different from today, but I think that will be manageable.

Everyone can create clones and send pull requests (instead of ticket patches) – but only core devs can do the actual pull – in addition I would recommend that core devs also work through the same approach (but all of that is likely for another day…..).

 

Have a great day!