Fw: [DRMAA-WG] Introducing Eclipse Science WG and OGF & DRMAA WG

[Bruno P. Kinoshita]

FYI,

Learned about Eclipse Science WG yesterday from a message about DRMAA in the DRMAA mailing list.

We are using DRMAA in the PBS plug-in, though with some customisation tailored for PBS. The idea was base the work on DRMAA and then enable the plug-in to work with other grid providers.

Now with DRMAA v2 it may be easier, specially querying about resources in the grid to display in Jenkins. We may be able to re-use what's being built in Triquetrum :)

Cheers

Bruno

----- Forwarded Message -----
From: erwindl0 <erwi...@gmail.com>
To: Science Industry Working Group <scien...@eclipse.org>; drmaa-wg <drma...@ogf.org>
Sent: Wednesday, 6 July 2016 9:51 PM
Subject: [DRMAA-WG] Introducing Eclipse Science WG and OGF & DRMAA WG

Dear all,

As scientific software and HPC often go together in the work we do, it might be good to get some interactions going between two specialized working groups in these domains :

Eclipse Science WG : http://science.eclipse.org/ and http://wiki.eclipse.org/Science_WG

"The Science Working Group (SWG) works to solve the problems of making science programs inter-operable and interchangeable by defining standards, common principles, and software development collaboration. It helps permeate concepts and capabilities to different research areas which allows serendipitous discoveries to be made.

The SWG, hosted by the Eclipse Foundation, is a collaborative effort involving industry, academia, and government to develop reusable open source software for scientific research. The SWG provides governance and infrastructure to enable a collaborative approach to producing technologies used for interdisciplinary analysis of scientific data. The group may package components to regularly release a trusted distribution of software."

Open Grid Forum and the DRMAA WG in particular : https://www.ogf.org and https://www.drmaa.org

"OGF is an open global community committed to driving the rapid evolution and adoption of modern advanced applied distributed computing, including cloud, grid and associated storage, networking and workflow methods. OGF is focused on developing and promoting innovative scalable techniques, applications and infrastructures to improve productivity in the enterprise and within the international research, science and business communities. "

"The 'Distributed Resource Management Application API (DRMAA)' working group develops and maintains a set of API specifications for tightly coupled and portable programmatic access to cluster, grid, and cloud systems.
The DRMAA working group deliverables are intended to facilitate the development of portable application programs and high-level libraries such as SAGA or OGSA-BES.
DRM system vendors can provide a standardized access to their product through a DRMAA implementation. High-level API designers, meta-scheduler architects and end users can rely on such DRMAA implementations for a unified access to execution resources.
The scope of the API standardization is focused on job submission, job control, reservation management, and retrieval of job and machine monitoring information. "

FYI, Triquetrum will be providing a first set of reusable OSGi-bundles for Java DRMAA API and bindings with our Science 2016 release.
The goal is to make them directly reusable in other Java/OSGi science projects that might want to submit jobs on clusters/grids/...
(i.e. also for those of us who don't want to do everything via workflows ;-) )

regards

erwin

--
  drmaa-wg mailing list
  drma...@ogf.org
  https://www.ogf.org/mailman/listinfo/drmaa-wg

[Ioannis Moutsatsos]

That sounds good! Will this also support the Sun Grid Engine (now Oracle Grid Engine) as well?

Best regards

Ioannis

[Bruno P. Kinoshita]

The v2 has implementations announces [1] for Univa Grid Engine, Torque / PBS Pro, GridWay. But the list of implementations [2] available for DRMAA v1 is:

Grid Engine

Univa Grid Engine

HTCondor

Torque/PBS

GridWay

Xgrid

EGEE (LCG2 / gLite)

UNICORE

Kerrighed Cluster Framework

IBM Tivoli Workload Scheduler LoadLeveler

SLURM

And anyone is free to start a new implementation based on the specification. So by using DRMAA it should be easier to support multiple platforms.

There are still a few issues with the current Java implementation, and also integrating it with low level bindings in C/C++. So that's why I have been looking at alternatives, libraries, and other working groups.

Bruno

[1] https://www.drmaa.org/ogf34.pdf

[2] https://en.wikipedia.org/wiki/DRMAA

---

From: Ioannis Moutsatsos <imout...@gmail.com>
To: BioUno Developers <biouno-d...@googlegroups.com>
Cc: brunod...@yahoo.com.br
Sent: Friday, 8 July 2016 1:04 AM
Subject: Re: Fw: [DRMAA-WG] Introducing Eclipse Science WG and OGF & DRMAA WG

--
You received this message because you are subscribed to the Google Groups "BioUno Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to biouno-develop...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.