DuraCloud Dev Google Group

Re: [duracloud-dev] Re: Duracloud with Openstack Swift Error

2013-04-25T14:56:27Z

Hi Onur,

We currently test DuraCloud against two OpenStack implementations:
Rackspace CloudFiles and SDSC Cloud. It is mentioned here:
[link]
that
Rackspace does not use Keystone for authentication. I can't say for sure

Re: Duracloud with Openstack Swift Error

2013-04-25T08:02:20Z

Hi Bill,

Apparently cyberduck is not compatible with keystone for the identification.

I'm wondering if Duracloud was compatible with keystone ?

Thank you very much for your support.

Best regards.
Onur Erdogan

Le vendredi 19 avril 2013 10:53:11 UTC+2, onur.hali...@gmail.com a écrit :

Re: [duracloud-dev] Duracloud with Openstack Swift Error

2013-04-19T13:47:03Z

Hi Onur,

As a starting point, since the error you're reporting is clearly a login
failure, have you verified that you can connect to your OpenStack swift
installation with the credentials you are using? Perhaps a stand-alone
client like CyberDuck ([link]) could be of assistance there.

Duracloud with Openstack Swift Error

2013-04-19T08:53:11Z

Hi, I am trying to implement Duracloud with Openstack Swift.

I updated the authURL of sdscstorageprovider so that he points
on my openstack. But I still can’t deploy the DuraCloud because it fails to
connect to Openstack Swift.

Can you help me?

Error in the shell after running the commande : sudo java –jar

Re: [duracloud-dev] Progress on Storage Reports with iRODS Backend

2013-01-10T19:58:34Z

Hi Dan,

I'm glad to hear that your work has progressed to the point where you can
begin doing demonstrations. I'd be interested to hear how those go.

With regard to the issue you're seeing with the prefix argument not working
properly, it's good to know that ignoring the prefix allows the calls to

Progress on Storage Reports with iRODS Backend

2013-01-09T23:09:17Z

I have made a bit of progress getting the storage reports to work in our
Duracloud setup using the iRODS storage provider.
It looks like there were two problems that caused the graphical storage
reports not to display.
First - it appears that there is a bug in the iRODS api that causes both
getSpaceContents and getSpaceContentsChunked to not return anything if the

Re: [duracloud-dev] Re: Deploying Services

2012-12-18T22:28:51Z

Dan,
According to your config, both of the following should render html in
your browser?
[link]
[link]

If they do not, then services-admin did not come up properly. There

Re: [duracloud-dev] Re: Deploying Services

2012-12-19T01:23:24Z

Hey Dan,

The list of services looks right, and the fact that a few are resolved
rather than active is fine, those just indicate what OSGi calls bundle
fragments, meaning that they are not stand-alone bundles but instead are
used to extend other bundles.

Also, the variables in the service xml file are fine, those variables are

Re: Deploying Services

2012-12-18T17:36:52Z

Bill -- I have included the list returned from the ss command.
It does contain 50 items including org.duracloud.services.admin.
Are the services listed as RESOLVED - rather than ACTIVE a problem?
And - yes
[link]

Re: [duracloud-dev] Deploying Services

2012-12-18T16:51:32Z

Hi Dan,

You are correct to not exit from the OSGi command prompt, as it is simply
running as an interactive process, not kicking off a daemon. If you're
running it on a linux system, you can use the nohup command with the &
parameter (e.g. "nohup run.sh &") to run it as a daemon, if you wish. For

Deploying Services

2012-12-15T16:06:21Z

Bill --
After reading your earlier email - I decided I should not exit from the
osgi command prompt after I start the osgi container (which I had been
doing).
I had thought that the run.sh command used to start the osgi container
started an osgi daemon process - but that seems to not be the case (??).

Re: [duracloud-dev] Private cloud storage options, maybe Swift?

2012-12-12T15:35:11Z

Hi Hardy,

DuraCloud currently has two production storage providers that make use of
the OpenStack Swift storage API. Those are Rackspace (not surprisingly) and
the SDSC Cloud ([link]). If you were to implement an
OpenStack environment locally, it would be straight forward to make use of

Private cloud storage options, maybe Swift?

2012-12-11T20:11:31Z

Hi, we're exploring the idea of running DuraCloud locally, and I was
wondering about private cloud storage options. OpenStack Object Storage
(aka Swift) was originally developed for RackSpace's cloud storage, so, I'm
wondering if anyone has used Swift for DuraCloud?

Re: [duracloud-dev] Unable to deploy services

2012-12-04T21:38:06Z

Hi Dan,

It's hard to know what exactly might be causing the issue. As a starting
point I assume that you have the OSGI container running (as detailed here:
[link]).
I assume also that the OSGI container is running on
duracloud.lib.utexas.edu(since that's where the calls are going), and

Re: [duracloud-dev] Re: Duracloud Configuration For Graphical Reports

2012-12-04T21:18:31Z

Hi Dan,

The storage reports build up over time, so if it has just run once, then
the graph won't be very interesting (just a single point on the graph). By
default, once initialized, the reporter will run weekly on Saturday at 1
AM. You can change that schedule, of course. In any case, once the reporter

Re: [duracloud-dev] Possible bug in Duraboss property in init.properties

2012-12-04T21:02:03Z

Hi Dan,

Sorry for the late reply on this, I've been out of the office for the past
two weeks, and am just now getting through all of my email.

Regarding the issue you reported, you are correct, this is a bug, thanks
for pointing it out. I've logged a bug report here:
[link]. You'll note that I went

Unable to deploy services

2012-11-27T22:30:37Z

If I click on the available services button - I get a list of 10 services.
If I select one of the services - like Bit Integrity Checker - I can get to
the panel with the 'deploy' button.
When I press the deploy button - I get an error box - and in my
catalina.out - I get the following errors:
INFO 2012/11/27 16:24:37 [http-80-11]

Re: Duracloud Configuration For Graphical Reports

2012-11-27T22:06:52Z

Ok - so I am getting storage reports in my x-duracloud-admin directory.
I can look through the XML and they seem legitimate.
But - when I open up the History panel - I have yet to see anything for
'Byte and File Counts over Time'.
I am also curious about why - none of my items have a value for their

Possible bug in Duraboss property in init.properties

2012-11-20T19:56:32Z

I was getting an error when I ran app-config-driver that said :
fromAddress not valid notification: u...@austin.utexas.edu (where user was
my username)
I researched this a bit and found a regular expression
in AmazonNotificationFactory.java
that looked like this:
!fromAddress.matches("[a-zA-Z_ 0-9+]+@\\w+\\.\\w+")) {

Re: [duracloud-dev] Re: Duracloud Configuration For Graphical Reports

2012-11-16T21:45:35Z

Hi Dan,

The portion of your config.properties that you sent looks fine, at least in
terms of getting the reporter going. You'd need to include values for the
user/pwd in order to actually get notifications, but that's another matter.

I assume that you've tried cycling your tomcat server, and re-running the

Re: Duracloud Configuration For Graphical Reports

2012-11-16T21:08:14Z

Bill --
When I try to hit our server
[link]<[link]>
I get a nicely formatted page that says :
This page contains the following errors:
error on line 1 at column 1: Document is empty
Below is a rendering of the page up to the first error.

Re: Duracloud Configuration For Graphical Reports

2012-11-16T18:47:39Z

Hi Dan,

Those graphs you saw are generated based on storage reports. The storage
reports are created by the reporter portion of DuraBoss. My guess, based on
the config you sent before, is that you currently have the reporter turned
off. The config item that turns the reporter on or off
is: duraboss.reporter.enabled. So you'd need to make sure that this is set

Re: [duracloud-dev] Duracloud seems to lose settings when I stop/restart Tomcat

2012-11-12T21:04:16Z

Hi Dan,

What you seeing is the expected behavior. DuraCloud does not store any of
the configuration information provided by app-config, except in runtime
memory. This means, of course, that if your server is restarted, it must
also be re-initialized. This approach was intentional, as it provides us

Duracloud seems to lose settings when I stop/restart Tomcat

2012-11-12T20:38:42Z

It appears that I need to run app-config every time I restart Tomcat.
If I don't run app-config - then it seems like my Duracloud installation
doesn't know about the user I have defined in my init.properties file.
Here is how I run app-config:
java -jar app-config-2.1.1-driver.jar classes/init.properties

Re: [duracloud-dev] FileNotFoundException trying to read bit-integrity-results.json

2012-11-01T15:20:25Z

Hi Dan,

I'm glad to hear that the iRODS integration is going well. With regard to
the error you mentioned, that file is used to capture the results of
automated bit integrity runs that are managed by DuraBoss. The reason that
error are showing up in the logs is because every time you attempt to view

FileNotFoundException trying to read bit-integrity-results.json

2012-10-31T22:19:50Z

I have been making a lot of progress getting Duracloud talking to an iRODS
server.
My Duracloud installation is actually communicating with the iRODS server
and I have been able to upload files.
I see this error a lot in my log file and I am not sure where to start
trying to debug it:
Caused by: org.duracloud.error.ContentSto reException: Response code was

Re: [duracloud-dev] How do I set duracloud.home ?

2012-10-31T17:01:08Z

Hi Dan,

As you could likely guess, the duracloud.home variable is used in the
logger configuration (we use LogBack) to specify where the log files should
be placed. While I usually set this variable in maven, since I generally
build from source, my understanding (based on the information here:

How do I set duracloud.home ?

2012-10-30T21:59:52Z

I am clearly missing something here - I don't know how I should be setting
Duracloud.home.
Here is one of the errors I get when I start Tomcat/Duracloud:
File property is set to
[duracloud.home_IS_UNDEFINED/l ogs/duracloud-duradmin.log]
21:55:07,522 |-ERROR in
ch.qos.logback.core.rolling.Ro llingFileAppender[DURACLOUD] - Failed to

Re: [duracloud-dev] Help Needed with init.properties

2012-10-17T17:32:09Z

Hi Dan,

Thanks for passing along your init file. I have several suggestions that
should help to get things running more smoothly.

1. You'll need to create a service repository to contain the service
bundles used by DuraService. This means that you'll need to:
- Create a space in DuraCloud named "duracloud-2-1-0-service-repo" and copy

Re: [duracloud-dev] Help Needed with init.properties

2012-10-17T15:55:41Z

Bill --
Here is what I currently have for my init.properties (passwords and email
addresses omitted).
My current project is to just get DuraCloud running on an Amazon Ubuntu
instance - talking to our S3 account - no funny business.
Note - I currently have the Duraboss line commented out - like you said in

Re: [duracloud-dev] Help Needed with init.properties

2012-10-16T22:49:49Z

Hi Dan,

It sounds like you've made good progress. Based on what you've said, it
sounds like most of the issues you're running into can be resolved by
tweaks to the init.properties file. If you could pass along your
init.properties file, that would be the best way for me to assist you.

Cheers,

Help Needed with init.properties

2012-10-16T20:07:47Z

I am trying to get DuraCloud working with our existing Amazon S3 account.
I installed DuraCloud 2.1.1 from binaries and I have been following the
instructions on the Wiki for installing from binaries.
I have been slowly making my way through the init.properties file and
making incremental changes that seem to make things better but DuraCloud is

NOTICE: DuraSpace Wiki Upgrade/Downtime on Fri @ 2-3pm EDT

2012-09-26T16:25:16Z

DuraCloud Developers,

We wanted to inform you that we will be performing an upgrade of our
DuraSpace Wiki ([link]) on:

Friday, September 28 from 2:00pm - 3:00pm EDT (18:00 - 19:00 UTC)

During this period, all areas of the Wiki will be UNAVAILABLE for
reading or editing.

NEWS RELEASE: DuraSpace and San Diego Supercomputer Center (SDSC) Partner to Provide Cost-Effective Cloud Storage/Preservation Services

2012-09-18T15:37:24Z

FOR IMMEDIATE RELEASE

Sept. 18, 2012
Contact: Carol Minton Morris, (cmmor...@duraspace.org); Jan Zverina (
jzver...@sdsc.edu)
Read it online: [link]

*DuraSpace and San Diego Supercomputer Center (SDSC) Partner to Provide
Cost-Effective Cloud Storage and Preservation Services**

Re: [duracloud-dev] deploy service and roles

2012-07-09T11:53:40Z

Hi Bill,
Thanks again for your help. I think they could all be viable options,
especially #2 and #3.

Paul

Re: [duracloud-dev] deploy service and roles

2012-07-07T19:13:25Z

Hi Paul,

Your plan for integration with DuraCloud via CloudSync sounds like a good
one. Regarding getting access to reports, there are a few ways that could
be done. The bit integrity reports are stored in the x-service-out space,
this is where service reports always go, regardless of whether they are

Re: [duracloud-dev] deploy service and roles

2012-07-06T20:20:46Z

Thanks for the info Bill. The executor maybe all we need.

One of the reasons I was looking at the services is that it looked like we
could run it as a non privileged user (i was incorrect in that assumption)
and it looked to me like the executor stuff required a privileged user.
But i can see the health check report as a non privileged user in the

Re: [duracloud-dev] deploy service and roles

2012-07-06T14:45:50Z

Hi Paul,

What we found to be the case for DuraCloud is that our users really prefer
for services like bit integrity to simply be managed for them. Everybody
liked the idea of frequent bit integrity checking, but very few were
interested in managing the details. That is what led us to the development

Re: [duracloud-dev] deploy service and roles

2012-07-06T12:54:45Z

Hi Bill,
Thanks for the quick response.

Yeah, it's a job and a half just keeping documentation up to date.

What would work well for us would be users with the USER role being able to
run services for spaces that they have read/write access on. Or similarly
it would work if we could limit an Adminstrator type user to a certain

Re: [duracloud-dev] deploy service and roles

2012-07-05T20:04:45Z

Hi Paul,

To start a service, you will need to make the call with a user that has
either the ADMIN or OWNER role. Part of the goal for the 2.0.0 release was
simplifying the interaction with DuraCloud for those with role USER, and
that resulted in a variety of changes, including the automation of several

deploy service and roles

2012-07-05T19:49:54Z

We've been using the duracloud rest api to integrate with islandora.
We can get content and properties and list services etc. but when
trying to deploy the bitintegrity service we are getting a 403
forbidden. We are trying this as a limited user (just a normal User
not Administrator or owner).

Re: [duracloud-dev] DuraBoss not initializing in init.properties

2012-06-07T17:04:22Z

Hello Dave,
It looks like the error is due to 'duraservice' not being able to find
the service zip files. If you have not already done so, in your
init.properties file you will want to update the following properties:
------------
duraservice.service-storage.sp ace-id=duracloud-2-0-0-service -repo

DuraBoss not initializing in init.properties

2012-06-01T03:27:45Z

I just installed the latest Duracloud binaries per the instructions
and for some reason when I run:

java -jar app-config.jar init.properties

I get the following error message:
...
23:21:42.743 [main] DEBUG httpclient.wire.header - << "[\r][\n]"
23:21:42.744 [main] DEBUG o.d.common.web.RestHttpHelper - RESPONSE

Re: [duracloud-dev] Setting up DuraCloud locally -- GSOC Idea 'Dynamic Language(Ruby) Client'

2012-03-16T19:01:20Z

Hello Nitish,
I would suggest the following:
durastore.storage-acct.0.stora ge-class=rrs
duraservice.primary-instance.s ervices-admin-context=org.dura cloud.services.admin_1.3.1
You can probably drop ROLE_ROOT from your roles. The groups can be
left commented out, unless you want to have security groups. The

Re: [duracloud-dev] Setting up DuraCloud locally -- GSOC Idea 'Dynamic Language(Ruby) Client'

2012-03-16T18:28:21Z

Adding to, what should be the values for -->
durastore.storage-acct.0.stora ge-class=[rrs|standard]

Re: [duracloud-dev] Setting up DuraCloud locally -- GSOC Idea 'Dynamic Language(Ruby) Client'

2012-03-16T18:25:30Z

Hi Bill
Can you please confirm the parameter values for -->
duraservice.primary-instance.s ervices-admin-context=org.dura cloud.services.admin_[VERSION]
For the security roles I have added values in file as -->
ecurity.user.0.grants.0=ROLE_U SER
security.user.0.grants.1=ROLE_ ROOT
security.user.0.grants.2=ROLE_ ADMIN

Re: [duracloud-dev] Setting up DuraCloud locally -- GSOC Idea 'Dynamic Language(Ruby) Client'

2012-03-14T15:49:46Z

Hi Nitish,
There are, unfortunately, no docs that currently speak specifically to
setting up DuraCloud from the binary distribution. There are a few steps
involved in this process:
1. Deploy the web applications
- Take the 4 .war files included in the binary distribution and copy them
into the "webapps" directory under your tomcat installation.

Setting up DuraCloud locally -- GSOC Idea 'Dynamic Language(Ruby) Client'

2012-03-14T14:44:26Z

I want to set up DuraCloud locally on my machine so that I can play with
the REST API and build a very quick barebone prototype for the idea . Have
already downloaded the Binary Distributions from
[link] with
Tomcat and Java already installed and running on OSX Lion.

Integrating Duracloud with iRODS

2012-02-13T14:02:04Z

Hi Mike (and Everyone),
My name is Jun Zhang and I am a software developer from King's College
London. I have deployed a local Duracloud instance for our research
project - Kindura and I am trying to add a live iRODS server as one of
the storage providers in the local Duracloud instance. I got some

Announcement: Another Successful Google Summer of Code!

2011-09-30T13:24:02Z

All,
As we head into Fall (for those of us in the Northern Hemisphere), we
thought it appropriate to reflect back on the successes that came out
of this year's Google Summer of Code (GSoC -
[link]).
As you may recall, this is the first year that all DuraSpace projects
took part in GSoC, with Fedora & DuraCloud joining DSpace with a