Re: Duracloud Configuration For Graphical Reports

21 views
Skip to first unread message

Bill Branan

unread,
Nov 16, 2012, 1:47:16 PM11/16/12
to Galewsky, Dan, duracl...@googlegroups.com
Hi Dan,

Those graphs you saw are generated based on storage reports. The storage reports are created by the reporter portion of DuraBoss. My guess, based on the config you sent before, is that you currently have the reporter turned off. The config item that turns the reporter on or off is: duraboss.reporter.enabled. So you'd need to make sure that this is set to true (duraboss.reporter.enabled=true).

Once you re-configure DuraBoss to turn the reporter on, you can go to: https://host:port/duraboss/report/storage/info to see the status of the reporter. Once it completes the first run, you'll start to see the graphs in your UI. Of course, the more runs it does, over time, the more useful the graphs become. You can find other calls for getting report data and scheduling reports here: https://wiki.duraspace.org/display/DURACLOUDDOC/DuraCloud+REST+API#DuraCloudRESTAPI-GetLatestStorageReport

The reports generated by the reporter are stored in the x-duracloud-admin space, under the "report/" prefix, in case you're interested in seeing what they look like.

Bill


On Fri, Nov 16, 2012 at 12:57 PM, Galewsky, Dan <dan.ga...@austin.utexas.edu> wrote:
Bill --

This morning I saw a production instance of Duracloud (my boss Ladd Hanson is helping develop the Digital Preservation Network (DPN) and they are using Duracloud).

The user interface was the same as what I have been seeing with the Duracloud that I have set up - except there were these really nice graphical reports - showing information about the content that had been uploaded to Duracloud.

So - my question - I don't see these graphics on my Duracloud instance -- what do I need to configure to make this work? My suspicion is that this has something to do with Duraboss?

I am running version 2.1.1 of Duracloud. Can you give me any tips about what might be wrong with my configuration ? Any debugging hints?

Thanks. I really do appreciate all of the help you have been giving me.

--Dan Galewsky
Texas Digital Library


Dan Galewsky

unread,
Nov 16, 2012, 4:08:13 PM11/16/12
to duracl...@googlegroups.com, Galewsky, Dan
Bill --

When I try to hit our server

I get a nicely formatted page that says :

This page contains the following errors:

error on line 1 at column 1: Document is empty

Below is a rendering of the page up to the first error.


So then I tried to use the Rest interface:


and get this message:

DuraBoss must be initialized

I am at a loss to figure out how to further initialize Duraboss.

Here are the lines from my config.properties file that are relevant to Duraboss:

----

app.duraboss.context=duraboss

----
###
# defines notification requirements, for duraboss
###
duraboss.notification.0.type=EMAIL
duraboss.notification.0.username=user
duraboss.notification.0.password=pwd
duraboss.notification.0.originator=us...@austin.utexas.edu
duraboss.notification.0.admin.0=us...@austin.utexas.edu
duraboss.reporter.enabled=true
duraboss.executor.enabled=true
duraboss.auditor.enabled=true

Bill Branan

unread,
Nov 16, 2012, 4:45:13 PM11/16/12
to duracl...@googlegroups.com, Galewsky, Dan
Hi Dan,

The portion of your config.properties that you sent looks fine, at least in terms of getting the reporter going. You'd need to include values for the user/pwd in order to actually get notifications, but that's another matter.

I assume that you've tried cycling your tomcat server, and re-running the init (using app-config)? I assume as well that the init ended with "success"? The output of the init should indicate that a 200 response came back from the call to duraboss.

Where there any errors in the duraboss log that might indicate the issue? Right after the init occurs, the duraboss log should print some messages indicating that a storage report is scheduled for a particular date, and that the storage report is starting (indicating the epoch time). Did these show up?

Bill


--
You received this message because you are subscribed to the Google Groups "DuraCloud Dev" group.
To view this discussion on the web visit https://groups.google.com/d/msg/duracloud-dev/-/zenv-rK46Z4J.
To post to this group, send email to duracl...@googlegroups.com.
To unsubscribe from this group, send email to duracloud-de...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/duracloud-dev?hl=en.

Dan Galewsky

unread,
Nov 27, 2012, 5:06:52 PM11/27/12
to duracl...@googlegroups.com, Galewsky, Dan
Ok - so I am getting storage reports in my x-duracloud-admin directory.

I can look through the XML and they seem legitimate. 

But - when I open up the History panel - I have yet to see anything for 'Byte and File Counts over Time'.

I am also curious about why - none of my items have a value for their checksums. That is - if I click on any of my items - the checksum field is empty.

Bill Branan

unread,
Dec 4, 2012, 4:18:31 PM12/4/12
to duracl...@googlegroups.com, Galewsky, Dan
Hi Dan,

The storage reports build up over time, so if it has just run once, then the graph won't be very interesting (just a single point on the graph). By default, once initialized, the reporter will run weekly on Saturday at 1 AM. You can change that schedule, of course. In any case, once the reporter has been run at least twice, the graphs should become more useful.

Regarding checksums, that is a value that comes from the storage provider (such as from S3 or RackSpace). In your case, since you're using the IRODS provider, that information would need to be coming from IRODS. However, I don't believe that is a value provided by IRODS, which would explain why the field is empty in the UI.

Bill


--
You received this message because you are subscribed to the Google Groups "DuraCloud Dev" group.
To view this discussion on the web visit https://groups.google.com/d/msg/duracloud-dev/-/5yxu1r_A31wJ.
Reply all
Reply to author
Forward
0 new messages