Disaggregation IndexError problems

159 views

Skip to first unread message

Mark Stirling

unread,

Jul 28, 2015, 7:34:33 PM7/28/15

to OpenQuake Users

Greetings

I am on the long road to becoming a OQ user after having used fortran for my PSHA work for around two decades. I am currently trying to get oq disaggregation working. I have run a disaggregation for a site in Fiji and get the following output/error message (calc_x.log output). I have set all the relevant bin widths to minimise the calcs, and have it just disaggregating 19 PGA exceedance levels (no SA levels). Any suggestions on a solution please?

Thanks v much

Mark

[2015-07-29 00:19:34,331 hazard job #6 - PROGRESS MainProcess/2956] ** pre_executing (hazard)
[2015-07-29 00:19:34,337 hazard job #6 - PROGRESS MainProcess/2956] ** initializing sites
[2015-07-29 00:19:34,342 hazard job #6 - PROGRESS MainProcess/2956] ** initializing site collection
[2015-07-29 00:19:34,348 hazard job #6 - PROGRESS MainProcess/2956] ** initializing sources
[2015-07-29 00:19:37,773 hazard job #6 - INFO MainProcess/2956] Processing 9191 fast sources...
[2015-07-29 00:19:38,857 hazard job #6 - PROGRESS MainProcess/2956] ** executing (hazard)
[2015-07-29 00:28:46,742 hazard job #6 - PROGRESS MainProcess/2956] ** post_executing (hazard)
[2015-07-29 00:28:46,744 hazard job #6 - PROGRESS MainProcess/2956] ** initializing realizations
[2015-07-29 00:28:46,746 hazard job #6 - INFO MainProcess/2956] Creating 1 realization(s) for model FIJI_source_model.xml, b1
[2015-07-29 00:28:46,766 hazard job #6 - INFO MainProcess/2956] saving 1 hazard curves for 228||hazard_curve||Hazard Curve rlz-6-PGA, imt=PGA
[2015-07-29 00:28:46,780 hazard job #6 - INFO MainProcess/2956] 1 epsilon bins from -3.0 to 3.0
[2015-07-29 00:28:46,790 hazard job #6 - INFO MainProcess/2956] 4 mag bins from 5.0 to 8.3
[2015-07-29 00:28:46,794 hazard job #6 - INFO MainProcess/2956] 10 dist bins from 0.0 to 200.0
[2015-07-29 00:28:46,795 hazard job #6 - INFO MainProcess/2956] 5 lon bins from 177.6 to -178.8
[2015-07-29 00:28:46,797 hazard job #6 - INFO MainProcess/2956] 5 lat bins from -18.2 to -14.7
[2015-07-29 00:28:46,799 hazard job #6 - PROGRESS MainProcess/2956] ** Submitting task compute_disagg #1
[2015-07-29 00:31:36,702 hazard job #6 - INFO MainProcess/2956] Collecting bins from 215424 ruptures close to <Latitude=-16.417000, Longitude=179.383000, Depth=0.0000>
[2015-07-29 00:38:35,023 hazard job #6 - CRITICAL MainProcess/2956] Traceback (most recent call last):
File "/usr/lib/python2.7/dist-packages/openquake/engine/engine.py", line 204, in run_calc
_do_run_calc(calculator, exports)
File "/usr/lib/python2.7/dist-packages/openquake/engine/engine.py", line 244, in _do_run_calc
calc.post_execute(result)
File "/usr/lib/python2.7/dist-packages/openquake/engine/calculators/hazard/disaggregation/core.py", line 380, in post_execute
self.full_disaggregation()
File "/usr/lib/python2.7/dist-packages/openquake/engine/performance.py", line 34, in newmeth
return method(self, *args)
File "/usr/lib/python2.7/dist-packages/openquake/engine/calculators/hazard/disaggregation/core.py", line 376, in full_disaggregation
self.save_disagg_results(res.reduce(self.agg_result))
File "/usr/lib/python2.7/dist-packages/openquake/commonlib/parallel.py", line 370, in reduce
agg_result = reduce(agg_and_percent, self.results, acc)
File "/usr/lib/python2.7/dist-packages/openquake/commonlib/parallel.py", line 364, in agg_and_percent
raise RuntimeError(val)
RuntimeError:
File "/usr/lib/python2.7/dist-packages/openquake/commonlib/parallel.py", line 109, in safely_call
res = func(*args), None
File "/usr/lib/python2.7/dist-packages/openquake/engine/calculators/hazard/disaggregation/core.py", line 270, in compute_disagg
bins, edges + (trt_names,))
File "/usr/lib/python2.7/dist-packages/openquake/hazardlib/calc/disagg.py", line 292, in _arrange_data_in_bins
diss_matrix[i_mag, i_dist, i_lon, i_lat, :, i_trt] *= \
IndexError: index (5) out of range (0<=index<4) in dimension 2

Mark Stirling

unread,

Jul 28, 2015, 7:37:03 PM7/28/15

to OpenQuake Users, nzburn...@gmail.com

ps I am running oq v 1.4 on Ubuntu, which is mounted on my dell laptop pc with virtual box.

Mark Stirling

unread,

Jul 28, 2015, 11:59:22 PM7/28/15

to OpenQuake Users, nzburn...@gmail.com

Here are all the relevant files. I hope someone in OpenQuake development can try to run these files. The disaggregation is in a site in Fiji, and I have been able to run UH Spectra and maps for this area no problem, using the compressed xml file attached. As I said earlier the job shows an index error (calc log file provided).

Thanks for your help ...Mark

On Wednesday, July 29, 2015 at 11:34:33 AM UTC+12, Mark Stirling wrote:

FIJI_source_model.7z

djob.ini

calc_15.log

Marco Pagani

unread,

Jul 29, 2015, 12:08:31 AM7/29/15

to openqua...@googlegroups.com

Hi Mark,

Thank you for your email and for going along with this shift!

Regarding the problem you are signaling it's hard to provide a feedback without your input files. Can you send them? If you cannot make them public you can send them to this email address haz...@globalquakemodel.org

Cheers

Marco

Sent from my iPhone

--
You received this message because you are subscribed to the Google Groups "OpenQuake Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to openquake-use...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Mark Stirling

unread,

Jul 29, 2015, 12:36:03 AM7/29/15

to OpenQuake Users, marco....@globalquakemodel.org

Thanks for the email Marco. I am glad to be making the shift to a state of the art software. My PhD fortran code has had a shelf life much too long IMHO.

Here is the input file. Just a seismicity file.

Thanks and best

Mark

fiji.sum.dat

Mark Stirling

unread,

Jul 29, 2015, 7:51:27 AM7/29/15

to OpenQuake Users

Hoping someone can look at this issue while the sun is on the other side of the world and I am asleep.
Thanks and best
Mark

Mark Stirling

unread,

Jul 30, 2015, 12:45:10 AM7/30/15

to OpenQuake Users, marco....@globalquakemodel.org

Hi Marco - any chance someone can look at this? All files are there.

Thanks v much

Mark

On Wednesday, July 29, 2015 at 4:08:31 PM UTC+12, Marco Pagani wrote:

Marco Pagani

unread,

Jul 30, 2015, 6:04:34 AM7/30/15

to Mark Stirling, OpenQuake Users

Hi Mark,

Please could you send us all the files you are using? i.e.
source_model_logic_tree.xml and gmpe_logic_tree.xml

I noticed that in your .ini file the 'disaggregation' flag at the bottom
is commented out. Is this intentional?

Cheers,

Marco

On 30/07/15 06:45, Mark Stirling wrote:
> Hi Marco - any chance someone can look at this? All files are there.
> Thanks v much
> Mark
>
>
> On Wednesday, July 29, 2015 at 4:08:31 PM UTC+12, Marco Pagani wrote:
>
> Hi Mark,
>
> Thank you for your email and for going along with this shift!
>
> Regarding the problem you are signaling it's hard to provide a
> feedback without your input files. Can you send them? If you cannot
> make them public you can send them to this email address

> haz...@globalquakemodel.org <javascript:>

> Cheers
> Marco
>
> Sent from my iPhone
>
> On 29/lug/2015, at 01:34, Mark Stirling <nzburn...@gmail.com

>> send an email to openquake-use...@googlegroups.com <javascript:>.

>> For more options, visit https://groups.google.com/d/optout.
>

--

*MARCO PAGANI* | Seismic hazard team coordinator | skype mm.pagani | g+
marco....@globalquakemodel.org | +39-0382-5169863

*GLOBAL EARTHQUAKE MODEL * working together to assess risk

*GEM -* globalquakemodel.org <http://www.globalquakemodel.org> | *T -*
@GEMwrld <http://twitter.com/GEMwrld> | *F -* GEMwrld
<http://www.facebook.com/GEMwrld>

Marco Pagani

unread,

Jul 30, 2015, 6:07:17 AM7/30/15

to Mark Stirling, OpenQuake Users

Hi Mark,

Please could you send us all the files you are using? i.e.
source_model_logic_tree.xml and gmpe_logic_tree.xml

Cheers,

Marco

On 30/07/15 06:45, Mark Stirling wrote:

> Hi Marco - any chance someone can look at this? All files are there.
> Thanks v much
> Mark
>
>
> On Wednesday, July 29, 2015 at 4:08:31 PM UTC+12, Marco Pagani wrote:
>
> Hi Mark,
>
> Thank you for your email and for going along with this shift!
>
> Regarding the problem you are signaling it's hard to provide a
> feedback without your input files. Can you send them? If you cannot
> make them public you can send them to this email address

> haz...@globalquakemodel.org <javascript:>

> Cheers
> Marco
>
> Sent from my iPhone
>
> On 29/lug/2015, at 01:34, Mark Stirling <nzburn...@gmail.com

>> send an email to openquake-use...@googlegroups.com <javascript:>.

>> For more options, visit https://groups.google.com/d/optout.
>

Mark Stirling

unread,

Jul 30, 2015, 7:05:26 AM7/30/15

to openqua...@googlegroups.com

---------- Forwarded message ----------
From: Mark Stirling <nzburn...@gmail.com>
Date: Thu, Jul 30, 2015 at 11:04 PM
Subject: Re: Disaggregation IndexError problems
To: Marco Pagani <marco....@globalquakemodel.org>

Hi Marco -the source model xml file is in the zip file sent yesterday (Fiji_source_model.Zz). Are you able to unzip it? I will put it on the GNS ftp site as well ftp.gns.cri.nz/incoming/marks. The gmpe xml file is just the standard Chiou and Youngs NGA. I cannot access it from home where I am now. Can you use one you have?

So the disaggegation line should not be commented out at the base?

Thanks

Mark

Mark Stirling

unread,

Jul 30, 2015, 5:33:08 PM7/30/15

to OpenQuake Users, nzburn...@gmail.com

Hi Marco - have sent the source model and gmpe logic tree xml files to your email ie outside of this thread.

Cheers

Mark

Marco Pagani

unread,

Jul 31, 2015, 12:29:15 AM7/31/15

to openqua...@googlegroups.com, nzburn...@gmail.com

Hi Mark thanks for sending the files. I've been able to reproduce your error which seems related with the international date line. I will need a few days to work on this.

Cheers,

Marco

Sent from my iPhone

To unsubscribe from this group and stop receiving emails from it, send an email to openquake-use...@googlegroups.com.

Mark Stirling

unread,

Jul 31, 2015, 12:48:15 AM7/31/15

to OpenQuake Users, nzburn...@gmail.com, marco....@globalquakemodel.org, openqua...@googlegroups.com

Thanks very much Marco. Interestingly, the international date line problem did not impact spectra or mapping calcs I did recently....

Thanks and looking forward to seeing what you come up with.

Best

Mark

Marco Pagani

unread,

Jul 31, 2015, 1:54:48 AM7/31/15

to Mark Stirling, OpenQuake Users

The disaggregator works separately from the hazard curve calculator. For the latter I'm sure we do have tests covering the IDL case. Not sure about this for the former.

Best

Marco

Sent from my iPhone

Michele Simionato

unread,

Jul 31, 2015, 6:49:53 AM7/31/15

to OpenQuake Users, marco....@globalquakemodel.org

We have tests about the IDL crossing in the disaggregation calculator, but they could be not enough:

https://github.com/gem/oq-hazardlib/blob/master/openquake/hazardlib/tests/calc/disagg_test.py#L328

Mark Stirling

unread,

Aug 6, 2015, 5:51:36 PM8/6/15

to Marco Pagani, openqua...@googlegroups.com

CIao Marco. Just checking in to see if you or anyone has made progress in the last week on the IDL index issue for deaggregation.

Thanks and best

Mark

On Wed, Aug 5, 2015 at 8:32 AM, Mark Stirling <nzburn...@gmail.com> wrote:

Thanks marco. Understand. I have a report due 31 July that was to have the disagg included, but at least the client doesn't seem to be responding to emails. He must not be to worried about time, but I do need to finish it off before I head overseas in a couple weeks.
Thanks for all y your help.
Mark

On Aug 5, 2015 6:49 AM, "Marco Pagani" <marco....@globalquakemodel.org> wrote:
Ciao Mark,
Sorry for getting back to you late. I'm working on it but I need time.
This is holiday period here and I have little help and a lot of issues
to face :( I hope to get back to you soon.
Cheers,
Marco

On 03/08/15 03:32, Mark Stirling wrote:
> Ciao Marco et al
> Just checking in on the progress on sorting out the IDL issue for
> disaggregation.
> Thanks and best
> Mark
>
> On Fri, Jul 31, 2015 at 7:40 PM, Mark Stirling <nzburn...@gmail.com
> <mailto:nzburn...@gmail.com>> wrote:
>
> Well that at least makes potential sense as to why I could run the
> haz maps arms spectra but not the disagg. appreciate the efforts and
> hope you can sort.. Thanks Mark
>
> On Jul 31, 2015 5:54 PM, "Marco Pagani"
> <marco....@globalquakemodel.org

> <mailto:marco....@globalquakemodel.org>> wrote:
>
> The disaggregator works separately from the hazard curve
> calculator. For the latter I'm sure we do have tests covering
> the IDL case. Not sure about this for the former.
> Best
> Marco
>
> Sent from my iPhone
>
> On 31/lug/2015, at 06:48, Mark Stirling <nzburn...@gmail.com

>>> <http://ftp.gns.cri.nz/incoming/marks>. The gmpe xml

>>> <http://globalquakemodel.org>

Mark Stirling

unread,

Aug 13, 2015, 6:22:43 AM8/13/15

to Marco Pagani, openqua...@googlegroups.com

Ciao Marco.

Given that this IDL disaggregation issue is a significant one, I was wondering if I could get the info I am after by another way? I am wanting to get the modal magnitude for a number of chosen sites, for the 500 year return period. Like, is that info able to be gained from the spectrum or hazard curve calculators somehow?

Thanks
Mark

On Aug 12, 2015 9:37 PM, "Mark Stirling" <nzburn...@gmail.com> wrote:

Thanks very much Marco. It is interesting to have exposed such a significant issue with disagg .... if you are working on the IDL . mark

On Aug 12, 2015 8:29 PM, "Marco Pagani" <marco....@globalquakemodel.org> wrote:
Ciao Mark,

yesterday I've been working at your bug and I haven't been able to
isolate the problem. I have a code that samples (sequentially as well as
randomly) your input model and creates a smaller input. So far it didn't
produce results as I was expecting. I'll keep on working on this.

Cheers,

Marco

On 10/08/15 10:15, Mark Stirling wrote:
> Ciao Marco. That is great to hear. Sorry to contribute to your workload,
> but I guess it is all in the name of testing and eliminating errors.
> Looking forward to hearing from you.
> Cheers
> Mark
>
> On Mon, Aug 10, 2015 at 4:27 PM, Marco Pagani
> <marco....@globalquakemodel.org
> <mailto:marco....@globalquakemodel.org>> wrote:
>
> Hi Mark. I'm working on it, currently trying to isolate the bug.
> I built a code that splits your model in many pieces that I run
> separately. I'll keep you posted.
> Best
> Marco

>
> On 06/08/15 23:51, Mark Stirling wrote:
> > CIao Marco. Just checking in to see if you or anyone has made progress
> > in the last week on the IDL index issue for deaggregation.
> > Thanks and best
> > Mark
> >

> > On Wed, Aug 5, 2015 at 8:32 AM, Mark Stirling <nzburn...@gmail.com <mailto:nzburn...@gmail.com>

> > <mailto:nzburn...@gmail.com <mailto:nzburn...@gmail.com>>> wrote:
> >
> > Thanks marco. Understand. I have a report due 31 July that was to
> > have the disagg included, but at least the client doesn't seem to be
> > responding to emails. He must not be to worried about time, but I do
> > need to finish it off before I head overseas in a couple weeks.
> > Thanks for all y your help.
> > Mark
> >
> > On Aug 5, 2015 6:49 AM, "Marco Pagani"
> > <marco....@globalquakemodel.org

> <mailto:marco....@globalquakemodel.org>
> > <mailto:marco....@globalquakemodel.org

> <mailto:marco....@globalquakemodel.org>>> wrote:
> >
> > Ciao Mark,
> > Sorry for getting back to you late. I'm working on it but I need
> > time.
> > This is holiday period here and I have little help and a lot of
> > issues
> > to face :( I hope to get back to you soon.
> > Cheers,
> > Marco
> >
> > On 03/08/15 03:32, Mark Stirling wrote:
> > > Ciao Marco et al
> > > Just checking in on the progress on sorting out the IDL issue for
> > > disaggregation.
> > > Thanks and best
> > > Mark
> > >
> > > On Fri, Jul 31, 2015 at 7:40 PM, Mark Stirling
> > <nzburn...@gmail.com <mailto:nzburn...@gmail.com>

> <mailto:nzburn...@gmail.com <mailto:nzburn...@gmail.com>>
> > > <mailto:nzburn...@gmail.com
> <mailto:nzburn...@gmail.com>

> > <mailto:nzburn...@gmail.com <mailto:nzburn...@gmail.com>>>> wrote:
> > >
> > > Well that at least makes potential sense as to why I
> > could run the
> > > haz maps arms spectra but not the disagg. appreciate the
> > efforts and
> > > hope you can sort.. Thanks Mark
> > >
> > > On Jul 31, 2015 5:54 PM, "Marco Pagani"
> > > <marco....@globalquakemodel.org
> <mailto:marco....@globalquakemodel.org>

> > <mailto:marco....@globalquakemodel.org
> <mailto:marco....@globalquakemodel.org>>
> > > <mailto:marco....@globalquakemodel.org
> <mailto:marco....@globalquakemodel.org>
> > <mailto:marco....@globalquakemodel.org

> <mailto:marco....@globalquakemodel.org>>>> wrote:
> > >
> > > The disaggregator works separately from the hazard curve
> > > calculator. For the latter I'm sure we do have tests
> > covering
> > > the IDL case. Not sure about this for the former.
> > > Best
> > > Marco
> > >
> > > Sent from my iPhone
> > >
> > > On 31/lug/2015, at 06:48, Mark Stirling
> > <nzburn...@gmail.com <mailto:nzburn...@gmail.com>

> <mailto:nzburn...@gmail.com <mailto:nzburn...@gmail.com>>
> > > <mailto:nzburn...@gmail.com
> <mailto:nzburn...@gmail.com>

> > <mailto:nzburn...@gmail.com <mailto:nzburn...@gmail.com>>>> wrote:
> > >
> > >>
> > >> Thanks very much Marco. Interestingly, the
> > international date
> > >> line problem did not impact spectra or mapping calcs
> > I did
> > >> recently....
> > >> Thanks and looking forward to seeing what you come up
> > with.
> > >> Best
> > >> Mark
> > >>
> > >> On Friday, July 31, 2015 at 4:29:15 PM UTC+12, Marco
> > Pagani wrote:
> > >>
> > >> Hi Mark thanks for sending the files. I've been
> > able to
> > >> reproduce your error which seems related with the
> > >> international date line. I will need a few days
> > to work on
> > >> this.
> > >> Cheers,
> > >> Marco
> > >>
> > >> Sent from my iPhone
> > >>
> > >> On 30/lug/2015, at 23:33, Mark Stirling

> > >> <nzburn...@gmail.com <mailto:nzburn...@gmail.com>

> > <http://ftp.gns.cri.nz/incoming/marks>

> > >>>
> <http://ftp.gns.cri.nz/incoming/marks>. The
> > gmpe xml
> > >>> file is just the standard Chiou and Youngs
> > NGA. I
> > >>> cannot access it from home where I am now.
> > Can you
> > >>> use one you have?
> > >>>
> > >>> So the disaggegation line should not be
> > commented out
> > >>> at the base?
> > >>> Thanks
> > >>> Mark
> > >>>
> > >>> On Thu, Jul 30, 2015 at 10:08 PM,
> Marco Pagani
> > >>> <marco....@globalquakemodel.org

> <mailto:marco....@globalquakemodel.org>
> > <mailto:marco....@globalquakemodel.org

> <mailto:haz...@globalquakemodel.org>
> > <mailto:haz...@globalquakemodel.org
> <mailto:haz...@globalquakemodel.org>> <javascript:>

> > >>> > Cheers
> > >>> > Marco
> > >>> >
> > >>> > Sent from my iPhone
> > >>> >
> > >>> > On 29/lug/2015, at 01:34, Mark
> > Stirling

> > >>> <nzburn...@gmail.com <mailto:nzburn...@gmail.com>
> > <mailto:nzburn...@gmail.com <mailto:nzburn...@gmail.com>>

> <mailto:openquake-use...@googlegroups.com>
> > <mailto:openquake-use...@googlegroups.com
> <mailto:openquake-use...@googlegroups.com>> <javascript:>.

> > >>> >> For more options, visit
> > >>> https://groups.google.com/d/optout.
> > >>> >
> > >>>
> > >>> --
> > >>>
> > >>> *MARCO PAGANI* | Seismic hazard team
> > coordinator
> > >>> | skype mm.pagani | g+

> > >>> marco....@globalquakemodel.org <mailto:marco....@globalquakemodel.org>
> > <mailto:marco....@globalquakemodel.org
> <mailto:marco....@globalquakemodel.org>> | +39-0382-5169863
> <tel:%2B39-0382-5169863>
> > <tel:%2B39-0382-5169863>

> > >>>
> > >>> *GLOBAL EARTHQUAKE MODEL * working
> > together to
> > >>> assess risk
> > >>>
> > >>> *GEM -* globalquakemodel.org <http://globalquakemodel.org>

> > <http://globalquakemodel.org>

> > >>> <http://globalquakemodel.org>
> > >>> <http://www.globalquakemodel.org> | *T -*
> > >>> @GEMwrld <http://twitter.com/GEMwrld> |
> > *F -* GEMwrld
> > >>> <http://www.facebook.com/GEMwrld>
> > >>>
> > >>>
> > >>>
> > >>> --
> > >>> You received this message because you are
> > subscribed to
> > >>> the Google Groups "OpenQuake Users" group.
> > >>> To unsubscribe from this group and stop
> > receiving emails
> > >>> from it, send an email to
> > openquake-use...@googlegroups.com

> <mailto:openquake-use...@googlegroups.com>
> > <mailto:openquake-use...@googlegroups.com
> <mailto:openquake-use...@googlegroups.com>>.

> > >>> For more options, visit
> > https://groups.google.com/d/optout.
> > >
> > >
> >
> > --
> >
> > *MARCO PAGANI* | Seismic hazard team coordinator | skype
> > mm.pagani | g+
> > marco....@globalquakemodel.org

> <mailto:marco....@globalquakemodel.org>
> > <mailto:marco....@globalquakemodel.org
> <mailto:marco....@globalquakemodel.org>> | +39-0382-5169863
> <tel:%2B39-0382-5169863>
> > <tel:%2B39-0382-5169863>

> >
> > *GLOBAL EARTHQUAKE MODEL * working together to assess risk
> >
> > *GEM -* globalquakemodel.org <http://globalquakemodel.org>
> <http://globalquakemodel.org>
> > <http://www.globalquakemodel.org> | *T -*
> > @GEMwrld <http://twitter.com/GEMwrld> | *F -* GEMwrld
> > <http://www.facebook.com/GEMwrld>
> >
> >
>
> --
>

> *MARCO PAGANI* | Seismic hazard team coordinator | skype mm.pagani | g+
> marco....@globalquakemodel.org

> <mailto:marco....@globalquakemodel.org> | +39-0382-5169863
> <tel:%2B39-0382-5169863>

>
> *GLOBAL EARTHQUAKE MODEL * working together to assess risk
>
> *GEM -* globalquakemodel.org <http://globalquakemodel.org>
> <http://www.globalquakemodel.org> | *T -*
> @GEMwrld <http://twitter.com/GEMwrld> | *F -* GEMwrld
> <http://www.facebook.com/GEMwrld>
>
>

--

Mark Stirling

unread,

Aug 18, 2015, 11:04:26 PM8/18/15

to Marco Pagani, openqua...@googlegroups.com

Hi Marco - wondering if there has been any progress on the disaggregation IDL issue?

Thanks and cheers

MArk

Mark Stirling

unread,

Aug 27, 2015, 3:43:30 PM8/27/15

to Marco Pagani, openqua...@googlegroups.com

Ciao Marco

Managed to successfully install the corrected version of OQ as per your instructions. Have just tried running a disaggregation job and get the error

col = getattr(obj, f)

AttributeError: 'HazardSite' object has no attribute 'lon'

I also get this same error when I try to run one of my earlier jobs that used to work ie spectra calculations. Looks like it is ignoring my site lon which is defined as per normal in djob.ini (the file I sent you some weeks back).

Any hints?

Thanks very much

Mark

On Thu, Aug 20, 2015 at 8:19 AM, Mark Stirling <nzburn...@gmail.com> wrote:

Thanks very much Marco. I will check into this asap. Really appreciate the efforts.

On Aug 20, 2015 4:44 AM, "Marco Pagani" <marco....@globalquakemodel.org> wrote:
Hi Mark,

The patch is in master. In order to use it you must install the engine
using the the sources following these instructions

https://github.com/gem/oq-engine/blob/engine-1.4/doc/engine/Installing-the-OpenQuake-Engine.md

Note I'm assuming you're using the engine installed on a Virtual
Machine. If this is not correct please let me know the properties of
your installations and I'll try to help you.

I run the disaggregation you sent on my machine but I didn't check the
results. I would appreciate receiving your feedback on this. Thank you.

Cheers,

Marco

On 19/08/15 12:52, Mark Stirling wrote:
> That's great news Marco. Looking forward to seeing the update. Cheers
> and thanks Mark
>
> On Aug 19, 2015 3:51 PM, "Marco Pagani"
> <marco....@globalquakemodel.org
> <mailto:marco....@globalquakemodel.org>> wrote:
>
> Hi Mark,
> I think I found the bug. I already worked at fixing it.
> I hope by today to push it into master.
> Cheers,
> Marco

>
> On 19/08/15 05:04, Mark Stirling wrote:
> > Hi Marco - wondering if there has been any progress on the
> > disaggregation IDL issue?
> > Thanks and cheers
> > MArk
> >
> > On Thu, Aug 13, 2015 at 10:22 PM, Mark Stirling

> <nzburn...@gmail.com <mailto:nzburn...@gmail.com>
> > <mailto:nzburn...@gmail.com <mailto:nzburn...@gmail.com>>>
> wrote:
> >

> > Ciao Marco.
> >
> > Given that this IDL disaggregation issue is a significant one,
> I was
> > wondering if I could get the info I am after by another way? I am
> > wanting to get the modal magnitude for a number of chosen
> sites, for
> > the 500 year return period. Like, is that info able to be gained
> > from the spectrum or hazard curve calculators somehow?
> >
> > Thanks
> > Mark
> >
> > On Aug 12, 2015 9:37 PM, "Mark Stirling"

> <nzburn...@gmail.com <mailto:nzburn...@gmail.com>

> > <mailto:nzburn...@gmail.com
> <mailto:nzburn...@gmail.com>>> wrote:
> >
> > Thanks very much Marco. It is interesting to have exposed
> such a
> > significant issue with disagg .... if you are working on
> the IDL
> > . mark
> >
> > On Aug 12, 2015 8:29 PM, "Marco Pagani"
> > <marco....@globalquakemodel.org

> <mailto:marco....@globalquakemodel.org>
> > <mailto:marco....@globalquakemodel.org
> <mailto:marco....@globalquakemodel.org>>> wrote:
> >
> > Ciao Mark,
> >

> > yesterday I've been working at your bug and I haven't been
> > able to
> > isolate the problem. I have a code that samples
> > (sequentially as well as
> > randomly) your input model and creates a smaller input. So
> > far it didn't
> > produce results as I was expecting. I'll keep on
> working on
> > this.
> >
> > Cheers,
> >
> > Marco
> >
> > On 10/08/15 10:15, Mark Stirling wrote:
> > > Ciao Marco. That is great to hear. Sorry to
> contribute to
> > your workload,
> > > but I guess it is all in the name of testing and
> > eliminating errors.
> > > Looking forward to hearing from you.
> > > Cheers
> > > Mark
> > >
> > > On Mon, Aug 10, 2015 at 4:27 PM, Marco Pagani
> > > <marco....@globalquakemodel.org
> <mailto:marco....@globalquakemodel.org>

> > <mailto:nzburn...@gmail.com
> <mailto:nzburn...@gmail.com> <mailto:nzburn...@gmail.com
> <mailto:nzburn...@gmail.com>>>
> > > > <mailto:nzburn...@gmail.com
> <mailto:nzburn...@gmail.com>
> > <mailto:nzburn...@gmail.com

> <mailto:nzburn...@gmail.com>>
> > <mailto:nzburn...@gmail.com
> <mailto:nzburn...@gmail.com>
> > <mailto:nzburn...@gmail.com
> <mailto:nzburn...@gmail.com>>>>> wrote:
> > > >
> > > > Thanks marco. Understand. I have a report
> due 31
> > July that was to
> > > > have the disagg included, but at least the
> > client doesn't seem to be
> > > > responding to emails. He must not be to
> worried
> > about time, but I do
> > > > need to finish it off before I head
> overseas in
> > a couple weeks.
> > > > Thanks for all y your help.
> > > > Mark
> > > >
> > > > On Aug 5, 2015 6:49 AM, "Marco Pagani"
> > > > <marco....@globalquakemodel.org
> <mailto:marco....@globalquakemodel.org>
> > <mailto:marco....@globalquakemodel.org
> <mailto:marco....@globalquakemodel.org>>

> <mailto:nzburn...@gmail.com>> <mailto:nzburn...@gmail.com

> > <mailto:nzburn...@gmail.com
> <mailto:nzburn...@gmail.com> <mailto:nzburn...@gmail.com
> <mailto:nzburn...@gmail.com>>>
> > > > <mailto:nzburn...@gmail.com
> <mailto:nzburn...@gmail.com>
> > <mailto:nzburn...@gmail.com
> <mailto:nzburn...@gmail.com>> <mailto:nzburn...@gmail.com
> <mailto:nzburn...@gmail.com>
> > <mailto:nzburn...@gmail.com
> <mailto:nzburn...@gmail.com>>>>>

> > > > >>> Date: Thu, Jul 30,
> 2015
> > at 11:04 PM
> > > > >>> Subject: Re:
> > Disaggregation IndexError problems
> > > > >>> To: Marco Pagani
> > > > <marco....@globalquakemodel.org
> <mailto:marco....@globalquakemodel.org>
> > <mailto:marco....@globalquakemodel.org
> <mailto:marco....@globalquakemodel.org>>

> > <mailto:marco....@globalquakemodel.org
> <mailto:marco....@globalquakemodel.org>
> > <mailto:marco....@globalquakemodel.org
> <mailto:marco....@globalquakemodel.org>>>
> > > > <mailto:marco....@globalquakemodel.org
> <mailto:marco....@globalquakemodel.org>
> > <mailto:marco....@globalquakemodel.org
> <mailto:marco....@globalquakemodel.org>>
> > > <mailto:marco....@globalquakemodel.org
> <mailto:marco....@globalquakemodel.org>
> > <mailto:marco....@globalquakemodel.org
> <mailto:marco....@globalquakemodel.org>>>>>
> > > > >>>
> > > > >>>

> <mailto:nzburn...@gmail.com>> <mailto:nzburn...@gmail.com

> <mailto:nzburn...@gmail.com>
> > <mailto:nzburn...@gmail.com <mailto:nzburn...@gmail.com>>>
> > > > <mailto:nzburn...@gmail.com
> <mailto:nzburn...@gmail.com>
> > <mailto:nzburn...@gmail.com
> <mailto:nzburn...@gmail.com>> <mailto:nzburn...@gmail.com
> <mailto:nzburn...@gmail.com>
> > <mailto:nzburn...@gmail.com
> <mailto:nzburn...@gmail.com>>>>
> > > > >>> >

> > <mailto:marco....@globalquakemodel.org
> <mailto:marco....@globalquakemodel.org>
> > <mailto:marco....@globalquakemodel.org
> <mailto:marco....@globalquakemodel.org>>>
> > > > <mailto:marco....@globalquakemodel.org
> <mailto:marco....@globalquakemodel.org>
> > <mailto:marco....@globalquakemodel.org
> <mailto:marco....@globalquakemodel.org>>
> > > <mailto:marco....@globalquakemodel.org
> <mailto:marco....@globalquakemodel.org>
> > <mailto:marco....@globalquakemodel.org

> > > <mailto:openquake-use...@googlegroups.com
> <mailto:openquake-use...@googlegroups.com>
> > <mailto:openquake-use...@googlegroups.com
> <mailto:openquake-use...@googlegroups.com>>>
> > > >
> <mailto:openquake-use...@googlegroups.com
> <mailto:openquake-use...@googlegroups.com>
> > <mailto:openquake-use...@googlegroups.com
> <mailto:openquake-use...@googlegroups.com>>
> > > <mailto:openquake-use...@googlegroups.com

> <mailto:openquake-use...@googlegroups.com>
> > <mailto:openquake-use...@googlegroups.com
> <mailto:openquake-use...@googlegroups.com>>>>.
> > > > >>> For more options, visit
> > > > https://groups.google.com/d/optout.
> > > > >
> > > > >
> > > >
> > > > --
> > > >
> > > > *MARCO PAGANI* | Seismic hazard team
> > coordinator | skype
> > > > mm.pagani | g+
> > > > marco....@globalquakemodel.org
> <mailto:marco....@globalquakemodel.org>
> > <mailto:marco....@globalquakemodel.org
> <mailto:marco....@globalquakemodel.org>>

> > > <mailto:marco....@globalquakemodel.org
> <mailto:marco....@globalquakemodel.org>
> > <mailto:marco....@globalquakemodel.org
> <mailto:marco....@globalquakemodel.org>>>
> > > >
> <mailto:marco....@globalquakemodel.org
> <mailto:marco....@globalquakemodel.org>
> > <mailto:marco....@globalquakemodel.org
> <mailto:marco....@globalquakemodel.org>>
> > > <mailto:marco....@globalquakemodel.org
> <mailto:marco....@globalquakemodel.org>
> > <mailto:marco....@globalquakemodel.org
> <mailto:marco....@globalquakemodel.org>>>> |

> > +39-0382-5169863 <tel:%2B39-0382-5169863>
> > > <tel:%2B39-0382-5169863>
> > > > <tel:%2B39-0382-5169863>
> > > >
> > > > *GLOBAL EARTHQUAKE MODEL * working
> together
> > to assess risk
> > > >
> > > > *GEM -* globalquakemodel.org
> <http://globalquakemodel.org>
> > <http://globalquakemodel.org>
> <http://globalquakemodel.org>

> > > <http://globalquakemodel.org>
> > > > <http://www.globalquakemodel.org> | *T -*
> > > > @GEMwrld <http://twitter.com/GEMwrld> | *F
> > -* GEMwrld
> > > > <http://www.facebook.com/GEMwrld>
> > > >
> > > >
> > >
> > > --
> > >
> > > *MARCO PAGANI* | Seismic hazard team coordinator |
> > skype mm.pagani | g+
> > > marco....@globalquakemodel.org
> <mailto:marco....@globalquakemodel.org>

> > <mailto:marco....@globalquakemodel.org
> <mailto:marco....@globalquakemodel.org>>
> > > <mailto:marco....@globalquakemodel.org
> <mailto:marco....@globalquakemodel.org>
> > <mailto:marco....@globalquakemodel.org
> <mailto:marco....@globalquakemodel.org>>> |

> > +39-0382-5169863 <tel:%2B39-0382-5169863>
> > > <tel:%2B39-0382-5169863>
> > >
> > > *GLOBAL EARTHQUAKE MODEL * working together to
> assess risk
> > >
> > > *GEM -* globalquakemodel.org
> <http://globalquakemodel.org>
> > <http://globalquakemodel.org>
> <http://globalquakemodel.org>
> > > <http://www.globalquakemodel.org> | *T -*
> > > @GEMwrld <http://twitter.com/GEMwrld> | *F -*
> GEMwrld
> > > <http://www.facebook.com/GEMwrld>
> > >
> > >
> >
> > --
> >
> > *MARCO PAGANI* | Seismic hazard team coordinator | skype
> > mm.pagani | g+
> > marco....@globalquakemodel.org
> <mailto:marco....@globalquakemodel.org>
> > <mailto:marco....@globalquakemodel.org
> <mailto:marco....@globalquakemodel.org>> |
> > +39-0382-5169863 <tel:%2B39-0382-5169863>
> >

> > *GLOBAL EARTHQUAKE MODEL * working together to assess risk
> >
> > *GEM -* globalquakemodel.org
> <http://globalquakemodel.org> <http://globalquakemodel.org>
> > <http://www.globalquakemodel.org> | *T -*
> > @GEMwrld <http://twitter.com/GEMwrld> | *F -* GEMwrld
> > <http://www.facebook.com/GEMwrld>
> >
> >
>
> --
>
> *MARCO PAGANI* | Seismic hazard team coordinator | skype mm.pagani | g+
> marco....@globalquakemodel.org
> <mailto:marco....@globalquakemodel.org> | +39-0382-5169863
>

Marco Pagani

unread,

Sep 2, 2015, 10:49:23 AM9/2/15

to Mark Stirling, openqua...@googlegroups.com

Hi Mark,

Thank you for your email and sorry for getting back to you so late.

My feeling is that your recent upgrade was not successful. Did you run some demos to check if the engine is working fine with simpler models?

Also, did you follow all the steps described at this link (I’m supposing you are using the engine on ubuntu 12.04)?

https://github.com/gem/oq-engine/blob/master/doc/engine/Installing-the-OpenQuake-Engine-from-source-code.md

Thanks

Marco

Reply all

Reply to author

Forward

0 new messages