General Question regarding export the disaggregation results in the traditional form

[Sujan Raj Adhikari]

Hi,

I have a question about exporting disaggregation results in the traditional format using OpenQuake Engine 3.20.1. The documentation provides the following commands:

1. oq export disagg-rlzs-traditional <calc_id>
2. oq export disagg-stats-traditional <calc_id>

I tried using these commands to obtain results in the traditional format, but when I run them in the OpenQuake Engine console on Windows, I receive a "syntax is incorrect" error.

Could you please provide a solution for this issue?

Thank you!

Sujan 

[Sujan Raj Adhikari]

if someone response how to obtain traditional one that will be great

[Lana Todorovic]

Dear Sujan,

Please try typing:

oq export disagg-rlzs-traditional 42

Do not put calc_id in <>. Hope this works.

Best regards

[Sujan Raj Adhikari]

thanks Iana but where it will export. it exported but i don't know the location. thanks for the help

[Lana Todorovic]

Dear Sujan,

It should be exported to the directory where your job file is.

[Sujan Raj Adhikari]

thanks Iana,
one more question, when i tried  oq export disagg-stats-traditional 54 the response is 

Keyerror: "No ' disagg-stats/TRT_Mag_Dis_Eps' found in <datastore c\........calc_54.hdf5 open>

but  oq export disagg-rlzs-traditional 54 is already runing

i can see these file through qgis . so confused. 

any thoughts on this 

thanks

Sujan

[Sujan Raj Adhikari]

Error when i tried to use oq export disagg-stats-traditional 57 but but  oq export disagg-rlzs-traditional 57  exported fine . any reason why?

C:\Users\ADHIS4\AppData\Local\Programs\OpenQuake Engine>oq export disagg-stats-traditional 57
Traceback (most recent call last):
  File "C:\Users\ADHIS4\AppData\Local\Programs\OpenQuake Engine\python3\Lib\site-packages\openquake\commonlib\datastore.py", line 507, in __getitem__
    val = self.hdf5[key]
          ~~~~~~~~~^^^^^
  File "C:\Users\ADHIS4\AppData\Local\Programs\OpenQuake Engine\python3\Lib\site-packages\openquake\baselib\hdf5.py", line 498, in __getitem__
    h5obj = super().__getitem__(path)
            ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "h5py\_objects.pyx", line 54, in h5py._objects.with_phil.wrapper
  File "h5py\_objects.pyx", line 55, in h5py._objects.with_phil.wrapper
  File "C:\Users\ADHIS4\AppData\Local\Programs\OpenQuake Engine\python3\Lib\site-packages\h5py\_hl\group.py", line 357, in __getitem__
    oid = h5o.open(self.id, self._e(name), lapl=self._lapl)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "h5py\_objects.pyx", line 54, in h5py._objects.with_phil.wrapper
  File "h5py\_objects.pyx", line 55, in h5py._objects.with_phil.wrapper
  File "h5py\h5o.pyx", line 189, in h5py.h5o.open
KeyError: 'Unable to synchronously open object (component not found)'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<frozen runpy>", line 198, in _run_module_as_main
  File "<frozen runpy>", line 88, in _run_code
  File "C:\Users\ADHIS4\AppData\Local\Programs\OpenQuake Engine\python3\Scripts\oq.exe\__main__.py", line 7, in <module>
  File "C:\Users\ADHIS4\AppData\Local\Programs\OpenQuake Engine\python3\Lib\site-packages\openquake\commands\__main__.py", line 48, in oq
    sap.run(commands, prog='oq')
  File "C:\Users\ADHIS4\AppData\Local\Programs\OpenQuake Engine\python3\Lib\site-packages\openquake\baselib\sap.py", line 212, in run
    return _run(parser(funcdict, **parserkw), argv)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\ADHIS4\AppData\Local\Programs\OpenQuake Engine\python3\Lib\site-packages\openquake\baselib\sap.py", line 203, in _run
    return func(**dic)
           ^^^^^^^^^^^
  File "C:\Users\ADHIS4\AppData\Local\Programs\OpenQuake Engine\python3\Lib\site-packages\openquake\commands\export.py", line 38, in main
    fnames = export_((datastore_key, fmt), dstore)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\ADHIS4\AppData\Local\Programs\OpenQuake Engine\python3\Lib\site-packages\openquake\baselib\general.py", line 668, in __call__
    return self[key](obj, *args, **kw)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\ADHIS4\AppData\Local\Programs\OpenQuake Engine\python3\Lib\site-packages\openquake\calculators\export\hazard.py", line 577, in export_disagg_csv
    aw = extract(dstore, ex % (k, s, spec))
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\ADHIS4\AppData\Local\Programs\OpenQuake Engine\python3\Lib\site-packages\openquake\calculators\extract.py", line 204, in __call__
    data = self[k](dstore, v)
           ^^^^^^^^^^^^^^^^^^
  File "C:\Users\ADHIS4\AppData\Local\Programs\OpenQuake Engine\python3\Lib\site-packages\openquake\calculators\extract.py", line 1177, in extract_disagg
    fullmatrix = dstore['disagg-%s/%s' % (spec, label)][sid]
                 ~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\ADHIS4\AppData\Local\Programs\OpenQuake Engine\python3\Lib\site-packages\openquake\commonlib\datastore.py", line 517, in __getitem__
    raise KeyError('No %r found in %s' % (key, self))
KeyError: "No 'disagg-stat/TRT_Mag_Dist_Eps' found in <DataStore C:\\Users\\ADHIS4\\oqdata\\calc_57.hdf5 open>"

[Yves Robert]

The exporter has been removed. Look at the link below.

https://groups.google.com/g/openquake-users/c/UCRyUCRubY0/m/qePqwMMrAwAJ

[Sujan Raj Adhikari]

Oh really, thanks a lot. exporting all the realization and taking out the average will be the solution, but the file size will be more than 20GB. its going to be a huge task.

[Owen Jiang]

if I just get the deaggregation results directly from OpenQuake calculation, and hope to convert to the traditional format (so the summation is 100%) and generate the plots like below. Anyone has any suggestions or if there is available python code for this? Thank you. 

--
You received this message because you are subscribed to the Google Groups "OpenQuake Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to openquake-use...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/openquake-users/0bd81281-c9ea-40aa-a70f-c830b44911d9n%40googlegroups.com.

[davidm]

Did you work out a solution to this Sujan?

I'm having a similar issue running a seismic model with hundreds of thousands of realisations and ending up with a .csv file that is 40GB for one return period, and need to get a traditional disaggregation result. Previously I've processed disaggregation results using pandas but the size of the dataset is making this challenging.

[Sujan Raj Adhikari]

I am using Python for this