The OpenQuake engine version 3.21 has been released

[Michele Simionato]

Version 3.21 is the culmination of 4 months of work involving nearly 250

pull requests. It is the release featuring the greatest performance improvements of the latest years.

It is aimed at users wanting the latest features
and maximum performance. Users valuing stability may want to stay with
the LTS release instead (currently at version 3.16.7).

The complete set of changes is listed in the changelog:

https://github.com/gem/oq-engine/blob/engine-3.21/debian/changelog

A summary of the new features and optimizations is given here:

https://docs.openquake.org/oq-engine/3.21/manual/release-notes/whats-new-3.21.html

You can install on all supported platforms (Linux, Windows, macOS) by
using the universal installer:

https://github.com/gem/oq-engine/blob/engine-3.21/doc/installing/universal.md

Windows user may prefer the native installer

https://downloads.openquake.org/pkgs/windows/oq-engine/OpenQuake_Engine_3.21.0-1.exe

The OpenQuake engine manual is available here:

https://docs.openquake.org/oq-engine/3.21/manual/getting-started/index.html

Before installing the new release you should uninstall the previous
release, if you have one. As always, before upgrading, you should export any
output of interests, since exporting an output computed with an older
version of the engine may raise an error. Moreover, it is generally
not possible to run a risk calculation starting from a hazard computed
with an older version.

That's all, please let us know if you have any trouble with the upgrade.

           Michele Simionato on behalf of the OpenQuake Team

[Sujan Raj Adhikari]

Last week, I tried using the developer version of the OpenQuake engine (version 3.21). Unfortunately, it did not run the deaggregation process; it seemed to stall at 94% and remained inactive for a day. I then set up version again 3.20.1, which ran smoothly and completed the task within half an hour.

I hope this issue has been addressed in the latest release. Today, I plan to download it and run it again. I will keep you updated on the results.

[Sujan Raj Adhikari]

issue is similar to as said before see all checksum.

2024-10-02T16:26:43.46,INFO,SpawnProcess-1/12256,ADHIS4 running C:\Users\ADHIS4\AppData\Local\Temp\calc_18\OQ\WesternCity\CanadaWestern-Disaggregation.ini [--hc=None]

2024-10-02T16:26:43.46,INFO,SpawnProcess-1/12256,Using engine version 3.21.0

2024-10-02T16:26:44.58,WARNING,SpawnProcess-1/12256,Using 14 processpool workers

2024-10-02T16:26:44.61,INFO,SpawnProcess-1/12256,Checksum of the inputs: 2852738396 (total size 214.97 KB)

2024-10-02T16:26:44.63,INFO,SpawnProcess-1/12256,Running PreClassicalCalculator with concurrent_tasks = 50

2024-10-02T16:26:44.64,INFO,SpawnProcess-1/12256,Extracting the hazard sites from the site model

2024-10-02T16:26:44.66,INFO,SpawnProcess-1/12256,Read N=1 hazard sites and L=440 hazard levels

2024-10-02T16:26:44.66,INFO,SpawnProcess-1/12256,Reading C:\Users\ADHIS4\AppData\Local\Temp\calc_18\OQ\WesternCity\CanadaSHM6_NBCC2020_WesternCanada-LT.xml

2024-10-02T16:26:44.69,INFO,SpawnProcess-1/12256,Building 4_096 realizations

2024-10-02T16:26:44.74,INFO,SpawnProcess-1/12256,Reading the source model(s) in parallel

2024-10-02T16:26:45.11,WARNING,SpawnProcess-1/12256,Sent 1 read_source_model tasks, 0 B

2024-10-02T16:26:45.13,INFO,SpawnProcess-1/12256,read_source_model 100% [1 submitted, 0 queued]

2024-10-02T16:26:45.14,INFO,SpawnProcess-1/12256,Received 1 * 82.42 KB in 0 seconds [unpik=0.00s] from read_source_model

{'C:\\Users\\ADHIS4\\AppData\\Local\\Temp\\calc_18\\OQ\\WesternCity\\CanadaSHM6_NBCC2020_WesternCanada.xml': '82.42 KB'}

2024-10-02T16:26:45.14,INFO,SpawnProcess-1/12256,Applying uncertainties

2024-10-02T16:26:45.16,INFO,SpawnProcess-1/12256,Rupture floating factor = 2.92

2024-10-02T16:26:45.16,INFO,SpawnProcess-1/12256,Rupture spinning factor = 6.12

2024-10-02T16:26:45.18,INFO,SpawnProcess-1/12256,Building cmakers

2024-10-02T16:26:46.26,WARNING,SpawnProcess-1/12256,The global pmap would require 55 KB (Gt=32)

2024-10-02T16:26:46.26,INFO,SpawnProcess-1/12256,Starting preclassical with 5 source groups

2024-10-02T16:26:46.49,INFO,SpawnProcess-1/12256,AreaSource AKC has maximum magnitude 9.45

2024-10-02T16:26:46.51,WARNING,SpawnProcess-1/12256,Sent 9 preclassical tasks, 4.7 MB

2024-10-02T16:26:53.84,INFO,SpawnProcess-1/12256,preclassical 11% [9 submitted, 0 queued]

2024-10-02T16:26:53.93,INFO,SpawnProcess-1/12256,preclassical 22% [9 submitted, 0 queued]

2024-10-02T16:26:56.21,INFO,SpawnProcess-1/12256,preclassical 33% [9 submitted, 0 queued]

2024-10-02T16:26:56.67,INFO,SpawnProcess-1/12256,preclassical 44% [9 submitted, 0 queued]

2024-10-02T16:26:57.49,INFO,SpawnProcess-1/12256,preclassical 55% [9 submitted, 0 queued]

2024-10-02T16:26:57.65,INFO,SpawnProcess-1/12256,preclassical 66% [9 submitted, 0 queued]

2024-10-02T16:27:03.93,INFO,SpawnProcess-1/12256,preclassical 77% [9 submitted, 0 queued]

2024-10-02T16:27:06.25,INFO,SpawnProcess-1/12256,preclassical 88% [9 submitted, 0 queued]

2024-10-02T16:27:06.57,INFO,SpawnProcess-1/12256,preclassical 100% [9 submitted, 0 queued]

2024-10-02T16:27:06.57,INFO,SpawnProcess-1/12256,Mean time per core=4s, std=4.2s, min=0s, max=12s

2024-10-02T16:27:06.59,INFO,SpawnProcess-1/12256,Received 9 * 1.83 MB in 20 seconds [unpik=0.42s] from preclassical

{2: '10.71 MB', 4: '5.5 MB', 1: '172.74 KB'}

2024-10-02T16:27:06.70,INFO,SpawnProcess-1/12256,ComplexFaultSource ruptures: 367

2024-10-02T16:27:06.70,INFO,SpawnProcess-1/12256,SimpleFaultSource ruptures: 16_940

2024-10-02T16:27:06.71,INFO,SpawnProcess-1/12256,PointSource ruptures: 10_555_188

2024-10-02T16:27:06.71,INFO,SpawnProcess-1/12256,AreaSource ruptures: 12_991_368

2024-10-02T16:27:06.81,INFO,SpawnProcess-1/12256,There are 5 groups and 81 sources with len(trt_smrs)=1.00

2024-10-02T16:27:07.11,INFO,SpawnProcess-1/12256,Storing 712.56 KB of CompositeSourceModel

2024-10-02T16:27:07.13,INFO,SpawnProcess-1/12256,tot_weight=2_108_296, max_weight=44_274, num_sources=37_225

2024-10-02T16:27:07.16,INFO,SpawnProcess-1/12256,There are 3 light groups out of 5

2024-10-02T16:27:07.16,INFO,SpawnProcess-1/12256,mem_gb = 0.00

2024-10-02T16:27:08.41,WARNING,SpawnProcess-1/12256,This is a regular calculation with 52 outputs, 52 tasks, min_tiles=1, max_tiles=1

2024-10-02T16:27:08.41,INFO,SpawnProcess-1/12256,Heaviest: <PointSource CAS.105, weight=1944.1>

2024-10-02T16:27:08.48,WARNING,SpawnProcess-1/12256,Sent 28 classical tasks, 6.42 MB

2024-10-02T16:27:08.66,INFO,SpawnProcess-1/12256,classical 1% [28 submitted, 24 queued]

2024-10-02T16:27:08.67,INFO,SpawnProcess-1/12256,classical 3% [28 submitted, 24 queued]

2024-10-02T16:27:08.69,INFO,SpawnProcess-1/12256,classical 5% [28 submitted, 24 queued]

2024-10-02T16:27:09.37,INFO,SpawnProcess-1/12256,classical 7% [28 submitted, 24 queued]

2024-10-02T16:27:09.48,INFO,SpawnProcess-1/12256,classical 9% [28 submitted, 24 queued]

2024-10-02T16:27:09.82,INFO,SpawnProcess-1/12256,classical 11% [28 submitted, 24 queued]

2024-10-02T16:27:09.94,INFO,SpawnProcess-1/12256,classical 13% [28 submitted, 24 queued]

2024-10-02T16:27:10.16,INFO,SpawnProcess-1/12256,classical 15% [28 submitted, 24 queued]

2024-10-02T16:27:10.37,INFO,SpawnProcess-1/12256,classical 17% [28 submitted, 24 queued]

2024-10-02T16:27:10.51,INFO,SpawnProcess-1/12256,classical 19% [28 submitted, 24 queued]

2024-10-02T16:27:10.70,INFO,SpawnProcess-1/12256,classical 21% [28 submitted, 24 queued]

2024-10-02T16:27:10.84,INFO,SpawnProcess-1/12256,classical 23% [28 submitted, 24 queued]

2024-10-02T16:27:11.18,INFO,SpawnProcess-1/12256,classical 25% [28 submitted, 24 queued]

2024-10-02T16:27:11.24,INFO,SpawnProcess-1/12256,classical 26% [28 submitted, 24 queued]

2024-10-02T16:27:11.33,INFO,SpawnProcess-1/12256,classical 28% [28 submitted, 24 queued]

2024-10-02T16:27:12.71,INFO,SpawnProcess-1/12256,classical 30% [28 submitted, 24 queued]

2024-10-02T16:27:12.74,INFO,SpawnProcess-1/12256,classical 32% [28 submitted, 24 queued]

2024-10-02T16:27:13.02,INFO,SpawnProcess-1/12256,classical 34% [29 submitted, 23 queued]

2024-10-02T16:27:13.03,INFO,SpawnProcess-1/12256,classical 36% [29 submitted, 23 queued]

2024-10-02T16:27:13.71,INFO,SpawnProcess-1/12256,classical 38% [30 submitted, 22 queued]

2024-10-02T16:27:14.59,INFO,SpawnProcess-1/12256,classical 40% [31 submitted, 21 queued]

2024-10-02T16:27:14.64,INFO,SpawnProcess-1/12256,classical 42% [31 submitted, 21 queued]

2024-10-02T16:27:14.80,INFO,SpawnProcess-1/12256,classical 44% [32 submitted, 20 queued]

2024-10-02T16:27:14.91,INFO,SpawnProcess-1/12256,classical 46% [33 submitted, 19 queued]

2024-10-02T16:27:14.94,INFO,SpawnProcess-1/12256,classical 48% [33 submitted, 19 queued]

2024-10-02T16:27:15.18,INFO,SpawnProcess-1/12256,classical 50% [34 submitted, 18 queued]

2024-10-02T16:27:15.20,INFO,SpawnProcess-1/12256,classical 51% [34 submitted, 18 queued]

2024-10-02T16:27:15.20,INFO,SpawnProcess-1/12256,classical 53% [34 submitted, 18 queued]

2024-10-02T16:27:15.21,INFO,SpawnProcess-1/12256,classical 55% [34 submitted, 18 queued]

2024-10-02T16:27:15.50,INFO,SpawnProcess-1/12256,classical 57% [34 submitted, 18 queued]

2024-10-02T16:27:15.53,INFO,SpawnProcess-1/12256,classical 59% [34 submitted, 18 queued]

2024-10-02T16:27:15.86,INFO,SpawnProcess-1/12256,classical 61% [35 submitted, 17 queued]

2024-10-02T16:27:15.88,INFO,SpawnProcess-1/12256,classical 63% [35 submitted, 17 queued]

2024-10-02T16:27:15.94,INFO,SpawnProcess-1/12256,classical 65% [36 submitted, 16 queued]

2024-10-02T16:27:16.33,INFO,SpawnProcess-1/12256,classical 67% [37 submitted, 15 queued]

2024-10-02T16:27:16.42,INFO,SpawnProcess-1/12256,classical 69% [38 submitted, 14 queued]

2024-10-02T16:27:16.73,INFO,SpawnProcess-1/12256,classical 71% [39 submitted, 13 queued]

2024-10-02T16:27:16.96,INFO,SpawnProcess-1/12256,classical 73% [40 submitted, 12 queued]

2024-10-02T16:27:17.16,INFO,SpawnProcess-1/12256,classical 75% [41 submitted, 11 queued]

2024-10-02T16:27:17.19,INFO,SpawnProcess-1/12256,classical 76% [41 submitted, 11 queued]

2024-10-02T16:27:17.36,INFO,SpawnProcess-1/12256,classical 78% [43 submitted, 9 queued]

2024-10-02T16:27:17.59,INFO,SpawnProcess-1/12256,classical 80% [44 submitted, 8 queued]

2024-10-02T16:27:17.70,INFO,SpawnProcess-1/12256,classical 82% [45 submitted, 7 queued]

2024-10-02T16:27:17.85,INFO,SpawnProcess-1/12256,classical 84% [46 submitted, 6 queued]

2024-10-02T16:27:18.13,INFO,SpawnProcess-1/12256,classical 86% [47 submitted, 5 queued]

2024-10-02T16:27:18.13,INFO,SpawnProcess-1/12256,classical 88% [47 submitted, 5 queued]

2024-10-02T16:27:18.21,INFO,SpawnProcess-1/12256,classical 90% [47 submitted, 5 queued]

2024-10-02T16:27:18.22,INFO,SpawnProcess-1/12256,classical 92% [47 submitted, 5 queued]

2024-10-02T16:27:18.28,INFO,SpawnProcess-1/12256,classical 94% [47 submitted, 5 queued]

2024-10-02T16:27:18.83,INFO,SpawnProcess-1/12256,classical 96% [48 submitted, 4 queued]

2024-10-02T16:27:18.98,INFO,SpawnProcess-1/12256,classical 98% [49 submitted, 3 queued]

2024-10-02T16:27:19.18,INFO,SpawnProcess-1/12256,classical 100% [50 submitted, 2 queued]

2024-10-02T16:27:19.21,INFO,SpawnProcess-1/12256,classical 101% [50 submitted, 2 queued]

2024-10-02T16:27:19.41,INFO,SpawnProcess-1/12256,classical 103% [51 submitted, 1 queued]

2024-10-02T16:27:19.72,INFO,SpawnProcess-1/12256,classical 105% [52 submitted, 0 queued]

2024-10-02T16:27:19.78,INFO,SpawnProcess-1/12256,classical 107% [52 submitted, 0 queued]

2024-10-02T16:27:19.86,INFO,SpawnProcess-1/12256,classical 109% [52 submitted, 0 queued]

2024-10-02T16:27:19.94,INFO,SpawnProcess-1/12256,classical 111% [52 submitted, 0 queued]

2024-10-02T16:27:19.96,INFO,SpawnProcess-1/12256,classical 113% [52 submitted, 0 queued]

2024-10-02T16:27:20.00,INFO,SpawnProcess-1/12256,classical 115% [52 submitted, 0 queued]

2024-10-02T16:27:20.02,INFO,SpawnProcess-1/12256,classical 117% [52 submitted, 0 queued]

2024-10-02T16:27:20.08,INFO,SpawnProcess-1/12256,classical 119% [52 submitted, 0 queued]

2024-10-02T16:27:20.08,INFO,SpawnProcess-1/12256,classical 121% [52 submitted, 0 queued]

2024-10-02T16:27:20.10,INFO,SpawnProcess-1/12256,classical 123% [52 submitted, 0 queued]

2024-10-02T16:27:20.10,INFO,SpawnProcess-1/12256,classical 125% [52 submitted, 0 queued]

2024-10-02T16:27:20.11,INFO,SpawnProcess-1/12256,classical 126% [52 submitted, 0 queued]

2024-10-02T16:27:20.16,INFO,SpawnProcess-1/12256,classical 128% [52 submitted, 0 queued]

2024-10-02T16:27:20.16,INFO,SpawnProcess-1/12256,classical 130% [52 submitted, 0 queued]

2024-10-02T16:27:20.18,INFO,SpawnProcess-1/12256,classical 132% [52 submitted, 0 queued]

2024-10-02T16:27:20.18,INFO,SpawnProcess-1/12256,classical 134% [52 submitted, 0 queued]

2024-10-02T16:27:20.19,INFO,SpawnProcess-1/12256,classical 136% [52 submitted, 0 queued]

2024-10-02T16:27:20.19,INFO,SpawnProcess-1/12256,classical 138% [52 submitted, 0 queued]

2024-10-02T16:27:20.21,INFO,SpawnProcess-1/12256,classical 140% [52 submitted, 0 queued]

2024-10-02T16:27:20.21,INFO,SpawnProcess-1/12256,classical 142% [52 submitted, 0 queued]

2024-10-02T16:27:20.23,INFO,SpawnProcess-1/12256,classical 144% [52 submitted, 0 queued]

2024-10-02T16:27:20.24,INFO,SpawnProcess-1/12256,classical 146% [52 submitted, 0 queued]

2024-10-02T16:27:20.82,INFO,SpawnProcess-1/12256,classical 148% [52 submitted, 0 queued]

2024-10-02T16:27:20.99,INFO,SpawnProcess-1/12256,classical 150% [52 submitted, 0 queued]

2024-10-02T16:27:21.01,INFO,SpawnProcess-1/12256,classical 151% [52 submitted, 0 queued]

2024-10-02T16:27:21.55,INFO,SpawnProcess-1/12256,classical 153% [52 submitted, 0 queued]

2024-10-02T16:27:21.77,INFO,SpawnProcess-1/12256,classical 155% [52 submitted, 0 queued]

2024-10-02T16:27:21.77,INFO,SpawnProcess-1/12256,classical 157% [52 submitted, 0 queued]

2024-10-02T16:27:22.15,INFO,SpawnProcess-1/12256,classical 159% [52 submitted, 0 queued]

2024-10-02T16:27:24.21,INFO,SpawnProcess-1/12256,classical 161% [52 submitted, 0 queued]

2024-10-02T16:27:24.34,INFO,SpawnProcess-1/12256,classical 163% [52 submitted, 0 queued]

2024-10-02T16:27:24.35,INFO,SpawnProcess-1/12256,classical 165% [52 submitted, 0 queued]

2024-10-02T16:27:24.37,INFO,SpawnProcess-1/12256,classical 167% [52 submitted, 0 queued]

2024-10-02T16:27:24.71,INFO,SpawnProcess-1/12256,classical 169% [52 submitted, 0 queued]

2024-10-02T16:27:24.90,INFO,SpawnProcess-1/12256,classical 171% [52 submitted, 0 queued]

2024-10-02T16:27:24.91,INFO,SpawnProcess-1/12256,classical 173% [52 submitted, 0 queued]

2024-10-02T16:27:25.04,INFO,SpawnProcess-1/12256,classical 175% [52 submitted, 0 queued]

2024-10-02T16:27:25.09,INFO,SpawnProcess-1/12256,classical 176% [52 submitted, 0 queued]

2024-10-02T16:27:25.45,INFO,SpawnProcess-1/12256,classical 178% [52 submitted, 0 queued]

2024-10-02T16:27:25.57,INFO,SpawnProcess-1/12256,classical 180% [52 submitted, 0 queued]

2024-10-02T16:27:25.85,INFO,SpawnProcess-1/12256,classical 182% [52 submitted, 0 queued]

2024-10-02T16:27:25.88,INFO,SpawnProcess-1/12256,classical 184% [52 submitted, 0 queued]

2024-10-02T16:27:25.95,INFO,SpawnProcess-1/12256,classical 186% [52 submitted, 0 queued]

2024-10-02T16:27:25.96,INFO,SpawnProcess-1/12256,classical 188% [52 submitted, 0 queued]

2024-10-02T16:27:25.98,INFO,SpawnProcess-1/12256,classical 190% [52 submitted, 0 queued]

2024-10-02T16:27:25.98,INFO,SpawnProcess-1/12256,classical 192% [52 submitted, 0 queued]

2024-10-02T16:27:26.10,INFO,SpawnProcess-1/12256,classical 194% [52 submitted, 0 queued]

2024-10-02T16:27:26.11,INFO,SpawnProcess-1/12256,classical 196% [52 submitted, 0 queued]

2024-10-02T16:27:26.27,INFO,SpawnProcess-1/12256,classical 198% [52 submitted, 0 queued]

2024-10-02T16:27:26.30,INFO,SpawnProcess-1/12256,classical 200% [52 submitted, 0 queued]

2024-10-02T16:27:26.33,INFO,SpawnProcess-1/12256,classical 201% [52 submitted, 0 queued]

2024-10-02T16:27:26.98,INFO,SpawnProcess-1/12256,classical 203% [52 submitted, 0 queued]

2024-10-02T16:27:27.13,INFO,SpawnProcess-1/12256,classical 205% [52 submitted, 0 queued]

2024-10-02T16:27:27.13,INFO,SpawnProcess-1/12256,classical 207% [52 submitted, 0 queued]

2024-10-02T16:27:27.15,INFO,SpawnProcess-1/12256,classical 209% [52 submitted, 0 queued]

2024-10-02T16:27:27.16,INFO,SpawnProcess-1/12256,classical 211% [52 submitted, 0 queued]

2024-10-02T16:27:27.16,INFO,SpawnProcess-1/12256,classical 213% [52 submitted, 0 queued]

2024-10-02T16:27:27.18,INFO,SpawnProcess-1/12256,classical 215% [52 submitted, 0 queued]

2024-10-02T16:27:27.19,INFO,SpawnProcess-1/12256,classical 217% [52 submitted, 0 queued]

2024-10-02T16:27:27.21,INFO,SpawnProcess-1/12256,classical 219% [52 submitted, 0 queued]

2024-10-02T16:27:27.21,INFO,SpawnProcess-1/12256,classical 221% [52 submitted, 0 queued]

2024-10-02T16:27:27.70,INFO,SpawnProcess-1/12256,classical 223% [52 submitted, 0 queued]

2024-10-02T16:27:27.72,INFO,SpawnProcess-1/12256,classical 225% [52 submitted, 0 queued]

2024-10-02T16:27:28.82,INFO,SpawnProcess-1/12256,classical 226% [52 submitted, 0 queued]

2024-10-02T16:27:29.68,INFO,SpawnProcess-1/12256,classical 228% [52 submitted, 0 queued]

2024-10-02T16:27:29.78,INFO,SpawnProcess-1/12256,classical 230% [52 submitted, 0 queued]

2024-10-02T16:27:29.79,INFO,SpawnProcess-1/12256,classical 232% [52 submitted, 0 queued]

2024-10-02T16:27:30.11,INFO,SpawnProcess-1/12256,classical 234% [52 submitted, 0 queued]

2024-10-02T16:27:30.13,INFO,SpawnProcess-1/12256,classical 236% [52 submitted, 0 queued]

2024-10-02T16:27:30.24,INFO,SpawnProcess-1/12256,classical 238% [52 submitted, 0 queued]

2024-10-02T16:27:30.50,INFO,SpawnProcess-1/12256,classical 240% [52 submitted, 0 queued]

2024-10-02T16:27:30.52,INFO,SpawnProcess-1/12256,classical 242% [52 submitted, 0 queued]

2024-10-02T16:27:32.02,INFO,SpawnProcess-1/12256,classical 244% [52 submitted, 0 queued]

2024-10-02T16:27:33.21,INFO,SpawnProcess-1/12256,classical 246% [52 submitted, 0 queued]

2024-10-02T16:27:33.22,INFO,SpawnProcess-1/12256,classical 248% [52 submitted, 0 queued]

2024-10-02T16:27:33.23,INFO,SpawnProcess-1/12256,classical 250% [52 submitted, 0 queued]

2024-10-02T16:27:33.24,INFO,SpawnProcess-1/12256,classical 251% [52 submitted, 0 queued]

2024-10-02T16:27:33.24,INFO,SpawnProcess-1/12256,classical 253% [52 submitted, 0 queued]

2024-10-02T16:27:33.25,INFO,SpawnProcess-1/12256,classical 255% [52 submitted, 0 queued]

2024-10-02T16:27:33.26,INFO,SpawnProcess-1/12256,classical 257% [52 submitted, 0 queued]

2024-10-02T16:27:33.26,INFO,SpawnProcess-1/12256,classical 259% [52 submitted, 0 queued]

2024-10-02T16:27:33.27,INFO,SpawnProcess-1/12256,classical 261% [52 submitted, 0 queued]

2024-10-02T16:27:36.03,INFO,SpawnProcess-1/12256,classical 263% [52 submitted, 0 queued]

2024-10-02T16:27:36.07,INFO,SpawnProcess-1/12256,classical 265% [52 submitted, 0 queued]

2024-10-02T16:27:36.16,INFO,SpawnProcess-1/12256,classical 267% [52 submitted, 0 queued]

2024-10-02T16:27:36.17,INFO,SpawnProcess-1/12256,classical 269% [52 submitted, 0 queued]

2024-10-02T16:27:36.58,INFO,SpawnProcess-1/12256,classical 271% [52 submitted, 0 queued]

2024-10-02T16:27:36.96,INFO,SpawnProcess-1/12256,classical 273% [52 submitted, 0 queued]

2024-10-02T16:27:37.03,INFO,SpawnProcess-1/12256,classical 275% [52 submitted, 0 queued]

2024-10-02T16:27:37.12,INFO,SpawnProcess-1/12256,classical 276% [52 submitted, 0 queued]

2024-10-02T16:27:37.13,INFO,SpawnProcess-1/12256,classical 278% [52 submitted, 0 queued]

2024-10-02T16:27:37.14,INFO,SpawnProcess-1/12256,Mean time per core=20s, std=3.0s, min=17s, max=28s

2024-10-02T16:27:37.14,INFO,SpawnProcess-1/12256,Received 145 * 321.45 KB in 28 seconds [unpik=0.06s] from classical

{'rup_data': '42.4 MB', 'source_data': '1.58 MB', 'rmap': '1.51 MB'}

2024-10-02T16:27:37.15,INFO,SpawnProcess-1/12256,Processing <RateMap(1, 440, 32)[55 KB]>

2024-10-02T16:27:37.20,INFO,SpawnProcess-1/12256,cfactor = 1_115_588/1_115_588 = 1.0

2024-10-02T16:27:37.29,INFO,SpawnProcess-1/12256,Producing 10.31 KB of hazard curves

2024-10-02T16:27:37.29,INFO,SpawnProcess-1/12256,Producing 264 B of hazard maps

2024-10-02T16:27:40.66,WARNING,SpawnProcess-1/12256,Sent 10 postclassical tasks, 0 B

2024-10-02T16:27:40.83,INFO,SpawnProcess-1/12256,postclassical 10% [10 submitted, 0 queued]

2024-10-02T16:27:40.84,INFO,SpawnProcess-1/12256,postclassical 20% [10 submitted, 0 queued]

2024-10-02T16:27:40.84,INFO,SpawnProcess-1/12256,postclassical 30% [10 submitted, 0 queued]

2024-10-02T16:27:40.84,INFO,SpawnProcess-1/12256,postclassical 40% [10 submitted, 0 queued]

2024-10-02T16:27:40.86,INFO,SpawnProcess-1/12256,postclassical 50% [10 submitted, 0 queued]

2024-10-02T16:27:40.86,INFO,SpawnProcess-1/12256,postclassical 60% [10 submitted, 0 queued]

2024-10-02T16:27:40.86,INFO,SpawnProcess-1/12256,postclassical 70% [10 submitted, 0 queued]

2024-10-02T16:27:40.86,INFO,SpawnProcess-1/12256,postclassical 80% [10 submitted, 0 queued]

2024-10-02T16:27:40.86,INFO,SpawnProcess-1/12256,postclassical 90% [10 submitted, 0 queued]

2024-10-02T16:27:40.86,INFO,SpawnProcess-1/12256,postclassical 100% [10 submitted, 0 queued]

2024-10-02T16:27:40.86,INFO,SpawnProcess-1/12256,Received 10 * 768.76 KB in 3 seconds [unpik=0.11s] from postclassical

{'hcurves-rlzs': '7.1 MB', 'hmaps-rlzs': '408.29 KB', 'hcurves-stats': '5.55 KB'}

2024-10-02T16:27:40.86,INFO,SpawnProcess-1/12256,Saving hcurves-rlzs

2024-10-02T16:27:40.90,INFO,SpawnProcess-1/12256,Saving hcurves-stats

2024-10-02T16:27:40.91,INFO,SpawnProcess-1/12256,Saving hmaps-rlzs

2024-10-02T16:27:40.91,INFO,SpawnProcess-1/12256,Saving hmaps-stats

2024-10-02T16:27:40.91,INFO,SpawnProcess-1/12256,The maximum hazard map values are {'PGV': 11.351675, 'PGA': 0.0769339, 'SA(0.05)': 0.09676715, 'SA(0.1)': 0.14788863, 'SA(0.2)': 0.16807862, 'SA(0.3)': 0.15078232, 'SA(0.5)': 0.11761725, 'SA(1.0)': 0.08058997, 'SA(2.0)': 0.061839994, 'SA(5.0)': 0.029287763, 'SA(10.0)': 0.01759428}

2024-10-02T16:27:40.92,INFO,SpawnProcess-1/12256,{'mag': 47, 'dist': 50, 'lon': 1, 'lat': 1, 'eps': 5, 'trt': 5, 'N': 1, 'M': 11, 'P': 1, 'Z': 4096}

2024-10-02T16:27:44.40,INFO,SpawnProcess-1/12256,Building N * M * P * Z = 45_056 intensities

2024-10-02T16:27:44.40,INFO,SpawnProcess-1/12256,Reading contexts

2024-10-02T16:27:44.67,INFO,SpawnProcess-1/12256,Building 4_096 realizations

2024-10-02T16:27:46.37,INFO,SpawnProcess-1/12256,Read 378_523 contexts

2024-10-02T16:27:51.80,WARNING,SpawnProcess-1/12256,Sent 59 compute_disagg tasks, 243.26 MB

2024-10-02T16:28:15.47,INFO,SpawnProcess-1/12256,compute_disagg 1% [59 submitted, 0 queued]

2024-10-02T16:28:17.59,INFO,SpawnProcess-1/12256,compute_disagg 3% [59 submitted, 0 queued]

2024-10-02T16:28:17.60,INFO,SpawnProcess-1/12256,compute_disagg 5% [59 submitted, 0 queued]

2024-10-02T16:28:17.60,INFO,SpawnProcess-1/12256,compute_disagg 6% [59 submitted, 0 queued]

2024-10-02T16:28:17.61,INFO,SpawnProcess-1/12256,compute_disagg 8% [59 submitted, 0 queued]

2024-10-02T16:28:17.62,INFO,SpawnProcess-1/12256,compute_disagg 10% [59 submitted, 0 queued]

2024-10-02T16:28:17.63,INFO,SpawnProcess-1/12256,compute_disagg 11% [59 submitted, 0 queued]

2024-10-02T16:28:17.64,INFO,SpawnProcess-1/12256,compute_disagg 13% [59 submitted, 0 queued]

2024-10-02T16:28:17.65,INFO,SpawnProcess-1/12256,compute_disagg 15% [59 submitted, 0 queued]

2024-10-02T16:28:17.65,INFO,SpawnProcess-1/12256,compute_disagg 16% [59 submitted, 0 queued]

2024-10-02T16:28:17.65,INFO,SpawnProcess-1/12256,compute_disagg 18% [59 submitted, 0 queued]

2024-10-02T16:28:31.74,INFO,SpawnProcess-1/12256,compute_disagg 20% [59 submitted, 0 queued]

2024-10-02T16:28:32.92,INFO,SpawnProcess-1/12256,compute_disagg 22% [59 submitted, 0 queued]

2024-10-02T16:28:34.37,INFO,SpawnProcess-1/12256,compute_disagg 23% [59 submitted, 0 queued]

2024-10-02T16:28:34.69,INFO,SpawnProcess-1/12256,compute_disagg 25% [59 submitted, 0 queued]

2024-10-02T16:28:35.25,INFO,SpawnProcess-1/12256,compute_disagg 27% [59 submitted, 0 queued]

2024-10-02T16:28:35.70,INFO,SpawnProcess-1/12256,compute_disagg 28% [59 submitted, 0 queued]

2024-10-02T16:28:36.32,INFO,SpawnProcess-1/12256,compute_disagg 30% [59 submitted, 0 queued]

2024-10-02T16:28:36.76,INFO,SpawnProcess-1/12256,compute_disagg 32% [59 submitted, 0 queued]

2024-10-02T16:28:37.01,INFO,SpawnProcess-1/12256,compute_disagg 33% [59 submitted, 0 queued]

2024-10-02T16:28:38.89,INFO,SpawnProcess-1/12256,compute_disagg 35% [59 submitted, 0 queued]

2024-10-02T16:28:39.09,INFO,SpawnProcess-1/12256,compute_disagg 37% [59 submitted, 0 queued]

2024-10-02T16:28:39.41,INFO,SpawnProcess-1/12256,compute_disagg 38% [59 submitted, 0 queued]

2024-10-02T16:28:58.18,INFO,SpawnProcess-1/12256,compute_disagg 40% [59 submitted, 0 queued]

2024-10-02T16:28:59.78,INFO,SpawnProcess-1/12256,compute_disagg 42% [59 submitted, 0 queued]

2024-10-02T16:29:01.11,INFO,SpawnProcess-1/12256,compute_disagg 44% [59 submitted, 0 queued]

2024-10-02T16:30:04.81,INFO,SpawnProcess-1/12256,compute_disagg 45% [59 submitted, 0 queued]

2024-10-02T16:31:20.62,INFO,SpawnProcess-1/12256,compute_disagg 47% [59 submitted, 0 queued]

2024-10-02T16:31:27.17,INFO,SpawnProcess-1/12256,compute_disagg 49% [59 submitted, 0 queued]

2024-10-02T16:31:27.56,INFO,SpawnProcess-1/12256,compute_disagg 50% [59 submitted, 0 queued]

2024-10-02T16:31:29.07,INFO,SpawnProcess-1/12256,compute_disagg 52% [59 submitted, 0 queued]

2024-10-02T16:31:30.07,INFO,SpawnProcess-1/12256,compute_disagg 54% [59 submitted, 0 queued]

2024-10-02T16:31:34.92,INFO,SpawnProcess-1/12256,compute_disagg 55% [59 submitted, 0 queued]

2024-10-02T16:31:40.22,INFO,SpawnProcess-1/12256,compute_disagg 57% [59 submitted, 0 queued]

2024-10-02T16:31:45.44,INFO,SpawnProcess-1/12256,compute_disagg 59% [59 submitted, 0 queued]

2024-10-02T16:32:01.94,INFO,SpawnProcess-1/12256,compute_disagg 61% [59 submitted, 0 queued]

2024-10-02T16:32:03.13,INFO,SpawnProcess-1/12256,compute_disagg 62% [59 submitted, 0 queued]

2024-10-02T16:32:06.83,INFO,SpawnProcess-1/12256,compute_disagg 64% [59 submitted, 0 queued]

2024-10-02T16:32:57.86,INFO,SpawnProcess-1/12256,compute_disagg 66% [59 submitted, 0 queued]

2024-10-02T16:33:55.14,INFO,SpawnProcess-1/12256,compute_disagg 67% [59 submitted, 0 queued]

2024-10-02T16:34:27.36,INFO,SpawnProcess-1/12256,compute_disagg 69% [59 submitted, 0 queued]

2024-10-02T16:34:33.31,INFO,SpawnProcess-1/12256,compute_disagg 71% [59 submitted, 0 queued]

2024-10-02T16:34:46.35,INFO,SpawnProcess-1/12256,compute_disagg 72% [59 submitted, 0 queued]

2024-10-02T16:34:47.56,INFO,SpawnProcess-1/12256,compute_disagg 74% [59 submitted, 0 queued]

2024-10-02T16:34:53.47,INFO,SpawnProcess-1/12256,compute_disagg 76% [59 submitted, 0 queued]

2024-10-02T16:34:57.34,INFO,SpawnProcess-1/12256,compute_disagg 77% [59 submitted, 0 queued]

2024-10-02T16:35:01.59,INFO,SpawnProcess-1/12256,compute_disagg 79% [59 submitted, 0 queued]

2024-10-02T16:35:03.15,INFO,SpawnProcess-1/12256,compute_disagg 81% [59 submitted, 0 queued]

2024-10-02T16:35:06.94,INFO,SpawnProcess-1/12256,compute_disagg 83% [59 submitted, 0 queued]

2024-10-02T16:35:08.58,INFO,SpawnProcess-1/12256,compute_disagg 84% [59 submitted, 0 queued]

2024-10-02T16:35:11.95,INFO,SpawnProcess-1/12256,compute_disagg 86% [59 submitted, 0 queued]

2024-10-02T16:35:29.59,INFO,SpawnProcess-1/12256,compute_disagg 88% [59 submitted, 0 queued]

2024-10-02T16:35:32.00,INFO,SpawnProcess-1/12256,compute_disagg 89% [59 submitted, 0 queued]

2024-10-02T16:35:36.32,INFO,SpawnProcess-1/12256,compute_disagg 91% [59 submitted, 0 queued]

2024-10-02T16:36:11.50,INFO,SpawnProcess-1/12256,compute_disagg 93% [59 submitted, 0 queued]

2024-10-02T16:36:45.77,INFO,SpawnProcess-1/12256,compute_disagg 94% [59 submitted, 0 queued]

its nearly 1 hour no updated after  2024-10-02T16:36:45.77,INFO,SpawnProcess-1

[Michele Simionato]

The only way issues can be debugged is if you send us the job.zip file.

[Michele Simionato]

On Thursday, October 3, 2024 at 4:42:58 PM UTC+2 asu...@gmail.com wrote:

Hi Michele.

this is the file i am working on. As mentioned earlier this job.ini file run smoothly for 3.19 to 3.20 without an issue. i want to use 3.21 for Conditional spectrum analysis.  i update open quake to 3.21 and run the Disaggregation and it stucked in 94%. 

if i run same file in 3.19 or 3.20 it gives the result. i don't know what is happening.

For me the calculation runs the same both with engine-3.21 and engine-3.20, engine-3.21 being marginally faster. There is a cosmetic bug in engine-3.21 so that the progress goes over 100% (already fixed) but it is not affecting anything else.

I will notice that you are using a huge amount of memory and indeed this line in your log {'mag': 47, 'dist': 50, 'lon': 1, 'lat': 1, 'eps': 5, 'trt': 5, 'N': 1, 'M': 11, 'P': 1, 'Z': 4096}

tells me that your binning parameters are wrong (47 magnitude bins is too much, 50 distance bins is too much) and you are doing a calculation larger than it should be.

The most likely explanation for your problem is that you are running out of memory; reducing the maximum_distance and/or the binning parameters will solve it.

Please see also this FAQ: https://docs.openquake.org/oq-engine/master/manual/user-guide/extras/faq.html#i-am-getting-an-error-disaggregation-matrix-is-too-large

                    Michele

[Sujan Raj Adhikari]

I aggreged on that my binning parameters are high but i can easily run in previous version of OQ 3.19 and 3.20 without any issue but only having this in this 3.21 version. I again re install it to 3.20 and it runs smoothly without any issues.  this is what I am not understanding. 

[Sujan Raj Adhikari]

Hello Michele,

I wanted to let you know that I’m using a bin of 0.1 for Magnitude and a distance of 30 km, and it’s working well now . However, I’m having same issues mentioned earlier when I try to use the same bin of 0.1 for a distance of 20 km (previous version working well). I understand that there is a memory issues with this new version (3.21).

On a positive note, I’m pleased that we can create conditions spectra in this version. Thank you very much for your comments!