[Bug 1096926] [NEW] OQ-Engine: define hazard tasks only for sources that are close to the region of interest

[Damiano Monelli]

Public bug reported:

Currently, hazard calculations are parallelized over sources (i.e. for
each source in a source model a task is created).

It can happen that a source model is defined over a large geographical
region (say US) but the region of interest is only a portion of it (say
California). However, in the current set up, we create tasks for all
sources in a source model, even for those sources that are evidently too
far (say sources that are on the east coast). For each of these tasks
distance calculations are also performed (to remove sites that are too
far from the source)

To avoid the creation of unneeded tasks, the locations where hazard
results need to be computed for can be saved into the DB, and tasks can
be created only for sources for which the 'rupture enclosing polygon'
(already saved into the DB) and dilated by maximum_distance intersect
the bounding box of the locations of interest.

** Affects: openquake
Importance: Undecided
Status: New

--
You received this bug notification because you are subscribed to
OpenQuake.
Matching subscriptions: openquake-bugs
https://bugs.launchpad.net/bugs/1096926

Title:
OQ-Engine: define hazard tasks only for sources that are close to the
region of interest

Status in OpenQuake:
New

Bug description:
Currently, hazard calculations are parallelized over sources (i.e. for
each source in a source model a task is created).

It can happen that a source model is defined over a large geographical
region (say US) but the region of interest is only a portion of it
(say California). However, in the current set up, we create tasks for
all sources in a source model, even for those sources that are
evidently too far (say sources that are on the east coast). For each
of these tasks distance calculations are also performed (to remove
sites that are too far from the source)

To avoid the creation of unneeded tasks, the locations where hazard
results need to be computed for can be saved into the DB, and tasks
can be created only for sources for which the 'rupture enclosing
polygon' (already saved into the DB) and dilated by maximum_distance
intersect the bounding box of the locations of interest.

To manage notifications about this bug go to:
https://bugs.launchpad.net/openquake/+bug/1096926/+subscriptions

[Lars Butler]

Here's how I'm thinking about implementing this:

- When the source model is first read, the raw xml is saved into the DB.
- When we parse the source model, currently we store each source into the `parsed_source` table.
- The proposed change here is that we perform this filtering and don't store sources that are too far outside of the region of interest.
- This means that tasks would only be created for the relevant (filtered set of) sources.

** Changed in: openquake
Status: New => Confirmed

** Changed in: openquake
Milestone: None => 0.9.1

** Changed in: openquake
Assignee: (unassigned) => Lars Butler (lars-butler)

** Changed in: openquake
Importance: Undecided => Medium

--
You received this bug notification because you are subscribed to
OpenQuake.
Matching subscriptions: openquake-bugs
https://bugs.launchpad.net/bugs/1096926

Title:
OQ-Engine: define hazard tasks only for sources that are close to the
region of interest

Status in OpenQuake:

Confirmed

[Lars Butler]

** Tags added: hazard optimization

--
You received this bug notification because you are subscribed to
OpenQuake.
Matching subscriptions: openquake-bugs
https://bugs.launchpad.net/bugs/1096926

Title:
OQ-Engine: define hazard tasks only for sources that are close to the
region of interest

Status in OpenQuake:

Confirmed

[Lars Butler]

** Changed in: openquake
Status: Confirmed => In Progress

--
You received this bug notification because you are subscribed to
OpenQuake.
Matching subscriptions: openquake-bugs
https://bugs.launchpad.net/bugs/1096926

Title:
OQ-Engine: define hazard tasks only for sources that are close to the
region of interest

Status in OpenQuake:

In Progress

[Lars Butler]

If we go with the approach suggested in
https://bugs.launchpad.net/openquake/+bug/1096926/comments/1, this has
an implication on input reuse.

This means that the first calculation to use that input will do
filtering specific to its input parameters. The next calculation that
runs, with the same input but different calculation geometry will get
the wrong filtered set of sources if it reuses the input.

Honestly, I don't see this input reuse feature being used, nor do I see
any major benefit in keeping. I think we should just remove it.

--
You received this bug notification because you are subscribed to
OpenQuake.
Matching subscriptions: openquake-bugs
https://bugs.launchpad.net/bugs/1096926

Title:
OQ-Engine: define hazard tasks only for sources that are close to the
region of interest

Status in OpenQuake:

In Progress