OpenQuake Engine 3.3.0
[Graeme Weatherill (@g-weatherill)]
- Adds GMPE suite for national PSHA for Germany
[Daniele Viganò (@daniviga)]
- Added a warning box when an unsupported browser is used to view the WebUI
- Updated Docker containers to support a multi-node deployment
with a shared directory - Moved the Docker containers source code from oq-builders
- Updated the documentation related to the shared directory
which is now mandatory for multi-node deployments
[Matteo Nastasi (@nastasi-oq)]
- Removed tests folders
[Stéphane Drouet (@stephane-on)]
- Added Drouet & Cotton (2015) GMPE including 2017 erratum
[Michele Simionato (@micheles)]
- Optimized the memory occupation in classical calculations (Context.poe_map)
- Fixed a wrong counting of the ruptures in split fault sources with
an hypo_list/slip_list causing the calculation to fail - Made the export of uniform hazard spectra fast
- Made the
std
hazard output properly exportable - Replaced the
~
in the header of the UHS csv files with a-
- Restored the
individual_curves
flag even for the hazard curves - Implemented dGMPE weights per intensity measure type
- Extended
--reuse-hazard
to all calculators - Fixed a bug in event_based_risk from GMFs with coefficients of variations
[Graeme Weatherill (@g-weatherill)]
- Adds magnitude scaling relation for Germany
[Michele Simionato (@micheles)]
- Used floats for the the GSIM realization weights, not Python Decimals
- Added a flag
fast_sampling
, by default False - Added an API
/extract/src_loss_table/<loss_type>
- Removed the rupture filtering from
sample_ruptures
and optimized it in
theRuptureGetter
by making use of the bounding box - Raised the limit on
ses_per_logic_tree_path
from 216 to 232; - Added a parameter
max_num_sites
to increase the number of sites accepted
by an event based calculation up to 2 ** 32 (the default is still 2 ** 16) - Added a command
oq compare
to compare hazard curves and maps within
calculations - Extended the engine to read transparently zipped source models and exposures
- Restored the check for invalid source IDs in applyToSources
- Extended the command
oq zip
to zip source models and exposures - Parallelized the associations event ID -> realization ID
- Improved the message when assets are discarded in scenario calculations
- Implemented aggregation by multiple tags, plus a special case for the
country code in event based risk
[Marco Pagani (@mmpagani)]
- Added two modified versions of the Bindi et al. (2011) to be used in a
backbone approach to compute hazard in Italy - Added a modified version of Berge-Thierry et al. 2003 supporting Mw
[Michele Simionato (@micheles)]
- Changed the way loss curves and loss maps are stored in order to unify
the aggregation logic with the one used for the average losses - Now it is possible to compute the ruptures without specifying the sites
- Added an early check for the case of missing intensity measure types
- Deprecated the case of exposure, site model and region_grid_spacing all
set at the same time - Implemented multi-exposure functionality in event based risk
- Changed the event based calculator to store the ruptures incrementally
without keeping them all in memory - Refactored the UCERF event based calculator to work as much as possible
the regular calculator - Optimized the management and storage of the aggregate losses in the event
based risk calculation; also, reduced the memory consumption - Changed the default for
individual_curves
to "false", which is the right
default for large calculations - Optimized the saving of the events
- Removed the
save_ruptures
flag in the job.ini since ruptures must be saved
always - Optimized the rupture generation in case of sampling and changed the
algorithm and seeds - Fixed a bug with the IMT
SA(1)
considered different fromSA(1.0)
- Removed the long-time deprecated GMF exporter in XML format for event_based
- Added a re-use hazard feature in event_based_risk in single-file mode
- Made the event ID unique also in scenario calculations with
multiple realizations - Removed the annoying hidden .zip archives littering the export directory
- Added an easy way to read the exposure header
- Added a way to run Python scripts using the engine libraries via
oq shell
- Improved the minimum_magnitude feature
- Fixed the check on missing hazard IMTs
- Reduced substantially the memory occupation in event based risk
- Added the option
spatial_correlation=no correlation
for risk calculations
from ShakeMaps - Removed the experimental calculator
ucerf_risk
- Optimized the sampling of time-independent sources for the case of
prefilter_sources=no
- Changed the algorithm associating events to SESs and made the event based
hazard calculator faster in the case of many SESs - Reduced substantially the memory consumption in event based risk
- Made it possible to read multiple site model files in the same calculation
- Implemented a smart single job.ini file mode for event based risk
- Now warnings for invalid parameters are logged in the database too
- Fixed
oq export avg_losses-stats
for the case of one realization - Added
oq export losses_by_tag
andoq export curves_by_tag
- Extended
oq export
to work in a multi-user situation - Forbidden event based calculations with more than
max_potential_paths
in the case of full enumeration - Saved a large amount of memory in event_based_risk calculations
- Added a command
oq export losses_by_tag/<tagname> <calc_id>
- Extended
oq zip
to zip the risk files together with the hazard files - Changed the building convention for the event IDs and made them unique
in the event loss table, even in the case of full enumeration - Optimized the splitting of complex fault sources
- Fixed the ShakeMap download procedure for
uncertainty.zip
archives
with an incorrect structure (for instance for ci3031111) - Disabled the spatial correlation in risk-from-ShakeMap by default
- Optimized the rupture sampling where there is a large number of SESs
- Extended the
reqv
feature to multiple tectonic region types and
removed the spinning/floating for the TRTs using the feature - Reduced the GMPE logic tree upfront for TRTs missing in the source model
- Fixed the ShakeMap downloader to use the USGS GeoJSON feed
- Improved the error message when there are more than 65536 distinct tags
in the exposure - Turned
vs30measured
into an optional parameter
[Chris Van Houtte (@cvanhoutte)]
- Added
siteclass
as a site parameter, andreference_site_class
as
a site parameter than can be specified by the user in the ini file - Added new classes to mcverry_2006.py to take siteclass as a predictor
- Updated comments in mcverry_2006.py
- Added new mcverry_2006 test tables to account for difference in site
parameter - Added qa_test_data classical case_32
[Michele Simionato (@micheles)]
- Fixed the rupture exporter for Canada
- Extended the
oq prepare_site_model
to optionally generate the
fields z1pt0, z2pt5 and vs30measured - It is now an error to specify both the sites and the site model in the
job.ini, to avoid confusion with the precedency - Implemented a reader for site models in CSV format
- Made the export_dir relative to the input directory
- Better error message for ShakeMaps with zero stddev
- Added a source_id-filtering feature in the job.ini
- Added a check on non-homogeneous tectonic region types in a source group
- Fixed the option
oq engine --config-file
that broke a few releases ago - Replaced
nodal_dist_collapsing_distance
and
hypo_dist_collapsing_distance
withpointsource_distance
and made
use of them in the classical and event based calculators
[Graeme Weatherill (@g-weatherill)]
- Fixes to hmtk completeness tables for consistent rates and addition of
more special methods to catalogue
[Michele Simionato (@micheles)]
- Restricted ChiouYoungs2008SWISS01 to StdDev.TOTAL to avoid a bug
when computing the GMFs with inter/intra stddevs - Raised an error if assets are discarded because too far from the hazard
sites (before it was just a warning) - Added an attribute .srcidx to every event based rupture and stored it
- Fixed an issue with the Byte Order Mark (BOM) for CSV exposures prepared
with Microsoft Excel - Reduced the site collection instead of just filtering it; this fixes
a source filtering bug and changes the numbers in case of GMF-correlation - Added a command
oq prepare_site_model
to prepare a sites.csv file
containing the vs30 and changed the engine to use it - Added a cutoff when storing a PoE=1 from a CSV file, thus avoiding NaNs
in classical_damage calculations - Reduced the data transfer in the risk model by only considering the
taxonomies relevant for the exposure - Extended
oq engine --run
to accept a list of files - Optimized the saving of the risk results in event based in the case of
many sites and changed the commandoq show portfolio_loss
to show
mean and standard deviation of the portfolio loss for each loss type
[Marco Pagani (@mmpagani)]
- Added a first and preliminary version of the GMM for the Canada model
represented in an analytical form. - Added a modified version of Atkinson and Macias to be used for the
calculation of hazard in NSHMP2014. - Added support for PGA to the Si and Midorikawa (1999).
[Michele Simionato (@micheles)]
- Made it possible to run the risk over an hazard calculation of another user
- Worked around the OverflowError: cannot serialize a bytes object larger
than 4 GiB in event based calculations - Started using Python 3.6 features
- Fixed the check on vulnerability function ID uniqueness for NRML 0.5
- Ruptures and GMFs are now computed concurrently, thus mitigating the
issue of slow tasks - Changed the name of the files containing the disaggregation outputs:
instead of longitude and latitude they contain the site ID now - If a worker runs close to out of memory, now a warning appears in the
main log - 'lons' and 'lats' are now spelled 'lon' and 'lat' in
the REQUIRES_SITES_PARAMETERS to be consistent with site_model.xml
[Daniele Viganò (@daniviga)]
- Fixed a bug about 'The openquake master lost its controlling terminal'
when running with 'nohup' from command line
[Michele Simionato (@micheles)]
- The
export_dir
is now created recursively, i.e. subdirectories are
automatically created if needed - Fixed a bug with the minimum_magnitude feature and extended it to be
tectonic region type dependent - Changed the rupture generation to yield bunches of ruptures, thus avoiding
the 4GB pickle limit - Parallelized the splitting of the sources, thus making the preprocessing
faster
[Marco Pagani (@mmpagani)]
- Implemented two additional versions of the Silva et al. 2002 GMPE
- Added the possibility of setting rake to 'undefined'
- Added first 'modified GMPE' implementing the site term for Canada 2015 model
- Fixed a bug in the disaggregation calculation due to wrong binning of magnitudes
[Michele Simionato (@micheles)]
- Now the combination uniform_hazard_spectra=true and mean_hazard_curves=false
is accepted again, as requested by Laurentiu Danciu (@danciul)
[Daniele Viganò (@daniviga)]
- Support for Ubuntu Trusty is removed
- Replaced supervisord with systemd in Ubuntu packages
[Michele Simionato (@micheles)]
- Changed the way the rupture geometries are stored to be consistent with
the source geometries - We are now saving information about the source geometries in the datastore
(experimentally) - Fixed a bug in event based with sampling causing incorrect GMFs
- Unified all distribution mechanisms to returns the outputs via zmq
- Added a check for inconsistent IMTs between hazard and risk
- Replaced the forking processpool with a spawning processpool