Skip to content

OpenQuake Engine 2.0
Compare
Choose a tag to compare
@nastasi-oq nastasi-oq released this 21 Jun 12:56
· 153989 commits to master since this release
v2.0.0
52593ac

[Michele Simionato (@micheles)]

  • Quoted the taxonomies in the CSV exports
  • Fixed a bug in classical_damage and added a master test for it
  • Fixed the escaping of the taxonomies in the datastore
  • Fixed the names of the exported risk files
  • Fixed a segfault in the WebUI when exporting files with h5py >= 2.4
  • Added a command oq dbserver to start/stop the database server
  • The engine exports the hazard curves one file per IMT
  • Exported lon and lat with 5 digits after the decimal point
  • Added a command oq info --build-reports
  • Introduced experimental support for exporting .hdf5 files

[Daniele Viganò (@daniviga)]

  • Reworked substantially the engine documentation: removed obsolete pages,
    updated to engine 2.0 and added instructions for Windows and Mac OS X
  • Remove oq_create_db script, db is created by the DbServer
  • Move oq_reset_db into utils and clean old code

[Michele Simionato (@micheles)]

  • Now the DbServer automatically upgrades the database if needed
  • Renamed oq-lite -> oq and added a subcommand oq engine
  • Added a CSV reader for the hazard curves
  • Having time_event=None in the hazard part of a calculation is now valid
  • Added an exporter for the rupture data, including the occurrence rate
  • Refactored the CSV exporters
  • Moved celeryconfig.py; now celery must be started with
    celery worker --config openquake.engine.celeryconfig
  • Added a default location ~/oqdata/dbserver.log for the DbServer log
  • Added an early check on the SA periods supported by the GSIMs
  • Now the gsim_logic_tree file is parsed only once
  • Added a document about the architecture of the engine
  • The realizations are now exported as a CSV file
  • Escaped taxonomies in the datastore
  • The Web UI log tool is now escaping the HTML
  • Moved openquake.commonlib.commands -> openquake.commands and
    openquake.commonlib.valid -> openquake.risklib.valid to have a
    linear tower of internal dependencies
  • Supported all versions of Django >= 1.5
  • Provided a better error message in the absence of openquake.cfg
  • Removed the check on the export_dir when using the WebUI
  • Reduce the data transfer of the realization association object
  • If uniform_hazard_spectra is true, the UHS curves are generated
    even if hazard_maps is false; the hazard maps are not exported
  • Optimized the filtering of PointSources
  • Initial work on the UCERF event based hazard calculator
  • Added a test calculation crossing the International Date Line (Alaska)

[Daniele Viganò (@daniviga)]

  • Remove the dependency from the python 'pwd' package which is not
    available on Windows
  • Supervisord init scripts are now provided for the dbserver, celery
    and the webui. Celery is not started by default, other two are.

[Michele Simionato (@micheles)]

  • Another export fix: made sure it is run by the current user
  • Fixed the export: if the export directory does not exists, it is created
  • Introduced the configuration variable multi_user, false for source
    installations and true for package installations
  • Fixed the WebUI export
  • Removed the .txt outputs from the WebUI page engine/<output_id>/outputs
    (they are useful only internally)
  • Fixed the export: first the xml exporter is tried and then the csv exporter;
    if both are available, only the first is used, not both of them
  • Optimized the case when the epsilons are not required, i.e. all the
    covariance coefficients are zero in the vulnerability functions
  • Added another test for event based risk (case_miriam)
  • Revisited the distribution mechanism and refined the weight of the
    ruptures in the event based calculators to avoid generating slow tasks
  • Added an automatic help for the subcommands of oq-lite and managed
    --version correctly
  • The event based risk calculator now use different seeds for different
    realizations; also, the performance has been substantially improved
  • Improved the .rst reports with data transfer information
  • Removed the RlzsAssoc object from the datastore
  • Fixed the number of tasks generated by the risk calculators
  • Refactored the serialization of CompositionInfo instances to HDF5
  • Used exponential notation with 5 decimal digits in most exported XML files
  • Refactored the sampling mechanics in the event based calculators
  • The event_based_risk calculator infers the minimum intensity of the GMFs
    from the vulnerability functions (if not specified in the job.ini)
  • Fixed the avg_losses-stats: they were not generated in absence of
    loss curves
  • Added a command oq-lite info --exports
  • Added filtering on the mininum intensity also in the event based
    hazard calculator; improved the performance and memory occupation
  • Added a view displaying the calculation times by source typology
  • Fixed the test of GMPETable after the correction in hazardlib
  • Optimized the saving of the asset loss table
  • Optimized the case of multiple assets of the same taxonomy on the
    same point and introduced a datastore view assets_by_site
  • Fixed HDF5 segmentation faults in the tests for Ubuntu 16.04

[Daniele Viganò (@daniviga)]

  • Add support for Ubuntu 16.04 (xenial) packages
  • Removed the openquake_worker.cfg file because it is not used anymore

[Michele Simionato (@micheles)]

  • Replaced PostgreSQL with SQLite
  • Introduced a dbserver to mediate the interaction with the database
  • Restored the signal handler to manage properly kill signals so that
    the workers are revoked when a process is killed manually
  • Fixed in a more robust way the duplicated log bug
  • Made more robust the killing of processes by patching concurrent.futures
  • Fixed a critical bug with celery not being used even when use_celery
    was true.
  • Improved the validation of NRML files
  • Added a command oq-engine --show-log <job_id>

[Daniele Viganò (@daniviga)]

  • Use the 'postgresql' meta package as dependency of the .deb
    package to support newer versions of Postgres; this makes
    Trusty package installable on Ubuntu 16.04 and Debian 8

[Daniele Viganò (@daniviga), Michele Simionato (@micheles)]

  • Fixed a bug in oq-engine --export-outputs

[Daniele Viganò (@daniviga), Matteo Nastasi (@nastasi-oq)]

  • Allow installation of the binary package on Ubuntu derivatives

[Matteo Nastasi (@nastasi-oq)]

  • Backport of libhdf5 and h5py for ubuntu 'precise' serie

[Michele Simionato (@micheles)]

  • Removed openquake/engine/settings.py
  • Made the dependency on celery required only in cluster installations
  • Integrated the authentication database in the engine server database
  • Fixed the description in the Web UI (before it was temporarily set to
    the string "A job").
  • Introduced filtering on the minimum intensity of the ground shaking
  • Solved the issue of serializing large SES collections, over the HDF5 limit
  • The loss maps and curves XML exporters now export the coordinates
    of the assets, not the coordinates of the closest hazard site
  • Stored the job.ini parameters into a table in the datastore
  • Added a check on the IMTs coming from the risk models
  • Changed the aggregate loss table exporter to export the event tags,
    not the event IDs
  • Fixed a bug with the CSV export of the ground motion fields
  • Fixed a bug with the export of UHS curves with --exports=xml
  • Reduced substantially the data transfer and the memory occupation
    for event based calculations with a large number of assets: we
    can run the California exposure with half million assets now
  • Fixed a bug in the SESCollection exporter
  • Changed the asset<->epsilons association: before for a given taxonomy the
    assets were ordered by asset_ref, now they are ordered by id. This
    has a minor impact on the numbers sensitive to the epsilons, akin to a
    change of seeds
  • Added a test on the ordering of the epsilons
  • Accepted . and | as valid characters for source IDs
  • Changed the GMF calculator to use a single seed per unique rupture
  • Changed the SESCollection exporter: now a single file is exported, before
    we were exporting one file per source model path per tectonic region model
  • Changed the event based calculators to avoid duplicating ruptures
    occurring more than once
  • Changed the risk calculators to work in blocks of assets on the same site
  • Made it possible to set different integration distances for different
    tectonic region types
  • Optimized the aggregation by asset in the event based risk calculator
  • Reporting the source_id when the filtering fails
Assets 2
Loading