Skip to content

Releases: HumanCellAtlas/pipeline-tools

v0.29.0

18 Sep 17:55
0f04daf
Compare
Choose a tag to compare
  • Removed a lot of unused files in the repo.
  • Instead of querying Cromwell during the submission, pipeline-tools is getting the versions of the pipelines directly from the WDL files.

v0.28.2

12 Sep 19:51
65fe001
Compare
Choose a tag to compare

Add cromwell maxRetries runtime parameter to the submit wdl tasks "get_metadata" and "stage_files"

v0.28.1

12 Sep 17:48
c8055cd
Compare
Choose a tag to compare
  • Update to use hca CLI version v4.4.0, which fixes changed the mechanism to throw exceptions when an error occurs.

v0.28.0

11 Sep 16:12
9b805ea
Compare
Choose a tag to compare
  • Retry HTTP requests with a 409 status code

v0.27.0

11 Sep 14:07
237830f
Compare
Choose a tag to compare
  • Use CaaS Prod within the Cromwell-metadata docker image, which is used in Submit WDL task.

v0.26.0

07 Sep 16:55
8a76d91
Compare
Choose a tag to compare

Changes

  • Optimus works with latest schema and bundle structure
  • Adding md5 checksums to results bundle metadata is optional and turned off by default due to HumanCellAtlas/secondary-analysis#287

v0.25.0

25 Aug 03:09
c6c11a2
Compare
Choose a tag to compare

Changes

  • [Breaking Change] Update to the latest HCA metadata schema:

    • analysis_json now is split into analysis_process and analysis_protocol, the former varies between runs, while the latter remains almost static given a specific version of the analysis pipeline.
    • Link analysis_protocol to analysis_process during the process of creating the submission envelope.
    • Update the testing data.
    • Update both SmartSeq2 and Optimus adapter workflows accordingly.
  • [Breaking Change] Update to the latest Bundle structure proposed by Ingest service, which breaks metadata file into smaller separate files.

  • [Breaking Change] Migrate to use the centralized metadata-api to prepare inputs for analysis pipelines. Leaving the part for preparing inputs for Optimus pipeline broken intentionally.

  • [Breaking Change] Migrate to Python3 and drop support for Python 2.x, update the dockerfile accordingly.

  • Migrate from unittest to pytest throughout the code base, update most of the testing cases, introduces a set of new testing fixtures.

  • Remove the redundant 10x adapter workflows.

  • Update the cromwell-metadata docker image.

v0.24.0

26 Jul 14:48
9cdf9b5
Compare
Choose a tag to compare
  • Add "schema_url" parameter to configure with HCA metadata schemas to use when constructing the analysis JSON

v0.23.0

17 Jul 18:58
94ff74e
Compare
Choose a tag to compare

In this release

  • Respect Retry-After headers when following redirects (#61)
  • Submit real md5 checksums along with pipeline outputs (#59)
  • Make submission tasks idempotent (#58)

v0.22.0

02 Jul 17:58
fb38b1b
Compare
Choose a tag to compare

In this release

  • Update to v4 hca cli
  • Restrict dependencies to a single major version
  • Add logging related to http request retries
  • Fix bug in parsing analysis workflow id from Cromwell metadata