Skip to content

Releases: HumanCellAtlas/pipeline-tools

v0.21.1

14 Jun 19:59
1345340
Compare
Choose a tag to compare
  • Fix stub submission wdl to include analysis_file_version parameter

v0.21.0

14 Jun 16:48
90eba0a
Compare
Choose a tag to compare
  • Fix the order of stage and confirm tasks
  • Pass Cromwell automated retries parameter to analysis wdl
  • Add support for changes to HCA metadata schema
    • Update the analysis json file to follow the "process" to "protocol" schema changes
    • Update getting the sample id from links_json

v0.20.0

04 Jun 20:29
3eb2096
Compare
Choose a tag to compare
  • The Python codes in adapter workflows are not using buffering now, so the stdouts won’t run into some intermittent-empty problems.
  • The stub submit workflow now uses a slim version of Python docker image for efficiency.
  • All the requests to Ingest now will retry on ReadTimeout exception by default, in case Ingest is unavailable.
  • Submit workflow now has separate stage_files and confirm_submission tasks, this decoupled structure helps debugging and workflow management.
  • Some documentation style fixes.

v0.19.0

19 May 13:12
bbfd6e1
Compare
Choose a tag to compare

Added the ability to optionally record HTTP requests and responses made by pipeline-tools code.

Retry logic has been centralized and all retry parameters like timeout and max interval are now exposed as workflow parameters in the Smart-seq2 WDL. A timeout for individual requests has been added and exposed as a workflow parameter for Smart-seq2.

ConnectionErrors are now retried. 4xx errors are no longer retried.

v0.18.0

11 May 18:55
64858c8
Compare
Choose a tag to compare

This release covers:

  1. Set up monitor scripts for the workflows started by Lira as Cromwell option files.
  2. Fix the dcp-integration test by upgrading the hca cli the pipeline-tools is using.

v0.17.0

30 Apr 21:31
afca52e
Compare
Choose a tag to compare
  • Add retries when making requests to the HCA data storage service and ingestion service, using the tenacity python library to add exponential wait times and timeouts.
  • Simplify the retry logic for getting the staging urn and checking if the submission status is valid.
  • Add auto-build documentation with Sphinx and hook up to readthedocs.io

v0.16.0

19 Apr 18:26
c66b745
Compare
Choose a tag to compare

Update submit.wdl to work with Cromwell-as-a-Service

v0.15.0

12 Apr 20:21
7965190
Compare
Choose a tag to compare
  • Move embedded python code from get_metadata task into a python script
  • Use the retry decorator from the tenacity python library to retry the request to get metadata from Cromwell, with exponentially larger wait times in between requests.
  • Add unit tests for get_analysis_metadata.py
  • Freeze package versions in requirements.txt

v0.14.0

27 Mar 00:19
54408d9
Compare
Choose a tag to compare

Update submit.wdl to follow the v5.1.0 metadata schema.

v0.13.0

25 Mar 16:35
506f6c8
Compare
Choose a tag to compare

Remove environment-specific urls for the HCA data storage service and ingestion service from the static input files.