Skip to content

Commit

Permalink
add description for work directory
Browse files Browse the repository at this point in the history
  • Loading branch information
kubranarci committed Aug 21, 2024
1 parent 9a90762 commit 4184d06
Showing 1 changed file with 2 additions and 0 deletions.
2 changes: 2 additions & 0 deletions episodes/10-workflow_checkpoint_caching.md
Original file line number Diff line number Diff line change
Expand Up @@ -86,6 +86,8 @@ You will see that the execution of the process `NUMLINES` is actually skipped (c

## How does resume work?

Nextflow stores all intermediate files and task results during the execution of a workflow is `work` directory. It acts as a scratch space where all the temporary data required for the workflow's execution is kept. Within the work directory, Nextflow creates subdirectories named with unique hashes (e.g., work/ab/cd1234...). Each of these subdirectories corresponds to a specific process or task in the pipeline. The hashed directory names ensure that each task's outputs are isolated and uniquely identified.

The mechanism works by assigning a unique ID to each task. This unique ID is used to create a separate execution directory, within the `work` directory, where the tasks are executed and the results stored. A task's unique ID is generated as a 128-bit hash number obtained from a composition of the task's:

- Inputs values
Expand Down

0 comments on commit 4184d06

Please sign in to comment.