Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support calling subgraph even if position hashes of inputs changed #194

Closed
windiana42 opened this issue May 17, 2024 · 0 comments · Fixed by #202
Closed

Support calling subgraph even if position hashes of inputs changed #194

windiana42 opened this issue May 17, 2024 · 0 comments · Fixed by #202

Comments

@windiana42
Copy link
Member

A work practice might be to develop on a small pipeline instance and only merge changes to main branch if a single task on the full pipeline is validated based on certain expectations. In this scenario, cache invalidation is ignored and the desire is to run single tasks none-the-less. The main obstacle here is the position hash check when pulling inputs to the subgraph that should be run (see #193).

Thus it would be nice to have an option that disables position hash checks when looking for inputs of the subgraph that is run. A warning or error may be raised in case either the cache lookup table or the current graph indicate that multiple instances of the task exist(ed) in the graph.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant