Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adding stream.tensor.dispatch op. #19817

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

benvanik
Copy link
Collaborator

This allows us to carry tensor encodings from higher levels of the stack down to where we now need them during the specialize encodings pass. Once the encodings are consumed the new op can be lowerd back into a stream.async.dispatch with the encodings erased.

Fixes #19806.

@benvanik benvanik added the compiler/dialects Relating to the IREE compiler dialects (flow, hal, vm) label Jan 25, 2025
@benvanik benvanik requested a review from hanhanW January 25, 2025 17:39
@benvanik benvanik force-pushed the users/benvanik/tensor-dispatch branch 2 times, most recently from b085879 to 36531c6 Compare January 25, 2025 20:05
This allows us to carry tensor encodings from higher levels of the stack
down to where we now need them during the specialize encodings pass.
Once the encodings are consumed the new op can be lowerd back into a
`stream.async.dispatch` with the encodings erased.

Fixes #19806.
@benvanik benvanik force-pushed the users/benvanik/tensor-dispatch branch from 36531c6 to 46bdf46 Compare January 25, 2025 20:21
@benvanik benvanik marked this pull request as ready for review January 25, 2025 20:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
compiler/dialects Relating to the IREE compiler dialects (flow, hal, vm)
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add a stream.tensor.dispatch op for encoding tensor types.
1 participant