Reshape propagation to enable broadcast(transpose) -> attention(q, kt, vt) fusion. #33488
Job | Run time |
---|---|
6s | |
1m 21s | |
2m 17s | |
3m 28s | |
1m 27s | |
1m 13s | |
1m 4s | |
2m 14s | |
2m 38s | |
1m 2s | |
18m 37s | |
16m 3s | |
20m 54s | |
2s | |
1h 12m 26s |
Job | Run time |
---|---|
6s | |
1m 21s | |
2m 17s | |
3m 28s | |
1m 27s | |
1m 13s | |
1m 4s | |
2m 14s | |
2m 38s | |
1m 2s | |
18m 37s | |
16m 3s | |
20m 54s | |
2s | |
1h 12m 26s |