You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Sequence packing is a very useful feature.
There are two places in the document (as shown in the following) that mention the performance improvement of sequence packing, but the data differs greatly.
10x performance improvement is unthinkable. Is it a typo?
shifangx
changed the title
in doc, performance improvement of sequence packing is claimed to be as higher as 10x, Is it a typo?
In doc, performance improvement of sequence packing is claimed to be as higher as 10x. Is it a typo?
Jan 10, 2025
shifangx
changed the title
In doc, performance improvement of sequence packing is claimed to be as higher as 10x. Is it a typo?
[doc] [typo] The performance improvement of sequence packing is claimed to be as higher as 10x. Is it a typo?
Jan 10, 2025
Sequence packing is a very useful feature.
There are two places in the document (as shown in the following) that mention the performance improvement of sequence packing, but the data differs greatly.
10x performance improvement is unthinkable. Is it a typo?
https://docs.nvidia.com/nemo-framework/user-guide/latest/nemotoolkit/features/optimizations/sequence_packing.html
https://docs.nvidia.com/nemo-framework/user-guide/latest/nemotoolkit/multimodal/mllm/sequence_packing.html
The text was updated successfully, but these errors were encountered: