Skip to content

Commit

Permalink
review: add comments in Qwen2ForSampling
Browse files Browse the repository at this point in the history
  • Loading branch information
dacorvo committed Dec 5, 2024
1 parent 113810e commit 6012a37
Showing 1 changed file with 7 additions and 1 deletion.
8 changes: 7 additions & 1 deletion optimum/neuron/models/qwen2/model.py
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,13 @@


class Qwen2ForSampling(base.NeuronModelBase):
"""The Qwen2 model is essentially a LLama model with bias in linear projections."""
"""The Qwen2 model is essentially a LLama model with bias in linear projections.
The implementation in this class is very similar to the one used for Llama in Tnx.
The only differences are:
- the config (Qwen2Config) and base model (Qwen2ForCausalLM) used in __init__,
- the addition of biases parameters when loading weights from the checkpoint model.
"""

def __init__(
self,
Expand Down

0 comments on commit 6012a37

Please sign in to comment.