Skip to content

Latest commit

 

History

History
33 lines (28 loc) · 777 Bytes

nn.md

File metadata and controls

33 lines (28 loc) · 777 Bytes

Neural Network classes

::: tinygrad.nn.BatchNorm ::: tinygrad.nn.Conv1d ::: tinygrad.nn.Conv2d ::: tinygrad.nn.ConvTranspose1d ::: tinygrad.nn.ConvTranspose2d ::: tinygrad.nn.Linear ::: tinygrad.nn.GroupNorm ::: tinygrad.nn.InstanceNorm ::: tinygrad.nn.LayerNorm ::: tinygrad.nn.LayerNorm2d ::: tinygrad.nn.RMSNorm ::: tinygrad.nn.Embedding ::: tinygrad.nn.LSTMCell

Optimizers

::: tinygrad.nn.optim.SGD ::: tinygrad.nn.optim.LARS ::: tinygrad.nn.optim.AdamW ::: tinygrad.nn.optim.Adam ::: tinygrad.nn.optim.LAMB

Load/Save

::: tinygrad.nn.state.safe_load ::: tinygrad.nn.state.safe_save ::: tinygrad.nn.state.get_state_dict ::: tinygrad.nn.state.get_parameters ::: tinygrad.nn.state.load_state_dict ::: tinygrad.nn.state.torch_load ::: tinygrad.nn.state.gguf_load