The repository contains implementation of
- DAN: Deep Averaging Network for text classification
- RNN: Forward and backprop of RNN with custom computational graph
- BERT: Encoder-only Transformer with custom self-attention
- DPR: Dense Passage Retrieval with BERT-based query & doc encoders
- Beam-search: Beam search for autoregressive inference
- ToT: State model for Tree-of-Thought reasoning