Language Models

The repository contains implementation of

1. DAN: Deep Averaging Network for text classification
2. RNN: Forward and backprop of RNN with custom computational graph
3. BERT: Encoder-only Transformer with custom self-attention
4. DPR: Dense Passage Retrieval with BERT-based query & doc encoders
5. Beam-search: Beam search for autoregressive inference
6. ToT: State model for Tree-of-Thought reasoning