Differentiable Mutual information Loss with pytorch
- Train a GM
- Estimate MI using covarience matrix (easy)
- Consruct a loss function with estimated covarience matrix and means
- BackPropagate!
Todo:
- update code
- works quite bad with High dimensional data, check this paper: https://openreview.net/forum?id=SvrYl-FDq2