Code

Switch to using PyTorch Lightning#195

Code

Closed

alan-cooney wants to merge 40 commits intomainai-safety-foundation/sparse_autoencoder:mainfrom lightningai-safety-foundation/sparse_autoencoder:lightningCopy head branch name to clipboard

+3,456-5,024

Commits

Commits on Jan 19, 2024

• Add pytorch lightning

  alan-cooney

  committed
  fe3fc2c

  Copy full SHA for fe3fc2c

• Move train metrics to torchmetrics

  alan-cooney

  committed
  19c1fb9

  Copy full SHA for 19c1fb9

Commits on Jan 21, 2024

• Move all metrics and loss to torchmetrics

  alan-cooney

  committed
  0f2cb46

  Copy full SHA for 0f2cb46

• Add neuron fired count metric

  alan-cooney

  committed
  acde426

  Copy full SHA for acde426

• Add a lightning module version of the model

  alan-cooney

  committed
  6473b2a

  Copy full SHA for 6473b2a

Commits on Jan 23, 2024

• Add support for keeping the batch dimension in loss functions

  alan-cooney

  committed
  4192477

  Copy full SHA for 4192477

• Tweak neuron activity documentation

  alan-cooney

  committed
  dee5e58

  Copy full SHA for dee5e58

• Set the default vscode testing framework

  alan-cooney

  committed
  466c10a

  Copy full SHA for 466c10a

• Simplify keeping of batch dimension with autoencoder

  alan-cooney

  committed
  47f2b42

  Copy full SHA for 47f2b42

• At lightning SAE support to replace activations hook

  alan-cooney

  committed
  bbcbcb6

  Copy full SHA for bbcbcb6

• Remove deepspeed optimizer

  Show description for 13ed5b1
  alan-cooney

  committed
  13ed5b1

  Copy full SHA for 13ed5b1

• Support any type of model for the replace activations hook

  alan-cooney

  committed
  447b479

  Copy full SHA for 447b479

• Simplify get model device

  alan-cooney

  committed
  33da685

  Copy full SHA for 33da685

• Simplify optimizer init

  alan-cooney

  committed
  3731a1f

  Copy full SHA for 3731a1f

• Fix init for changed modules

  alan-cooney

  committed
  9ff259e

  Copy full SHA for 9ff259e

• Ignore lightning deprecated warning

  alan-cooney

  committed
  1692d3f

  Copy full SHA for 1692d3f

• Add lightning support to get model device

  alan-cooney

  committed
  76b5e2c

  Copy full SHA for 76b5e2c

Commits on Jan 24, 2024

• Combine all train metrics with loss

  alan-cooney

  committed
  3ebadfa

  Copy full SHA for 3ebadfa

• Improve lightning loss performance

  alan-cooney

  committed
  8505c7a

  Copy full SHA for 8505c7a

• Add a separate autoencoder loss module

  alan-cooney

  committed
  977f620

  Copy full SHA for 977f620

• Add loss to module exports

  alan-cooney

  committed
  ed021a3

  Copy full SHA for ed021a3

Commits on Jan 26, 2024

• Add pipeline

  alan-cooney

  committed
  b8f0211

  Copy full SHA for b8f0211

• Merge remote-tracking branch 'origin/main' into lightning

  alan-cooney

  committed
  f32c113

  Copy full SHA for f32c113

• Remove prints

  alan-cooney

  committed
  7164322

  Copy full SHA for 7164322

• Add training step tests

  alan-cooney

  committed
  1a98484

  Copy full SHA for 1a98484

Commits on Jan 27, 2024

• Support none and 1 dimensions

  alan-cooney

  committed
  24c2864

  Copy full SHA for 24c2864

Commits on Jan 29, 2024

• Fix metric logging

  alan-cooney

  committed
  1b69ed3

  Copy full SHA for 1b69ed3

• Revert activation resampler and fix tests

  alan-cooney

  committed
  4e4c7a9

  Copy full SHA for 4e4c7a9

• Support mps

  alan-cooney

  committed
  fb8ec8d

  Copy full SHA for fb8ec8d

• Fix batch dim setting

  alan-cooney

  committed
  bc5f563

  Copy full SHA for bc5f563

• Add data parallel for HookedTransformer

  alan-cooney

  committed
  a491460

  Copy full SHA for a491460

• Fix docs build

  alan-cooney

  committed
  346cc8f

  Copy full SHA for 346cc8f

• Add reconstruction score in

  alan-cooney

  committed
  98bc2c6

  Copy full SHA for 98bc2c6

• Improve docs typing

  alan-cooney

  committed
  3900d1a

  Copy full SHA for 3900d1a

• Update packages

  alan-cooney

  committed
  a89abbc

  Copy full SHA for a89abbc

• Add DataParallelWithModelAttributes to the resampler

  alan-cooney

  committed
  100278a

  Copy full SHA for 100278a

Commits on Jan 30, 2024

• Fix tests

  alan-cooney

  committed
  e819555

  Copy full SHA for e819555

• Remove logging if not signed in

  alan-cooney

  committed
  4e2f67b

  Copy full SHA for 4e2f67b

• Fix logging

  alan-cooney

  committed
  e98e34e

  Copy full SHA for e98e34e

• Fix loss link

  alan-cooney

  committed
  bb97eb1

  Copy full SHA for bb97eb1