Code

Add eprop work to main tools#1368

Code

Draft

andrewgait wants to merge 144 commits intomasterSpiNNakerManchester/sPyNNaker:masterfrom eprop_adaptive_updateSpiNNakerManchester/sPyNNaker:eprop_adaptive_updateCopy head branch name to clipboard

+6,845-88

Commits

Commits on Sep 19, 2019

• Skeleton implementation with updated data structures

  oliverrhodes

  committed
  c731160

  Copy full SHA for c731160

• update to skeleton implementation

  

  mbassor2

  committed
  8d6f485

  Copy full SHA for 8d6f485

• Add eprop_adaptive synapse type

  oliverrhodes

  committed
  e04b1c4

  Copy full SHA for e04b1c4

Commits on Sep 26, 2019

• added regularisation functionality

  

  mbassor2

  committed
  c0911e3

  Copy full SHA for c0911e3

• Added adaptive neuron

  

  mbassor2

  committed
  65cde93

  Copy full SHA for 65cde93

• Adaptive threshold working

  oliverrhodes

  committed
  b095d6e

  Copy full SHA for b095d6e

Commits on Sep 27, 2019

• make regularisation target rates scalable with neurons per core

  

  mbassor2

  committed
  c813aff

  Copy full SHA for c813aff

Commits on Oct 2, 2019

• beginnings of store recall readout neuron, still broken and needs actual implementation

  adamperrett

  committed
  3e63017

  Copy full SHA for 3e63017

Commits on Oct 3, 2019

• most of the structure of the store recall task is in place just waiting for poisson sources to be update-able from this code, all poisson stuff has been removed, neuron index 1 and 2 has V stored a…

  Show description for a7ee9d6
  adamperrett

  committed
  a7ee9d6

  Copy full SHA for a7ee9d6

Commits on Oct 4, 2019

• no longer broadcasting error with inhib and excite but as a packet

  adamperrett

  committed
  6dd206e

  Copy full SHA for 6dd206e

Commits on Oct 7, 2019

• c code compiles, packets transmitted to poisson spike source, includes are corrected, init corrected to include store_recall and eprop properly, test script adjusted to creat edge for poisson updat…

  Show description for c73a232
  adamperrett

  committed
  c73a232

  Copy full SHA for c73a232

Commits on Oct 8, 2019

• add signed weights functionality

  

  mbassor2

  committed
  532a6da

  Copy full SHA for 532a6da

• Update to allow correct reading of weights (static)

  oliverrhodes

  committed
  1ae007e

  Copy full SHA for 1ae007e

Commits on Oct 18, 2019

• Add learning signal param and skeleton synapse state updates

  oliverrhodes

  committed
  f8a2309

  Copy full SHA for f8a2309

Commits on Oct 21, 2019

• add note to replace saturation check

  oliverrhodes

  committed
  54f7155

  Copy full SHA for 54f7155

• Merge branch 'eprop_adaptive' of https://github.com/SpiNNakerManchester/sPyNNaker into eprop_adaptive

  oliverrhodes

  committed
  18445eb

  Copy full SHA for 18445eb

Commits on Nov 15, 2019

• Put threshold in neuron model for easier access during synaptic state

  Show description for 04a6736
  oliverrhodes

  committed
  04a6736

  Copy full SHA for 04a6736

• check test scripts still run correctly

  oliverrhodes

  committed
  36adad1

  Copy full SHA for 36adad1

Commits on Nov 26, 2019

• Remove delays from spike processing, and use field to index synapse

  Show description for f7cc1a3
  oliverrhodes

  committed
  f7cc1a3

  Copy full SHA for f7cc1a3

• Skeleton sinusoid readout neuron

  oliverrhodes

  committed
  b61026a

  Copy full SHA for b61026a

Commits on Nov 27, 2019

• skeleton sinusoid readout neuron

  oliverrhodes

  committed
  f55810e

  Copy full SHA for f55810e

• sinusoid readout implemented

  oliverrhodes

  committed
  dfa0a55

  Copy full SHA for dfa0a55

Commits on Nov 28, 2019

• Learning signal by payload

  oliverrhodes

  committed
  d448e65

  Copy full SHA for d448e65

• Add complete synaptic state updates

  oliverrhodes

  committed
  8521b6e

  Copy full SHA for 8521b6e

• begin sketching out weight update scheme

  oliverrhodes

  committed
  387f1d3

  Copy full SHA for 387f1d3

Commits on Nov 29, 2019

• Change arithmetic to fit with prototype implementation of weight change

  oliverrhodes

  committed
  a86232f

  Copy full SHA for a86232f

Commits on Jan 22, 2020

• fix error by payload test example

  oliverrhodes

  committed
  76c811a

  Copy full SHA for 76c811a

Commits on Jan 24, 2020

• Convert to delta synapses and add test

  oliverrhodes

  committed
  0abc0bc

  Copy full SHA for 0abc0bc

Commits on Mar 2, 2020

• folded in eprop learning to sinusoid readout neuron, altered make file, created separate synapses.c for sinusoid to process neuron array separately, altered print outs, couple bug fixes

  adamperrett

  committed
  0efa07d

  Copy full SHA for 0efa07d

• Add plastic weight update

  oliverrhodes

  committed
  18a7ebb

  Copy full SHA for 18a7ebb

Commits on Mar 3, 2020

• Add regularisation functionality

  oliverrhodes

  committed
  7ddeadf

  Copy full SHA for 7ddeadf

• Merge pull request #794 from SpiNNakerManchester/implement_eprop_plastic_update

  Show description for 76948ef
  oliverrhodes

  authored
  76948ef

  Copy full SHA for 76948ef

• merged in new plasticity stuff, make files for the new plasticity on both sinusoid and eprop, learning signal no longer passed back into itself, compiles but weight update is wrong in terms of scal…

  Show description for f2b9e61
  adamperrett

  committed
  f2b9e61

  Copy full SHA for f2b9e61

Commits on Mar 4, 2020

• learning now in sinusoid, weight is shifted to make more sense, print statements adjusted

  adamperrett

  committed
  a07ee44

  Copy full SHA for a07ee44

Commits on Mar 10, 2020

• Updated sinusoid learning and print management

  adamperrett

  committed
  2b38adc

  Copy full SHA for 2b38adc

• Merge pull request #801 from SpiNNakerManchester/eprop_adam_tive

  Show description for 12cae24
  sara-es

  authored
  12cae24

  Copy full SHA for 12cae24

Commits on Mar 11, 2020

• delays now passed correctly, changes to prints

  adamperrett

  committed
  23a926f

  Copy full SHA for 23a926f

Commits on Mar 13, 2020

• fix to allow extraction of signed weights, removed timing dependence check as no longer relevant and causing crashes

  adamperrett

  committed
  b325dfe

  Copy full SHA for b325dfe

• updates to reg firing, rest committed in case home

  adamperrett

  committed
  5e9da36

  Copy full SHA for 5e9da36

Commits on Mar 17, 2020

• Fixed neurons per core, updated regularisation

  adamperrett

  committed
  fdc7cdf

  Copy full SHA for fdc7cdf

• removed an annoying print

  adamperrett

  committed
  6a8295e

  Copy full SHA for 6a8295e

Commits on Mar 19, 2020

• more synapses per eprop neuron, regularised to within a boundary

  adamperrett

  committed
  c57e81a

  Copy full SHA for c57e81a

• reduced error margin

  adamperrett

  committed
  1f60cd7

  Copy full SHA for 1f60cd7

Commits on Mar 23, 2020

• Add comments to n_neurons parameter in neuron implementation

  oliverrhodes

  committed
  1b4bc1f

  Copy full SHA for 1b4bc1f

• Be careful setting the size of the e-prop synapse array

  oliverrhodes

  committed
  e37842c

  Copy full SHA for e37842c

• warning about having same parameter but different name, also this needs

  Show description for 84237f1
  oliverrhodes

  committed
  84237f1

  Copy full SHA for 84237f1

• Merge pull request #804 from SpiNNakerManchester/eprop_being_adapted

  Show description for 6c08926
  oliverrhodes

  authored
  6c08926

  Copy full SHA for 6c08926

Commits on Apr 6, 2020

• Fix pause-and-resume for eprop neuron model

  andrewgait

  committed
  aaf2e56

  Copy full SHA for aaf2e56

Commits on Apr 7, 2020

• change log_info's to log_debug

  andrewgait

  committed
  c46b527

  Copy full SHA for c46b527

Commits on Apr 8, 2020

• Add comment for compiler fix: += => -=

  oliverrhodes

  committed
  74b38e7

  Copy full SHA for 74b38e7

• updated total_synapses_per_neuron comment

  oliverrhodes

  committed
  29aa11b

  Copy full SHA for 29aa11b

• Merge pull request #815 from SpiNNakerManchester/eprop_pause_and_resume

  Show description for 98810a4
  oliverrhodes

  authored
  98810a4

  Copy full SHA for 98810a4

Commits on Apr 24, 2020

• Small changes to regularisation, merged with new branch, left right task not included

  adamperrett

  committed
  4caf284

  Copy full SHA for 4caf284

• Basic version of left right, not currently working

  adamperrett

  committed
  03f1ad2

  Copy full SHA for 03f1ad2

Commits on Apr 29, 2020

• Poisson key collected and given to model, runs but poisson not updating rate

  adamperrett

  committed
  5220c26

  Copy full SHA for 5220c26

Commits on Apr 30, 2020

• Poisson rates updated properly, operation not ok

  adamperrett

  committed
  0c72023

  Copy full SHA for 0c72023

Commits on May 20, 2020

• different recording, rho changed but not calculated on the fly, rates changed, updated left right variable and parameter loading in python and a little in sinusoid

  adamperrett

  committed
  67a4802

  Copy full SHA for 67a4802

Commits on May 21, 2020

• rho correctly calculated for each neuron and used

  adamperrett

  committed
  c70c68b

  Copy full SHA for c70c68b

Commits on May 26, 2020

• Add functionality to apply weight updates after an elapsed period of

  Show description for 08e877f
  oliverrhodes

  committed
  08e877f

  Copy full SHA for 08e877f

Commits on May 28, 2020

• updates to firing reg making it averaged over time, updates are staggered accumulated over 10 tests, updates to prints, removed unecessary rho calc and import,

  adamperrett

  committed
  5023019

  Copy full SHA for 5023019

Commits on Jun 1, 2020

• changes to recording, left right always alternated, reg error not included if small enough, learning signal not included after waiting an

  adamperrett

  committed
  731af5d

  Copy full SHA for 731af5d

Commits on Jun 2, 2020

• Merge pull request #828 from SpiNNakerManchester/eprop_adaptive_delayed_weight_update

  Show description for f21b6c9
  oliverrhodes

  authored
  f21b6c9

  Copy full SHA for f21b6c9

• Merge remote-tracking branch 'origin/eprop_adaptive' into eprop_left_right

  Show description for 70ee0be
  oliverrhodes

  committed
  70ee0be

  Copy full SHA for 70ee0be

• Merge pull request #827 from SpiNNakerManchester/eprop_left_right

  Show description for d153fc2
  oliverrhodes

  authored
  d153fc2

  Copy full SHA for d153fc2

• removed abs and switched to accum to be sure

  adamperrett

  committed
  2f256b9

  Copy full SHA for 2f256b9

• hot fix

  adamperrett

  committed
  ae86f7b

  Copy full SHA for ae86f7b

• reset the synapse params between tests, window size a single variable except for synapse dynamics, changes to recording

  adamperrett

  committed
  5a11a6a

  Copy full SHA for 5a11a6a

Commits on Jun 9, 2020

• added voltage regularisation, neuron/synapse dynamics reset between runs, merged master, fixed bug causing 1 time step to be skipped

  adamperrett

  committed
  4faf879

  Copy full SHA for 4faf879

Commits on Jun 11, 2020

• window size is variable, reset now includes membrane and refract timer

  adamperrett

  committed
  dd2a207

  Copy full SHA for dd2a207

Commits on Jun 17, 2020

• saturation check and fix added, removed reg for testing, update ready synchronised, window size bug

  adamperrett

  committed
  9cf2d98

  Copy full SHA for 9cf2d98

Commits on Jun 26, 2020

• update to learning signal calculation

  adamperrett

  committed
  f690e7a

  Copy full SHA for f690e7a

Commits on Jul 16, 2020

• exp un-scaled, reset works if spike received at t=0, io_prints removed to save buffer overflow on repeats, bad version of over/underflow check on ring buffer,

  adamperrett

  committed
  c4c0892

  Copy full SHA for c4c0892

Commits on Jul 22, 2020

• remove some print statements

  andrewgait

  committed
  ec335d0

  Copy full SHA for ec335d0

Commits on Sep 25, 2020

• number of cues now an input variable for incremental learning

  adamperrett

  committed
  da6d0f3

  Copy full SHA for da6d0f3

• added #of cues to default init values

  adamperrett

  committed
  1b7a510

  Copy full SHA for 1b7a510

Commits on Sep 29, 2020

• vmem used in learning

  adamperrett

  committed
  8f220ae

  Copy full SHA for 8f220ae

• number of cues added to eprop for membrane resetting, changes to recording

  adamperrett

  committed
  071baca

  Copy full SHA for 071baca

• moved test_length

  adamperrett

  committed
  8ddf983

  Copy full SHA for 8ddf983

Commits on Oct 2, 2020

• random cue turned back on

  adamperrett

  committed
  01abcad

  Copy full SHA for 01abcad

Commits on Oct 12, 2020

• Update_ready fully added to sinusoid

  adamperrett

  committed
  01d0688

  Copy full SHA for 01d0688

• change recording

  adamperrett

  committed
  c77ce84

  Copy full SHA for c77ce84

• change recording

  adamperrett

  committed
  f1c035b

  Copy full SHA for f1c035b

• change recording

  adamperrett

  committed
  b1301ac

  Copy full SHA for b1301ac

• removed decay pon zbar

  adamperrett

  committed
  e731731

  Copy full SHA for e731731

• updated weight update issue with - +=

  adamperrett

  committed
  3870823

  Copy full SHA for 3870823

• changed recording

  adamperrett

  committed
  89a9260

  Copy full SHA for 89a9260

• removed reset if not left right task

  adamperrett

  committed
  6c5481e

  Copy full SHA for 6c5481e

• default number of cues = 0

  adamperrett

  committed
  b7b65c7

  Copy full SHA for b7b65c7

• return of the rate reg

  adamperrett

  committed
  4d56da3

  Copy full SHA for 4d56da3

• return of the rate reg

  adamperrett

  committed
  81b79ae

  Copy full SHA for 81b79ae

• return of the rate reg

  adamperrett

  committed
  7f41581

  Copy full SHA for 7f41581

• return of the rate reg

  adamperrett

  committed
  ea7420c

  Copy full SHA for ea7420c

Commits on Oct 13, 2020

• removed printing for small windows and long runs

  adamperrett

  committed
  14791a3

  Copy full SHA for 14791a3

Commits on Oct 22, 2020

• Merge branch 'eprop_adaptive' into eprop_incremental_graph

  andrewgait

  authored
  b86ae0d

  Copy full SHA for b86ae0d

• Delete unneeded file

  andrewgait

  committed
  bafd5d0

  Copy full SHA for bafd5d0

• Merge pull request #896 from SpiNNakerManchester/eprop_incremental_graph

  Show description for be20e45
  andrewgait

  authored
  be20e45

  Copy full SHA for be20e45

Commits on Mar 24, 2023

• Merge remote-tracking branch 'origin/master' into eprop_adaptive_update

  andrewgait

  committed
  4fa3634

  Copy full SHA for 4fa3634

Commits on Mar 27, 2023

• Rho is calculated already during initialise so no need to do this

  andrewgait

  committed
  f5e9a0f

  Copy full SHA for f5e9a0f

Commits on Apr 3, 2023

• Fix merge to make basic eprop (and STDP) work

  andrewgait

  committed
  d46c4af

  Copy full SHA for d46c4af

• Merge branch 'eprop_adaptive_update' of https://github.com/SpiNNakerManchester/sPyNNaker.git into eprop_adaptive_update

  andrewgait

  committed
  af37a9e

  Copy full SHA for af37a9e

Commits on Apr 14, 2023

• Get sinusoid readout neuron working; fix STDP?

  andrewgait

  committed
  5a17f83

  Copy full SHA for 5a17f83

• Get rid of debug prints for now

  andrewgait

  committed
  b82a0cd

  Copy full SHA for b82a0cd

Commits on Apr 17, 2023

• Do STDP initialise correctly here as well

  andrewgait

  committed
  f4618ab

  Copy full SHA for f4618ab

Commits on Apr 24, 2023

• Make work for delays and add use_key to sinusoid readout

  andrewgait

  committed
  cee70f1

  Copy full SHA for cee70f1

Commits on May 4, 2023

• Update left-right task to where it now seems to work

  andrewgait

  committed
  aa937db

  Copy full SHA for aa937db

• Add comment and fix broken loop

  andrewgait

  committed
  af35d2c

  Copy full SHA for af35d2c

Commits on May 5, 2023

• Tidying up for earlier compiler versions to fit in ITCM

  andrewgait

  committed
  afe47db

  Copy full SHA for afe47db

• Switch this calculation back for now as kdivui doesn't seem to work

  andrewgait

  committed
  3e6da01

  Copy full SHA for 3e6da01

• More comments on dividing negative values

  andrewgait

  committed
  07e09f5

  Copy full SHA for 07e09f5

Commits on May 9, 2023

• Tidying up (working?) C code

  andrewgait

  committed
  3f14ee2

  Copy full SHA for 3f14ee2

• Merge remote-tracking branch 'origin/master' into eprop_adaptive_update

  andrewgait

  committed
  29f4c46

  Copy full SHA for 29f4c46

Commits on May 25, 2023

• Fixes for incremental_learning script and tidying up

  andrewgait

  committed
  48fd0cc

  Copy full SHA for 48fd0cc

Commits on May 26, 2023

• Turn non-eprop models back on again

  andrewgait

  committed
  888e3d6

  Copy full SHA for 888e3d6

• Tidy up code, vera line lengths, delete unused model

  andrewgait

  committed
  8f6f9a1

  Copy full SHA for 8f6f9a1

• vera line length

  andrewgait

  committed
  42eabce

  Copy full SHA for 42eabce

• Try using ubuntu 22 (to update compiler version)

  andrewgait

  committed
  fc149df

  Copy full SHA for fc149df

Commits on Jun 6, 2023

• Merge remote-tracking branch 'origin/master' into eprop_adaptive_update

  andrewgait

  committed
  2987d20

  Copy full SHA for 2987d20

• Reduce ITCM further

  andrewgait

  committed
  c15512d

  Copy full SHA for c15512d

• Don't build eprop binaries in debug mode

  andrewgait

  committed
  5de2d6d

  Copy full SHA for 5de2d6d

Commits on Jun 7, 2023

• Not using StoreRecallReadout any more

  andrewgait

  committed
  80cd906

  Copy full SHA for 80cd906

• Update is_same_as in eprop stdp

  andrewgait

  committed
  8143e7c

  Copy full SHA for 8143e7c

Commits on Jun 8, 2023

• Flake8 and general tidying up

  andrewgait

  committed
  2ce486a

  Copy full SHA for 2ce486a

• Flake8 / rename ambiguous parameter

  andrewgait

  committed
  7e18daf

  Copy full SHA for 7e18daf

• more flake8

  andrewgait

  committed
  3910aff

  Copy full SHA for 3910aff

• pylint: match to slots properly

  andrewgait

  committed
  55e56a5

  Copy full SHA for 55e56a5

• missed one

  andrewgait

  committed
  699148f

  Copy full SHA for 699148f

• pylint unused variables, access

  andrewgait

  committed
  f8bd3a3

  Copy full SHA for f8bd3a3

• Update licenses and rename file to match other naming

  andrewgait

  committed
  40e235a

  Copy full SHA for 40e235a

• Put include files in the correct order

  andrewgait

  committed
  a1e1fac

  Copy full SHA for a1e1fac

• set default for target_data

  andrewgait

  committed
  39d1ce4

  Copy full SHA for 39d1ce4

Commits on Jun 16, 2023

• rename setter to correct name

  andrewgait

  committed
  966fedb

  Copy full SHA for 966fedb

Commits on Jul 6, 2023

• Add use_eprop to pass correct value into synapses

  andrewgait

  committed
  1f2e808

  Copy full SHA for 1f2e808

• Merge remote-tracking branch 'origin/master' into eprop_adaptive_update

  andrewgait

  committed
  a2ce977

  Copy full SHA for a2ce977

Commits on Aug 8, 2023

• Merge remote-tracking branch 'origin/master' into eprop_adaptive_update

  andrewgait

  committed
  d12e14b

  Copy full SHA for d12e14b

• DataType has moved

  andrewgait

  committed
  40383ef

  Copy full SHA for 40383ef

• flake8 missing line

  andrewgait

  committed
  0397647

  Copy full SHA for 0397647

• pylint spelling

  andrewgait

  committed
  c9be8b3

  Copy full SHA for c9be8b3

• pylint property

  andrewgait

  committed
  bfdee44

  Copy full SHA for bfdee44

• overrides goes last

  andrewgait

  committed
  e7375d9

  Copy full SHA for e7375d9

Commits on Sep 20, 2023

• Merge branch 'master' into eprop_adaptive_update

  andrewgait

  authored
  a87b9ca

  Copy full SHA for a87b9ca

Commits on Sep 25, 2023

• Merge branch 'master' into eprop_adaptive_update

  andrewgait

  authored
  fa3478a

  Copy full SHA for fa3478a

Commits on Sep 28, 2023

• Use the correct structure for the data on the branch

  andrewgait

  committed
  012194f

  Copy full SHA for 012194f

Commits on Sep 29, 2023

• Merge branch 'master' into eprop_adaptive_update

  andrewgait

  authored
  c8011ca

  Copy full SHA for c8011ca

Commits on Oct 30, 2023

• Merge branch 'master' into eprop_adaptive_update

  rowleya

  authored
  4cde343

  Copy full SHA for 4cde343