Code

Add further debug logging#691

Code

Closed

ddobie wants to merge 50 commits intodevaskap-vast/vast-pipeline:devfrom add-further-debug-loggingaskap-vast/vast-pipeline:add-further-debug-loggingCopy head branch name to clipboard

+202-30

Commits

Commits on Jun 29, 2023

• Initial changes

  ddobie

  committed
  192289f

  Copy full SHA for 192289f

Commits on Jul 4, 2023

• Bump to 1.0.1 for reference

  ddobie

  committed
  93c4e42

  Copy full SHA for 93c4e42

• Added forced photometry timer debug statements

  ddobie

  committed
  1a0eebb

  Copy full SHA for 1a0eebb

• Fixed previous commit

  ddobie

  committed
  a05bb86

  Copy full SHA for a05bb86

• Log number of sources being forced fit

  ddobie

  committed
  fa0bda6

  Copy full SHA for fa0bda6

• Updated forced fitting scheduler to processes

  ddobie

  committed
  1f5c7c6

  Copy full SHA for 1f5c7c6

Commits on Jul 5, 2023

• Added timing debug loggging to new_sources.py

  ddobie

  committed
  84c4423

  Copy full SHA for 84c4423

• Fixed f-strings

  ddobie

  committed
  9b41f7b

  Copy full SHA for 9b41f7b

Commits on Jul 7, 2023

• Added association_models_generator debug logging

  ddobie

  committed
  63e80c3

  Copy full SHA for 63e80c3

• Drop associations batch size to 100

  ddobie

  committed
  8ab0f67

  Copy full SHA for 8ab0f67

• Added get_memory_usage function

  ddobie

  committed
  d7f95d1

  Copy full SHA for d7f95d1

• Added get_memory_usage to finalise.py

  ddobie

  committed
  ba4f91b

  Copy full SHA for ba4f91b

• Added get_memory_usage to loading.py

  ddobie

  committed
  0e6bf3a

  Copy full SHA for 0e6bf3a

• Added get_memory_usage to main.py

  ddobie

  committed
  1cc2f0e

  Copy full SHA for 1cc2f0e

• Cleaned things up

  ddobie

  committed
  b181cd7

  Copy full SHA for b181cd7

Commits on Jul 13, 2023

• Hardcode n_cpu

  ddobie

  committed
  43d9d2f

  Copy full SHA for 43d9d2f

Commits on Jul 30, 2023

• Shorten forced fit measurment name

  ddobie

  committed
  9c30c43

  Copy full SHA for 9c30c43

• Add some further logging

  ddobie

  committed
  029418e

  Copy full SHA for 029418e

• Only log if long

  ddobie

  committed
  2cf9970

  Copy full SHA for 2cf9970

Commits on Dec 14, 2023

• Fix merge conflicts

  

  Dougal Dobie

  committed
  8faefdf

  Copy full SHA for 8faefdf

• Fixed indent

  ddobie

  authored
  e95351f

  Copy full SHA for e95351f

• Fix syntax error

  ddobie

  committed
  ea30f62

  Copy full SHA for ea30f62

Commits on Feb 6, 2024

• Revert association size to 1e5

  ddobie

  committed
  cb22d33

  Copy full SHA for cb22d33

Commits on Feb 13, 2024

• Temporarily hardcode n_cpu=10

  ddobie

  committed
  e77d538

  Copy full SHA for e77d538

• Added some more logging

  ddobie

  committed
  72d1aeb

  Copy full SHA for 72d1aeb

• Attempt to limit memory usage

  ddobie

  committed
  b3e217b

  Copy full SHA for b3e217b

• Attempt to limit memory usage

  ddobie

  committed
  41bd240

  Copy full SHA for 41bd240

Commits on Feb 14, 2024

• Update parallel_grouppby to use chunksize

  ddobie

  committed
  83b60cf

  Copy full SHA for 83b60cf

Commits on Feb 15, 2024

• Correctly set chunk size

  ddobie

  committed
  9102656

  Copy full SHA for 9102656

Commits on Feb 16, 2024

• Remove superfluous logging

  ddobie

  committed
  19741ba

  Copy full SHA for 19741ba

• Further dask groupby fixes

  ddobie

  committed
  1598169

  Copy full SHA for 1598169

Commits on Feb 20, 2024

• Added django.db.reset_queries

  ddobie

  committed
  a3e4135

  Copy full SHA for a3e4135

• Added chunking for associations upload

  ddobie

  committed
  f3fb2b8

  Copy full SHA for f3fb2b8

• Fixes

  ddobie

  committed
  868d518

  Copy full SHA for 868d518

• calculate measurement pairs with sensible partitions

  ddobie

  committed
  c06b2e5

  Copy full SHA for c06b2e5

• parallel_groupby_coord with sensible partitions

  ddobie

  committed
  55b8a88

  Copy full SHA for 55b8a88

• parallel_groupby_coord with sensible partitions

  ddobie

  committed
  6b0455c

  Copy full SHA for 6b0455c

• parallel_association with sensible partitions

  ddobie

  committed
  75d2fb0

  Copy full SHA for 75d2fb0

• parallel_get_rms_measurements with sensible partitions

  ddobie

  committed
  9da2404

  Copy full SHA for 9da2404

Commits on Feb 21, 2024

• Fixed new_sources issue

  ddobie

  committed
  1af0a9f

  Copy full SHA for 1af0a9f

Commits on Feb 25, 2024

• commit all changes

  ddobie

  committed
  7d93b31

  Copy full SHA for 7d93b31

Commits on May 22, 2024

• Remove unnecessary debug logging statements

  ddobie

  authored
  40283e1

  Copy full SHA for 40283e1

• Remove superfluous debug statements

  ddobie

  committed
  2355d9e

  Copy full SHA for 2355d9e

Commits on May 23, 2024

• Lots of debugging statements

  ddobie

  committed
  4f4eb8b

  Copy full SHA for 4f4eb8b

• Correctly estimate partition size

  ddobie

  committed
  edae5f8

  Copy full SHA for edae5f8

• More playing

  ddobie

  committed
  f0cffcc

  Copy full SHA for f0cffcc

• Stash?

  ddobie

  committed
  1082596

  Copy full SHA for 1082596

• More changes to make this work

  ddobie

  committed
  ec66300

  Copy full SHA for ec66300

Commits on Jul 16, 2024

• Resolve conflicts

  ddobie

  committed
  d4bc1a5

  Copy full SHA for d4bc1a5

• Fix merge

  ddobie

  committed
  a7f6f4b

  Copy full SHA for a7f6f4b