Code

Improve read/write performance#21

Code

Merged

halleysfifthinc merged 22 commits intomasterhalleysfifthinc/C3D.jl:masterfrom performancehalleysfifthinc/C3D.jl:performanceCopy head branch name to clipboardAug 14, 2024

+148-114

Commits

Commits on Aug 13, 2024

• Be less eager with slow get_multipled_parameter_names calls

  halleysfifthinc

  committed
  f2d7e37

  Copy full SHA for f2d7e37

• Replace one transcode with a widen

  halleysfifthinc

  committed
  fb8bff9

  Copy full SHA for fb8bff9

• strip before transcoding

  halleysfifthinc

  committed
  4b26a35

  Copy full SHA for 4b26a35

• Fix copy-pasta

  halleysfifthinc

  committed
  55df1e4

  Copy full SHA for 55df1e4

• Only create pt_labels if there are points to be labeled

  halleysfifthinc

  committed
  1d90a7a

  Copy full SHA for 1d90a7a

• Only create an_labels if there are analog channels

  halleysfifthinc

  committed
  44566a8

  Copy full SHA for 44566a8

• Add some big files to benchmarks and update tuning file

  halleysfifthinc

  committed
  258bf4b

  Copy full SHA for 258bf4b

• Avoid repeated typed_index for POINT:SCALE

  halleysfifthinc

  committed
  7bbc351

  Copy full SHA for 7bbc351

• Further refine duplicate warnings (maxlog once by hash of the filename and dedupped marker name)

  halleysfifthinc

  committed
  01d3a25

  Copy full SHA for 01d3a25

• Avoid repeated dict indexing and improve broadcasting of point sample

  halleysfifthinc

  committed
  be698f8

  Copy full SHA for be698f8

• Use adjoint(view) instead of permutedims for point and analog

  halleysfifthinc

  committed
  12ec8ab

  Copy full SHA for 12ec8ab

• Avoid repeated acquire/release of file for position calls

  halleysfifthinc

  committed
  d008a45

  Copy full SHA for d008a45

• Test another big data file

  halleysfifthinc

  committed
  3d7eeea

  Copy full SHA for 3d7eeea

• Fix missed rename of rstrip_vectorstring

  halleysfifthinc

  committed
  737a701

  Copy full SHA for 737a701

• Tweak predicate order when stripping non-text

  halleysfifthinc

  committed
  09705ba

  Copy full SHA for 09705ba

• Separate pointdata block creation into a function

  halleysfifthinc

  committed
  d83b58e

  Copy full SHA for d83b58e

• Fix bad dispatch in roundapprox

  halleysfifthinc

  committed
  63079e0

  Copy full SHA for 63079e0

• Move dynamic dispatch further up the call chain and create pointdata manually instead of with mapreduce

  halleysfifthinc

  committed
  6f41df0

  Copy full SHA for 6f41df0

• Create analogdata manually instead of mapreduce and fix manually type-split

  halleysfifthinc

  committed
  021bde0

  Copy full SHA for 021bde0

• Fix type instability and add explicit rtol to approx

  halleysfifthinc

  committed
  72f3988

  Copy full SHA for 72f3988

• Add init to sum write (groups|parameters)

  halleysfifthinc

  committed
  59c972b

  Copy full SHA for 59c972b

• Address missed API change in writedata

  halleysfifthinc

  committed
  a7e9ead

  Copy full SHA for a7e9ead