-
Notifications
You must be signed in to change notification settings - Fork 11
/
todo.txt
35 lines (26 loc) · 1.2 KB
/
todo.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
- Auto generate absolute plots
* Fix broken image for absolute manual/DescriptionRuntime/
- Add benchmark for matrix creation time.
- Randomly draw operation and matrix size
* first do a run through until an exception occurs
* once max matrix size is known randomly draw
* only save each trial results in XML
* terminating conditions. 1) number of trials per op. 2) total computational time per op.
- only plot results if errors don't exist
- use BigDecimal to compute accuracy of libraries
- stability of BigDecimal matrices?
- convert results to excel format
- Create a memoryMB leak test
- Guava StopWatch for timing
- Remove determinant() from standard benchmark
- Reduce size of smallest matrix in stability matrix from 10 to 6
* That's what people are focusing on for small matrix optimization
- Summary chart for stability
* Break results down to pass, minor issue, failed
- Switch to gradle?
* Download libraries when possible
- Fix summary plot by intelligently cropping the tail
- Weights for each operation is based on their theoretical complexity and not the fastest library
- Penalize libraries which fail stability
- Merge runtime and memoryMB interfaces
- Make it easier to add new operations