Activity
Explain some results from the project
Explain some results from the project
Describe the general project in a README
Describe the general project in a README
Try lowering leverage and see scaling again
Try lowering leverage and see scaling again
Try multi-sigmoid trade loss to boost trading
Try multi-sigmoid trade loss to boost trading
Remove gconv and robust loss files (unused)
Remove gconv and robust loss files (unused)
Try robust loss from Ma & Huang 2020
Try robust loss from Ma & Huang 2020
Remove sgconv naming (due to switch to FlashMHA)
Remove sgconv naming (due to switch to FlashMHA)
Experiment with norms, go back to layernorm
Experiment with norms, go back to layernorm
Try rotary, rmsnorm and normal gelu activation
Try rotary, rmsnorm and normal gelu activation
Turn off final layer norm (fixed scaling?)
Turn off final layer norm (fixed scaling?)
Try an embedding norm to help with stability
Try an embedding norm to help with stability
Use log1p and set max loss to .5 for inverse math
Use log1p and set max loss to .5 for inverse math
Try small, regularized, and only trade loss runs
Try small, regularized, and only trade loss runs
Try some larger runs (not scaling, divergence)
Try some larger runs (not scaling, divergence)
Rerun normal data processing with max classes
Rerun normal data processing with max classes
Start preparing/planning for scaling experiment
Start preparing/planning for scaling experiment
Turn off SGConv and non linear embedding
Turn off SGConv and non linear embedding
Adjust layers for scaling and speed
Adjust layers for scaling and speed
Clean up validation splitting to 120 days
Clean up validation splitting to 120 days
Organize and analyze random data experiment
Organize and analyze random data experiment
Run random data experiments (positive results)
Run random data experiments (positive results)
Set randomization parameter legitimately
Set randomization parameter legitimately