The timing parameters for the PSRAM need to be made dependant on the selected clock.

[PontusO]

For now the system works reliably with the selected PSRAM up to 150MHz after this strange things happen.
One solution for this is to scale the timing parameters with respect to F_CPU.
This is an interesting one as it will depend on both the selected PSRAM manufacturer and F_CPU.