Concurrency

[dievsky]

It feels counterintuitive to utilize the extended CPU registers and to simultaneously ignore the multiple CPU cores.

We could introduce at least some sort of built-in concurrency to viktor. One approach is nd4j-like: you actually have to take additional steps to make it non-concurrent, otherwise it utilizes all the cores it can find. Another approach is to allow the user switching the concurrency on and off.