Windows support?

[woct0rdho]

Hi, is there any plan to build kernels on Windows, or cross-build on Linux targeting Windows?

I'm not an expert on Nix but AFAIK Nix is far from usable on Windows. Transformers v5 is going to be released and it's heavily promoting the use of kernels like attentions and MoE. I guess there will be an increasing demand to run the kernels on Windows.

WSL is surely a solution but it would be good if there is a native solution, because the overhead of WSL is non-negligible when running AI.

[danieldk]

We are working on support for building kernels on Windows. It will not use Nix for the reason that you state, but we are aiming for it to be as close as possible (with ABI checks, etc.).