Why is chaiNNer so slow?

[ehobson]

Every model runs much more slowly in chaiNNer than it does outside of the application. Most recently, I tried running an onnx model with TensorRT; the file took 4 hours to process outside of chainner and 7 days to process in chainner.... Why is chainner so slow?

[Velorexe]

Are you running ChaiNNer on a GPU? 4 vs 168 hours sounds like a huge difference if done on the same GPU with the same underlying ONNX library.

[joeyballentine]

I wouldn't recommend using tensorrt with chaiNNer. Use PyTorch or just cuda with onnx.