Can someone help me integrate Deep Speed solution to my code?

[asigalov61]

Hey Deep Speed team, GitHub users,

I was wondering if someone can help me integrate one of the Deep Speed modules/solutions into my code. It would really help me out and also IMHO it would be very useful to the DL/ML GitHub community as well.

What I need is to integrate this:
https://github.com/microsoft/DeepSpeed/blob/master/deepspeed/ops/sparse_attention/sparse_self_attention.py

Into this:
https://github.com/asigalov61/tegridy-tools/blob/main/tegridy-tools/minGPT.py

I think it would really make a great solution but it is a bit over my head so I could use some specific assistance and help. Pointers and code-snippets alone would not help me as I would not know what to do with it.

I also want to use specifically minGPT cuz it's awesome and also cuz my codebase is built on it. So please do not direct me to something else, as it will not work for me.

Thank you very much and please let me know if you can help.

Alex