Adding support to Llama 3.1

[asmit203]

As llama 2 and llama 3.1 are quite similar in terms of architecture hence, will it be possible to add support for llama 3.1?

[charliewang789]

co-asking, anyone tried this?

[SamuelTallet]

Hello guys,
@Dylan-Harden3 added inference support for Llama 3.2 in its fork.