Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Phi-3-mini support #24

Open
kangurek-kao opened this issue May 8, 2024 · 1 comment
Open

Phi-3-mini support #24

kangurek-kao opened this issue May 8, 2024 · 1 comment

Comments

@kangurek-kao
Copy link

Hello!
First of all, I'm impressed by this project and I hope it will pick up some steam in the nearby future. But I would really like to see additional LLMs/SLMs, as local models get faster and more creative every single day. Like Microsoft's Phi-3 models.

https://news.microsoft.com/source/features/ai/the-phi-3-small-language-models-with-big-potential/

Apparently they are open-sourced and they are comparable performance-wise to vanilla GPT-3 and Llama models. They can be run locally though, meaning they fit perfectly into this project (especially when Phi-1.5 is already implemented).

I would love seeing it, although I'm afraid I couldn't help too much outside of translating things. Thus consider this issue as an idea rather than issue per se.

Warm greetings

@abi
Copy link
Owner

abi commented May 8, 2024

I'm planning on supporting phi3 soon. Maybe, this weekend.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants