Project news 2024-05-30

[pwgit-create]

The new standard model

Changing the context window to 10240 is the most effective way for me to generate code with the new default model codestral:22b. If you have good hardware, try it out by edit the number in the config.props file located at "src/main/resources/config.props" in the release folder)

config.props

Dev news

In the next release, there will be three more configurations that the user can edit within the same file. Those are:

• TOP_K=40
• NUM_PREDICT=-1
• TEMPERATURE=0.8

Before merging anything, I need to test this and determine how stable these configurations are over time, as well as whether they bring enhancements or problems to this project. The branch for it can be viewed here.

I am grateful to the Ollama community

I would also like to take the time to thank the Ollama team (and community) for bringing us this amazing framework! Thanks to Ollama, thousands of new projects and ideas have been created worldwide, and its developers deserve our praise.