Code

WIP: new server backend for GPT4All#2806

Code

Draft

cebtenzzre wants to merge 17 commits intomainnomic-ai/gpt4all:mainfrom new-server-backendnomic-ai/gpt4all:new-server-backendCopy head branch name to clipboard

+1,935-1,156

Commits

Commits on Aug 7, 2024

• remove unused llmodel_shared.h

  Show description for 43b6f63
  cebtenzzre

  committed
  43b6f63

• rename LLamaModel to LlamaCppBackendImpl

  Show description for 9808be5
  cebtenzzre

  committed
  9808be5

• backend: move more stuff into LlamaCppBackend

  Show description for 595501f
  cebtenzzre

  committed
  595501f

• chatllm: clean up API

  Show description for f1f60d6
  cebtenzzre

  committed
  f1f60d6

• rename LlamaCppBackend::Implementation to LlamaCppBackendManager

  Show description for bafbed9
  cebtenzzre

  committed
  bafbed9

• rename LLModel -> ModelBackend, EmbLLModel -> EmbCapableBackend

  Show description for 5be5314
  cebtenzzre

  committed
  5be5314

• fix some #includes with IWYU

  Show description for 429613a
  cebtenzzre

  committed
  429613a

Commits on Aug 8, 2024

• rename ChatLLM to LlamaCppModel

  Show description for f2e5c93
  cebtenzzre

  committed
  f2e5c93

• create a generic interface for LlamaCppModel, called LLModel

  Show description for 39f5c53
  cebtenzzre

  committed
  39f5c53

• cleanup function braces

  Show description for 05bd604
  cebtenzzre

  committed
  05bd604

Commits on Aug 9, 2024

• replace setShouldBeLoaded with loadModelAsync/releaseModelAsync

  Show description for 8fd9f01
  cebtenzzre

  committed
  8fd9f01

• modellist: format file size string lazily

  Show description for d49b64d
  cebtenzzre

  committed
  d49b64d

• add comment to ModelInfo

  Show description for ff927b5
  cebtenzzre

  committed
  ff927b5

• modellist: make role names 'static const'

  Show description for d098426
  cebtenzzre

  committed
  d098426

Commits on Aug 14, 2024

• modellist: refactor some lambdas into functions

  Show description for f6c8c7c
  cebtenzzre

  committed
  f6c8c7c

Commits on Aug 23, 2024

• WIP

  cebtenzzre

  committed
  c13b33f

• Ollama WIP

  cebtenzzre

  committed
  912d08c