Code

Add streaming output#71

Code

Open

aantn wants to merge 33 commits intomasterrobusta-dev/holmesgpt:masterfrom add-streaming-outputrobusta-dev/holmesgpt:add-streaming-outputCopy head branch name to clipboard

+1,237-177

Commits

Commits on Jun 24, 2024

• Add support for many llms via litellm

  Show description for 41140b5
  aantn

  committed
  41140b5

  Copy full SHA for 41140b5

• remove function calling title parameter that gemini doesn't support

  aantn

  committed
  4bbcb53

  Copy full SHA for 4bbcb53

• more work on fixing gemini

  aantn

  committed
  89031c2

  Copy full SHA for 89031c2

• add logging

  aantn

  committed
  4e9da1f

  Copy full SHA for 4e9da1f

• Make tool calling compatible with gemini

  aantn

  committed
  081359b

  Copy full SHA for 081359b

• remove unnecessary log

  aantn

  committed
  905b748

  Copy full SHA for 905b748

• hide info logs from litellm

  aantn

  committed
  bfe8d12

  Copy full SHA for bfe8d12

• fix pyinstaller build

  aantn

  committed
  1a9f638

  Copy full SHA for 1a9f638

• more fixes for pyinstaller build

  aantn

  committed
  4b42b64

  Copy full SHA for 4b42b64

• Update build-binaries-and-brew.yaml

  aantn

  committed
  05cdf02

  Copy full SHA for 05cdf02

• more work on fixing pyinstaller builds

  aantn

  committed
  4783e74

  Copy full SHA for 4783e74

• silent noisy logs when using bedrock

  aantn

  committed
  88eebb9

  Copy full SHA for 88eebb9

• Update README.md

  aantn

  committed
  1229b32

  Copy full SHA for 1229b32

• Update README.md

  aantn

  committed
  1624017

  Copy full SHA for 1624017

• Update README.md

  aantn

  committed
  4d73043

  Copy full SHA for 4d73043

• Update README.md

  aantn

  committed
  8c3aec1

  Copy full SHA for 8c3aec1

• Update README.md

  aantn

  committed
  9f6cd9f

  Copy full SHA for 9f6cd9f

• Update README.md

  aantn

  committed
  883f9a4

  Copy full SHA for 883f9a4

• Update README.md

  aantn

  committed
  78218d7

  Copy full SHA for 78218d7

• Update README.md

  aantn

  committed
  91a17f7

  Copy full SHA for 91a17f7

• Update README.md

  aantn

  committed
  ee3dfa9

  Copy full SHA for ee3dfa9

• Update README.md

  aantn

  committed
  9241dd9

  Copy full SHA for 9241dd9

• Update README.md

  aantn

  committed
  bddaed2

  Copy full SHA for bddaed2

• Update README.md

  aantn

  committed
  1648912

  Copy full SHA for 1648912

• Update README.md

  aantn

  committed
  4cc6ea2

  Copy full SHA for 4cc6ea2

• Update README.md

  aantn

  committed
  e1705cd

  Copy full SHA for e1705cd

• Update README.md

  aantn

  committed
  4f87d4a

  Copy full SHA for 4f87d4a

Commits on Jun 25, 2024

• fix typo

  aantn

  committed
  241a193

  Copy full SHA for 241a193

• Update README.md

  aantn

  committed
  888d7e8

  Copy full SHA for 888d7e8

• refactor tool_calling_llm.py

  aantn

  committed
  7226639

  Copy full SHA for 7226639

Commits on Jun 26, 2024

• initial working version of streaming API

  aantn

  committed
  51a9050

  Copy full SHA for 51a9050

• cleanup code + minor improvements

  aantn

  committed
  b64f928

  Copy full SHA for b64f928

• Split tool call streaming into request/result

  aantn

  committed
  c25e2f2

  Copy full SHA for c25e2f2