v2.8.12

2.8.12 (2024-06-21)

Bug Fixes

• bump llama.cpp release used in prebuilt binaries (#247) (2137c46)

v3.0.0-beta.32

3.0.0-beta.32 (2024-06-18)

Bug Fixes

• preload error on chat command (#245) (c89178f)

---

Shipped with llama.cpp release b3166

To use the latest llama.cpp release available, run npx --no node-llama-cpp download --release latest. (learn more)

v3.0.0-beta.31

3.0.0-beta.31 (2024-06-17)

Bug Fixes

• remove CUDA binary compression for Windows (#243) (0b85800)
• improve inspect gpu command output (#243) (0b85800)

---

Shipped with llama.cpp release b3166

To use the latest llama.cpp release available, run npx --no node-llama-cpp download --release latest. (learn more)

v3.0.0-beta.30

3.0.0-beta.30 (2024-06-17)

Bug Fixes

• avoid duplicate context shifts (#241) (1e7c5d0)
• onProgress on ModelDownloader (#241) (1e7c5d0)
• re-enable CUDA binary compression (#241) (1e7c5d0)
• more thorough tests before loading a binary (#241) (1e7c5d0)
• increase compatibility of prebuilt binaries (#241) (1e7c5d0)

---

Shipped with llama.cpp release b3166

To use the latest llama.cpp release available, run npx --no node-llama-cpp download --release latest. (learn more)

v3.0.0-beta.29

3.0.0-beta.29 (2024-06-16)

Bug Fixes

• remove CUDA binary compression for now (#238) (0d40ffc)

---

Shipped with llama.cpp release b3153

To use the latest llama.cpp release available, run npx --no node-llama-cpp download --release latest. (learn more)

v3.0.0-beta.28

3.0.0-beta.28 (2024-06-15)

Features

• compress CUDA prebuilt binaries (#236) (b89ad2d)
• automatically solve more CUDA compilation errors (#236) (b89ad2d)

---

Shipped with llama.cpp release b3153

To use the latest llama.cpp release available, run npx --no node-llama-cpp download --release latest. (learn more)

v3.0.0-beta.27

3.0.0-beta.27 (2024-06-12)

Features

• render markdown in the Electron example (#234) (23012d1)

---

Shipped with llama.cpp release b3135

To use the latest llama.cpp release available, run npx --no node-llama-cpp download --release latest. (learn more)

v3.0.0-beta.26

3.0.0-beta.26 (2024-06-11)

Bug Fixes

• async gpu info getters (#232) (56749c7)

---

Shipped with llama.cpp release b3135

To use the latest llama.cpp release available, run npx --no node-llama-cpp download --release latest. (learn more)

v3.0.0-beta.25

3.0.0-beta.25 (2024-06-10)

Bug Fixes

• Electron example build (#230) (73cabcd)

---

Shipped with llama.cpp release b3091

To use the latest llama.cpp release available, run npx --no node-llama-cpp download --release latest. (learn more)

v3.0.0-beta.24

3.0.0-beta.24 (2024-06-09)

Bug Fixes

• Electron example build (#228) (a5f3596)
• rename llamaBins directory to bins (#228) (a5f3596)

---

Shipped with llama.cpp release b3091

To use the latest llama.cpp release available, run npx --no node-llama-cpp download --release latest. (learn more)