Skip to content

Conversation

@dependabot
Copy link
Contributor

@dependabot dependabot bot commented on behalf of github Sep 15, 2025

Updates the requirements on red-candle to permit the latest version.

Release notes

Sourced from red-candle's releases.

Red Candle v1.3.0 Release Notes

🎉 Ruby 3.1+ Support

Breaking Change: This release expands Ruby compatibility by lowering the minimum required version from Ruby 3.2.0 to Ruby 3.1.0, making Red Candle accessible to more developers and systems.

✨ Major Features

Custom Tokenizer Support for All Models

All safetensors model types (Llama, Mistral, Gemma, Qwen, and Phi) now support custom tokenizers:

# Load a model with a specific tokenizer
llm = Candle::LLM.from_pretrained(
  "model-without-bundled-tokenizer",
  tokenizer: "appropriate-tokenizer-repo"
)
Useful for models that don't include tokenizers or when using specialized tokenizers
llm = Candle::LLM.from_pretrained(
"meta-llama/Llama-2-7b",
tokenizer: "meta-llama/Llama-2-7b-chat-hf"  # Use chat-tuned tokenizer
)

Enhanced Phi Model Support

  • Phi-3-mini-128k models now work correctly
  • Robust configuration preprocessing handles non-standard fields
  • Automatic handling of gegelu activation and ff_intermediate_size parameters
  • Improved compatibility with various Phi-3 model variants

Reranker Performance Improvements

  • Configurable max length for better performance tuning
  • Automatic truncation of long inputs to prevent errors
  • Significant performance optimizations for document ranking tasks
# Configure max length for optimal performance
reranker = Candle::Reranker.from_pretrained(
  "BAAI/bge-reranker-base",
  max_length: 512  # Customize based on your use case
)

🛡️ Security & Stability

Dependency Updates

... (truncated)

Commits
  • f5d8072 Version bump
  • d746824 Removed to pending specs
  • 9b98ef2 Working on error handling for custom tokenizers
  • ce29ef9 Updating the dependencies
  • 4c1357e Implementing custom tokenizers for safetensor models
  • 4a4ac3b Speccing out the custom tokenizer with safetensor code
  • ee8450a Updating the supported models documentation
  • 245a69b Made phi3-mini-128k work and made phi3 loading more robust in general
  • 73d69c5 Implementing custom tokenizers for Phi based safetensor models (only phi so far)
  • 364cfe8 Moving the requirements down to ruby 3.1
  • Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

  • @dependabot rebase will rebase this PR
  • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
  • @dependabot merge will merge this PR after your CI passes on it
  • @dependabot squash and merge will squash and merge this PR after your CI passes on it
  • @dependabot cancel merge will cancel a previously requested merge and block automerging
  • @dependabot reopen will reopen this PR if it is closed
  • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
  • @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
  • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

Updates the requirements on [red-candle](https://github.com/scientist-labs/red-candle) to permit the latest version.
- [Release notes](https://github.com/scientist-labs/red-candle/releases)
- [Commits](scientist-labs/red-candle@1.2.3...1.3.0)

---
updated-dependencies:
- dependency-name: red-candle
  dependency-version: 1.3.0
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
@dependabot @github
Copy link
Contributor Author

dependabot bot commented on behalf of github Sep 15, 2025

Labels

The following labels could not be found: dependencies, ruby. Please create them before Dependabot can add them to a pull request.

Please fix the above issues or remove invalid values from dependabot.yml.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant