Loading LLäMmlein2Vec using LLM2Vec library #1
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
- Implement load_encoder_model() function in util.py for LLM2Vec integration - Add llm2vec dependency to pyproject.toml - Update all model classes to use the new encoder loading function - Add new model configurations: - LLämmlein2Vec 120M, 1B, and 7B models - ModernGBERT 134M model configuration - Update existing model configs with proper HuggingFace model names - Rename model config files to use correct German umlaut spelling
|
@fynnos I managed to ask my AI friend to remove the unnecessary whitespace formatting. This should make this PR much simpler. The PR is updated |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR should load the LLäMmlein2Vec models using the LLM2Vec library as mentioned in the readme: https://huggingface.co/LSX-UniWue/LLaMmlein2Vec_1B, and also i couldn't resist but add our other models as well ;)
and sorry, my autoformatter ran, before i noticed...
hope it works 🤞🏻 let us know (also about the results 😇)
Best