-
Notifications
You must be signed in to change notification settings - Fork 4.1k
Open
Labels
pythonPull requests for the Python Semantic KernelPull requests for the Python Semantic Kerneltriage
Description
In this cell
from semantic_kernel import Kernel
from semantic_kernel.connectors.ai.hugging_face import HuggingFaceTextCompletion, HuggingFaceTextEmbedding
from semantic_kernel.core_plugins import TextMemoryPlugin
from semantic_kernel.memory import SemanticTextMemory, VolatileMemoryStore
kernel = Kernel()
# Configure LLM service
if selectedService == Service.HuggingFace:
# Feel free to update this model to any other model available on Hugging Face
text_service_id = "HuggingFaceM4/tiny-random-LlamaForCausalLM"
kernel.add_service(
service=HuggingFaceTextCompletion(
service_id=text_service_id, ai_model_id=text_service_id, task="text-generation"
),
)
embed_service_id = "sentence-transformers/all-MiniLM-L6-v2"
embedding_svc = HuggingFaceTextEmbedding(service_id=embed_service_id, ai_model_id=embed_service_id)
kernel.add_service(
service=embedding_svc,
)
memory = SemanticTextMemory(storage=VolatileMemoryStore(), embeddings_generator=embedding_svc)
kernel.add_plugin(TextMemoryPlugin(memory), "TextMemoryPlugin")
I get ModuleNotFoundError: No module named 'transformers'
In venv
I need to
pip install transformers
pip install torch
pip install sentence_transformers
Which fixes that cell but i still get pip install hf_xet
warnings - probably want to install that also.
Metadata
Metadata
Assignees
Labels
pythonPull requests for the Python Semantic KernelPull requests for the Python Semantic Kerneltriage