Releases: EveripediaNetwork/llmdk
Releases · EveripediaNetwork/llmdk
1.2410.1
- Moved common
generate()
logic toLlmInterface
base class for improved code reuse - Introduced
_execute_request()
method to be implemented by subclasses, enhancing extensibility - Removed duplicate code from provider-specific classes, reducing maintenance overhead
- Made
model_name
optional inLlmInterface
for more flexible initialization - Transitioned from
setup.py
topyproject.toml
for modern Python packaging - Updated version import in
__init__.py
for consistent versioning - Implemented streaming functionality across all supported providers
- Updated README with streaming examples and improved usage instructions for better developer experience
- Refactored
LlmInterface
to support bothgenerate
andstream
methods, providing a unified API - Removed vLLM provider since vLLM servers run preferably with the OpenAI-compatible API
- Updated imports, improved type hints and error handling for increased robustness
1.2410.0
- Update all provider classes to use a unified
generate
method signature - Add support for system prompts and pre-defined message lists
- Implement flexible kwargs handling for provider-specific options
- Replace
max_tokens
andtemperature
params with more generic approach - Update type hints and imports across all provider files
- Improve error handling and default values in provider initializations
- Standardize payload construction and API call patterns
- Remove unused parameters and simplify client instantiations