Releases: EveripediaNetwork/llmdk
Releases · EveripediaNetwork/llmdk
1.2410.1
- Moved common
generate()logic toLlmInterfacebase class for improved code reuse - Introduced
_execute_request()method to be implemented by subclasses, enhancing extensibility - Removed duplicate code from provider-specific classes, reducing maintenance overhead
- Made
model_nameoptional inLlmInterfacefor more flexible initialization - Transitioned from
setup.pytopyproject.tomlfor modern Python packaging - Updated version import in
__init__.pyfor consistent versioning - Implemented streaming functionality across all supported providers
- Updated README with streaming examples and improved usage instructions for better developer experience
- Refactored
LlmInterfaceto support bothgenerateandstreammethods, providing a unified API - Removed vLLM provider since vLLM servers run preferably with the OpenAI-compatible API
- Updated imports, improved type hints and error handling for increased robustness
1.2410.0
- Update all provider classes to use a unified
generatemethod signature - Add support for system prompts and pre-defined message lists
- Implement flexible kwargs handling for provider-specific options
- Replace
max_tokensandtemperatureparams with more generic approach - Update type hints and imports across all provider files
- Improve error handling and default values in provider initializations
- Standardize payload construction and API call patterns
- Remove unused parameters and simplify client instantiations