Skip to content

Latest commit

 

History

History
164 lines (138 loc) · 16.4 KB

CHANGELOG.md

File metadata and controls

164 lines (138 loc) · 16.4 KB

CHANGELOG

Inspired from Keep a Changelog

[1.2.0]

Added

  • Add workflows and scripts for automating model tracing and uploading process by @thanawan-atc in (#209)
  • Add workflow and scripts for automating model listing updating process by @thanawan-atc in (#210)
  • Add script to trigger ml-models-release jenkins workflow with generic webhook by @thanawan-atc in (#211)
  • Add example notebook for tracing and registering a CLIPTextModel to OpenSearch with the Neural Search plugin by @patrickbarnhart in (#283)
  • Add support for train api functionality by @rawwar in (#310)
  • Add support for Model Access Control - Register, Update, Search and Delete by @rawwar in (#332)
  • Add support for model connectors by @rawwar in (#345)
  • Add support for model profiles by @rawwar in (#358)
  • Support for security default admin credential changes in 2.12.0 in (#365)
  • adding cross encoder models in the pre-trained traced list (#378)
  • Add workflows and scripts for sparse encoding model tracing and uploading process by @conggguan in (#394)

Changed

  • Add a parameter for customize the upload folder prefix (#398)
  • Modify ml-models.JenkinsFile so that it takes model format into account and can be triggered with generic webhook by @thanawan-atc in (#211)
  • Update demo_tracing_model_torchscript_onnx.ipynb to use make_model_config_json by @thanawan-atc in (#220)
  • Bump torch from 1.13.1 to 2.0.1 and add onnx dependency by @thanawan-atc (#237)
  • Update pretrained_model_listing.json (2023-08-23 16:51:21) by @dhrubo-os (#248)
  • Store new format of model listing at pretrained_models_all_versions.json instead of pre_trained_models.json in S3 and pretrained_model_listing.json in repo by @thanawan-atc (#256)
  • Make the model tracing-uploading-releasing workflow fail early for ≥2GB model by @thanawan-atc (#258)
  • Rename model/model-listing workflows by @thanawan-atc (#260)
  • Update pretrained_models_all_versions.json (2023-08-30 14:07:38) by @dhrubo-os (#264)
  • Update model upload history - sentence-transformers/msmarco-distilbert-base-tas-b (v.1.0.2)(BOTH) by @dhrubo-os (#272)
  • Enable model listing workflow to exclude old 1.0.0 models from the generated model listing by @thanawan-atc (#265)
  • Have model upload workflow require approval from two code maintainers by @thanawan-atc (#273)
  • Update pretrained_models_all_versions.json (2023-09-08 13:14:07) by @dhrubo-os (#277)
  • Update model upload history - sentence-transformers/distiluse-base-multilingual-cased-v1 (v.1.0.1)(TORCH_SCRIPT) by @dhrubo-os (#281)
  • Update pretrained_models_all_versions.json (2023-09-14 10:28:41) by @dhrubo-os (#282)
  • Enable the model upload workflow to add model_content_size_in_bytes & model_content_hash_value to model config automatically @thanawan-atc (#291)
  • Update pretrained_models_all_versions.json (2023-10-18 18:11:34) by @dhrubo-os (#322)
  • Update model upload history - sentence-transformers/paraphrase-mpnet-base-v2 (v.1.0.0)(BOTH) by @dhrubo-os (#321)
  • Replaced usage of is_datetime_or_timedelta_dtype with is_timedelta64_dtype and is_datetime64_any_dtype by @rawwar (#316)
  • use try-except-else block for handling unexpected exceptions during integration tests by @rawwar(#370)
  • Removed pandas version pin in nox tests by @rawwar (#368)
  • Switch AL2 to AL2023 agent and DockerHub to ECR images in ml-models.JenkinsFile (#377)
  • Refactored validators in ML Commons' client(#385)
  • Update model upload history - opensearch-project/opensearch-neural-sparse-encoding-doc-v2-mini (v.1.0.0)(TORCH_SCRIPT) by @dhrubo-os (#407)
  • Update model upload history - opensearch-project/opensearch-neural-sparse-encoding-doc-v2-distill (v.1.0.0)(TORCH_SCRIPT) by @dhrubo-os (#405)
  • Update model upload history - opensearch-project/opensearch-neural-sparse-encoding-v2-distill (v.1.0.0)(TORCH_SCRIPT) by @dhrubo-os (#410)
  • updating listing file with three v2 sparse model - by @dhrubo-os (#412)
  • Update model upload history - opensearch-project/opensearch-neural-sparse-encoding-doc-v2-mini (v.1.0.0)(TORCH_SCRIPT) by @dhrubo-os (#417)
  • Update model upload history - opensearch-project/opensearch-neural-sparse-encoding-v2-distill (v.1.0.0)(TORCH_SCRIPT) by @dhrubo-os (#419)

Fixed

  • Fix the wrong final zip file name in model_uploader workflow, now will name it by the upload_prefix alse.(#413)
  • Fix the wrong input parameter for model_uploader's base_download_path in jekins trigger.(#402)
  • Enable make_model_config_json to add model description to model config file by @thanawan-atc in (#203)
  • Correct demo_ml_commons_integration.ipynb by @thanawan-atc in (#208)
  • Handle the case when the model max length is undefined in tokenizer by @thanawan-atc in (#219)
  • Change to use tokenCredentialId for triggering ml-models-release via generic webhook by @thanawan-atc in (#240)
  • Fix typo in model/model-listing workflows by @thanawan-atc in (#244)
  • Fix typo in model-listing workflows by @thanawan-atc in (#246)
  • Add BUCKET_NAME to ml-models-release jenkinsfile by @thanawan-atc in (#249)
  • Roll over pretrained_model_listing.json because of ml-commons dependency by @thanawan-atc in (#252)
  • Fix pandas dependency issue in nox session by installing pandas package to python directly by @thanawan-atc in (#266)
  • Fix conditional job execution issue in model upload workflow by @thanawan-atc in (#294)
  • fix bug in MLCommonClient_client.upload_model by @rawwar in (#336)
  • fix lint issues on main by @rawwar in (#374)
  • fix CVE vulnerability by @rawwar in (#383)

[1.1.0]

Added

  • Adding documentation for model group id @dhrubo-os (#176)
  • listing pre-trained release models @dhrubo-os (#85)
  • Upload pretrained models @AlibiZhenis (#111)
  • Added delete task API. @Nurlanprog (#127)
  • Add test coverage statistics to Codecod @Yerzhaisang @bl1nkker (#138)
  • Merging Feature/mcorr to main @dhrubo-os @greaa-aws (#150)
  • Adding boolean argument to ML Commons API @AlibiZhenis (#143)
  • Rename APIs for model serving framework @AlibiZhenis (#159)
  • Adding executeAPI @AlibiZhenis (#165)
  • Adding documentation for model group id @dhrubo-os (#176)
  • Search task added @Nurlanprog (#177)
  • adding jupyter notebook based documentation for metrics correlation algorithm by @AlibiZhenis (#186)

Changed

  • Update jenkins file to use updated docker image (#189)
  • Updated documentation @dhrubo-os (#98)
  • Updating ML Commons API documentation @AlibiZhenis (#156)

Fixed

  • Fix ModelUploader bug & Update model tracing demo notebook by @thanawan-atc in (#185)
  • Fix make_model_config_json function by @thanawan-atc in (#188)
  • Make make_model_config_json function more concise by @thanawan-atc in (#191)
  • Enabled auto-truncation for any pretrained models by @Yerzhaisang in (#192)
  • Generalize make_model_config_json function by @thanawan-atc in (#200)

Added

  • Added multiple notebooks in documentation for better clarification
  • Added integration tests and more functionalities for MLCommons integration
  • Added support for tracing model in Onnx format
  • Add make_model_config function and add doc by @mingshl (#46)
  • Unit test for SentenceTransformerModel by @mingshl in (#52)
  • Notebook_documentation by @dhrubo-os in ([#66]opensearch-project#66)
  • Added download link to the notebook by @dhrubo-os in (#73)

Changed

  • Updating installation instruction by @dhrubo-os in (#41)
  • Refactoring upload_api + added integration test + added load model API by @dhrubo-os in (#54)
  • Updated MAINTAINERS.md format. by @dblock in ([#64]opensearch-project#64)
  • Merged generate.py demo notebook with training notebook by @dhrubo-os in (#67)
  • Tracing model with onnx format + changed OpenSearch version to 2.5.0 (#69)
  • Updating docs workflow to 2.5.0 also by @dhrubo-os(#71)
  • Update notebook + version update by @dhrubo-os in (#76)

Deprecated

Removed

  • Removing os_client dependency + added 2.4.0 version for integration test by @dhrubo-os in (#45)

Fixed

  • Fixed bugs in Training Script
  • Fix file extension issue and add wait for multi-processes by @mingshl in (#42)
  • Fixing train documentation by @dhrubo-os in (#44)
  • Upgrade package version to fix security issues and format code by @mingshl in (#51)
  • Bug fix of SentenceTransformerModel + add integration test from model by @dhrubo-os in (#63)

Security

  • Bump opensearch-py from 2.0.1 to 2.1.1 by @dependabot (#70)

Added

Changed

Deprecated

Removed

Fixed

Security