Skip to content

Retrieve model chunk size #907

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
billschereriii opened this issue Mar 17, 2022 · 1 comment
Open

Retrieve model chunk size #907

billschereriii opened this issue Mar 17, 2022 · 1 comment

Comments

@billschereriii
Copy link

Is your feature request related to a problem? Please describe.
I don't believe there is a way for the client to retrieve the model chunk size. It can be set via AI.CONFIG, but I see no way to get the current setting back out.

Describe the solution you'd like
The cleanest approach would be to make a new command, say AI.RETRIEVECONFIG, that includes this information. It could also indicate whether the various backends have been loaded, for symmetry with AI.CONFIG

Describe alternatives you've considered
I'm not aware of any alternatives

Additional context
We're implementing model chunking support in SmartSim and are concerned that if one client sets a model chunk size, there is no way for a second to realize that the chunk size has been adjusted. While we're really only implementing AI.CONFIG to test chunking behavior, there could be a larger role for it someday.

@alonre24
Copy link
Collaborator

alonre24 commented Jun 2, 2022

Hey, the new AI.CONFIG GET sub-command was added to RedisAI master version recently (#918), and it will allow you to retrieve the MODEL_CHUNK_SIZE configuration (see here the docs https://oss.redis.com/redisai/master/commands/#aiconfig).
Note that this option will also be available via redisai-py client soon.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants