Skip to content

How to set lowvram mode on via settings? #107

@stubkan

Description

@stubkan

The main readme.md says this

On systems with low VRAM you can call config.apply_low_vram_defaults() to reduce the amount of VRAM needed (at the cost of some speed and quality). The default settings use about 6.3GB of VRAM and the low VRAM settings use about 2.7GB.

But I have no idea how to do that. I dont know how to pass the --vram argument because Im using a framework to run the clip interrogator through another script

The closest I've figured out is that Config appears to be set in the clip_interrogator.py file, and is called from there, and I can see this section of it

    def apply_low_vram_defaults(self):
        self.caption_model_name = 'blip-base'
        self.caption_offload = True
        self.clip_offload = True
        self.chunk_size = 1024
        self.flavor_intermediate_count = 1024

Which looks like the settings for low vram mode, I can't see any lowvram disable or enable variable anywhere, or know where to insert one. How do I "call config.apply_low_vram_defaults()" ?

I'm just going to edit the main settings to be like those vars in low_vram, ie, setting chunk size to 1024 instead of 2048 etc, and it works with 6GB VRAM for now

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions