Hi,
I run in two CT containers the following
oobabooga/text-generation-webui
AUTOMATIC1111/stable-diffusion-webui
On their own they each work great, however, only one can be using the VRAM at one time.
As I only have 12gb in my 3060 LHR
I am wondering if you have any script to automate, or other solution, to make the user experience better.
Without having to go into both interfaces and manually unload the model in one then load it in the other.
Something to automate that ?
I run in two CT containers the following
oobabooga/text-generation-webui
AUTOMATIC1111/stable-diffusion-webui
On their own they each work great, however, only one can be using the VRAM at one time.
As I only have 12gb in my 3060 LHR
I am wondering if you have any script to automate, or other solution, to make the user experience better.
Without having to go into both interfaces and manually unload the model in one then load it in the other.
Something to automate that ?