Sygil-Dev/sygil-webui
1
1
Fork 0
mirror of https://github.com/Sygil-Dev/sygil-webui.git synced 2024-12-14 22:13:41 +03:00
Code Issues Projects Releases Wiki Activity

Startup OOM fix (optimized)

Browse Source 
Prevent model from being loaded into VRAM at startup in optimized mode (causes OOM)
This commit is contained in:
oobabooga 2022-08-30 10:00:01 -03:00 committed by hlky
parent 7ad5c4ecd8
commit fe173407fe
1 changed files with 2 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
webui.py
View File

@ -357,7 +357,8 @@ if opt.optimized:
model = instantiate_from_config(config.modelUNet)
_, _ = model.load_state_dict(sd, strict=False)
model.cuda()
if not opt.optimized:
model.cuda()
model.eval()
model.turbo = opt.optimized_turbo