gbtb/nix-stable-diffusion
1
1
Fork 0
mirror of https://github.com/gbtb/nix-stable-diffusion.git synced 2024-08-15 22:30:50 +03:00
Code Issues Packages Projects Releases Wiki Activity
Flake for running SD on NixOS
6 Commits 5 Branches 8 Tags 189 KiB
Nix 94.6%
Shell 5.4%
invokeai_nvidia
Go to file
gbtb a018316066 added InvokeAI shell with nvidia support, 
updated readme, removed mkl overlay, changed output devshells names
2022-10-22 18:27:55 +10:00
InvokeAI@a8b794d7e0 small cleanup in shellHook and unused packages, updated submodule 2022-10-18 19:44:06 +10:00
packages small cleanup in shellHook and unused packages, updated submodule 2022-10-18 19:44:06 +10:00
.gitmodules copied flake files 2022-10-17 22:08:44 +10:00
flake.lock copied flake files 2022-10-17 22:08:44 +10:00
flake.nix added InvokeAI shell with nvidia support, 2022-10-22 18:27:55 +10:00
README.md added InvokeAI shell with nvidia support, 2022-10-22 18:27:55 +10:00

README.md

nix-stable-diffusion

Flake for running SD on NixOS

What's done

  • Nix devShell capable of running InvokeAI's flavor of SD without need to fallback for pip or conda (including AMD ROCM support)
  • ...???
  • PROFIT

How to use it?

  1. Clone repo
  2. Clone submodule with InvokeAI
  3. Run nix develop .#invokeai.{default,nvidia,amd}, wait for shell to build
    1. .#invokeai.default builds shell which overrides bare minimum required for SD to run
    2. .#invokeai.amd builds shell which overrides torch packages with ROCM-enabled bin versions
    3. .#invokeai.nvidia builds shell with overlay explicitly setting cudaSupport = true for torch
  4. Inside InvokeAI's directory, run python scripts/preload_models.py to preload models
  5. Place SD weights into models/ldm/stable-diffusion-v1/model.ckpt
  6. Run CLI with python scripts/invoke.py or GUI with python scripts/invoke.py --web
  7. For more detailed instructions consult https://invoke-ai.github.io/InvokeAI/installation/INSTALL_LINUX/

What's needed to be done

  • devShell with CUDA support (should be trivial, but requires volunteer with NVidia GPU)
  • Missing packages definitions should be submitted to Nixpkgs
  • Investigate ROCM device warning on startup
  • Apply patches so that all downloaded models would go into one specific folder
  • Should create a PR to pynixify with "skip-errors mode" so that no ugly patches would be necessary
  • Shell hooks for initial setup?
  • May be this devShell should be itself turned into a package?
  • Add additional flavors of SD ?

Acknowledgements

Many many thanks to https://github.com/cript0nauta/pynixify which generated all the boilerplate for missing python packages.
Also thanks to https://github.com/colemickens/stable-diffusion-flake and https://github.com/skogsbrus/stable-diffusion-nix-flake for inspiration and some useful code snippets.