juspay/services-flake
1
1
Fork 0
mirror of https://github.com/juspay/services-flake.git synced 2024-09-11 04:15:36 +03:00
Code Issues Packages Projects Releases Wiki Activity

chore(docs): ollama: better intro, and GPU pointers

Browse Source
This commit is contained in:
Sridhar Ratnakumar 2024-06-13 14:12:56 -04:00 committed by GitHub
parent 1ab4a8a9aa
commit 4cb3824de9
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 6 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

8
doc/ollama.md
View File

@ -1,6 +1,6 @@
# Ollama
[Ollama](https://github.com/ollama/ollama) enables you to get up and running with Llama 3, Mistral, Gemma, and other large language models.
[Ollama](https://github.com/ollama/ollama) enables you to easily run large language models (LLMs) locally. It supports Llama 3, Mistral, Gemma and [many others](https://ollama.com/library).
## Getting Started
@ -15,7 +15,9 @@
By default Ollama uses the CPU for inference. To enable GPU acceleration:
### Cuda
### CUDA
For NVIDIA GPUs.
```nix
# In `perSystem.process-compose.<name>`
@ -29,6 +31,8 @@ By default Ollama uses the CPU for inference. To enable GPU acceleration:
### ROCm
For Radeon GPUs.
```nix
# In `perSystem.process-compose.<name>`
{