themactep.com

A home of miscellaneous projects by Paul Philippov.

Notes

How to override Ollama model storage location

export OLLAMA_MODELS=/network/storage/path
mkdir -p $OLLAMA_MODELS
chown ollama:ollama $OLLAMA_MODELS
mkdir -p /etc/systemd/system/ollama.service.d
echo "[Service]
Environment=\"OLLAMA_MODELS=$OLLAMA_MODELS\"
" >> /etc/systemd/system/ollama.service.d/override.conf
systemctl daemon-reload
systemctl restart ollama