ollama

Setup

Windows

Follow the step at ollama

ollama run llama3.1

Serve (optional via 13434 PORT)

Windows

SET OLLAMA_HOST=0.0.0.0:13434
ollama serve