Pick a model
Choose a model on the left, press Load, then chat. The weights download once from Hugging Face and are cached by your browser. All inference runs on your GPU, and nothing you type is sent anywhere.
Needs a WebGPU browser: Chrome or Edge 113+, Safari 26+, or Firefox 141+ on Windows. Smaller models (230M–1.2B) work on most laptops and many phones. The 8B and VL-3B models need a desktop GPU with 8 GB or more.