FreeToken Desktop

FreeToken Desktop manages local language models, engine installation,
model downloads and an OpenAI-compatible inference server from a
native desktop application.

Open FreeToken Desktop and use Install to download its Python engine
and CUDA dependencies. Models and the engine are stored under
~/snap/freetoken-desktop/common and require several gigabytes of disk
space. Local inference requires a supported NVIDIA GPU and driver.

The desktop can also share the freetoken snap's engine and models
instead of downloading a separate engine.

This snap uses the official Linux desktop package. Desktop updates
are delivered through the Snap Store.