Start your first CLI chat#

This guide starts an interactive local chat using the anna executable.

Before you start#

  • Build ANNA as described in Install and build ANNA.

  • Download or otherwise obtain a compatible local model file.

  • Note the model file’s path.

Run ANNA#

From the repository root, replace the example path with your model file:

./anna -m /path/to/model.gguf

Wait until model loading finishes, type a message, and press Enter. ANNA prints the generated reply and then accepts the next message.

End the session safely#

At an input prompt, enter:

quit()

This asks ANNA to shut down gracefully. It is preferable to interrupting the process while it is working.

Useful next options#

Set the number of CPU threads with -t, limit each reply with -n, and set a context length with -x:

./anna -m /path/to/model.gguf -t 8 -n 256 -x 4096

See the complete CLI option reference.