Install and build ANNA

ANNA is currently built from source. The repository’s root Makefile builds the command-line application, server, LISA, and the static ANNA library.

Linux command-line build

Install a C/C++ toolchain and the dependencies required by the enabled build features, then run the following from the repository root:

make

The resulting executables are anna, anna_server, and lisa in the repository root.

Caution

The current Makefile enables CUDA support by default (LLAMA_CUBLAS=1). A working CUDA development environment is therefore required for the default configuration. If you need a CPU-only build, review and adjust the build configuration before running make.

Graphica GUI

Open anna_graphica/anna_graphica.pro in Qt Creator, configure a Release build using Qt 5.15, and select Build. On Linux, build the root library first with make.

Verify the build

After a successful build, run:

./anna

The application prints its usage information when no model has been supplied. Continue with your first command-line chat.