A node in three commands
Linux node, Android app
- aigw-node pair, install and up take a machine from nothing to a serving node: pair with the hub, install the service (systemd on Linux, launchd on macOS), then add the chat models found on the machine and wait until the hub has the node online. Each command is safe to run again.
- A "tools" setting on a chat model starts llama.cpp with its chat template, so tool calls work on the Anthropic, Responses and chat completions APIs.
- The Android app starts serving when it is opened, also on TVs whose firmware blocks apps from starting themselves after an update.