How to Use Pre-Svelte webui in tools/server with latest llama.cpp.

[BradHutchings]

I hope this might help someone who was happy enough with the pre-Svelte webui and having trouble with the Svelte one. My particular problem is that the new Svelte webui won't run right on a non-root web server endpoint. So if I want to use my own UI via the --path parameter, I'd like to keep the default chat UI, but put it on a non-root endpoint.

Here's my process:

1. Clone llama.cpp (or fork).

2. Run this to restore old tools/server/webui direfctory:

rm -r -f tools/server/webui
git checkout 6c019cb04e86e2dacfe62ce7666c64e9717dde1f tools/server/webui/

3. Run this to build the webui:

cd tools/server/webui
npm i
npm run build
cd ../../..

4. Build llama.cpp.

---

I have a feature request for running adding a parameter for the endpoint on which to run the webui:

#16184

You can check out my fork of llama.cpp, called Mmojo-Server. It has a completion UI as default and runs cross-platform as a single binary like llamafile:

https://github.com/BradHutchings/Mmojo-Server

-Brad