627904e130fa24135b7d9b80ee6e8a932279daac
mtp-relaxed-decoding/ holds the patch, build, and guide for a custom llama-server with relaxed-acceptance MTP speculative decoding (see its README for the full writeup). Bumps the open-webui submodule to the commit that adds it as a new service, connection, and the ollama-auth proxy swap. Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
Description
No description provided
5.8 MiB
Languages
Python
66.7%
Dockerfile
26.2%
Shell
7.1%