OpenAI-compatible API server for Rockchip NPU (RK3588/RK3576) running RKLLM models, designed as a drop-in backend for Open WebUI. Built for single-board computers like the Orange Pi 5 Plus, this ...
TrustTunnel extensions for UDP and healthchecks are supported as well, which means dumbproxy server running with HTTPS enabled is compatible with TrustTunnel client. Resilient to DPI (including active ...