AKMessi releases Kivarro, an open-source Rust/Tauri local LLM inference workbench

AKMessi has released Kivarro v0.1 alpha, an open-source local model inference workbench built with Rust and Tauri. The tool is designed to provide comprehensive runtime control for running GGUF models locally via llama.cpp.

• Features include a GGUF model registry, prompt profiles (Balanced, JSON extraction, code review, long context), and runtime tuning controls.
• It provides a command-center style UI with local API status, logs, benchmarks, and hardware/memory readouts.
• The current release includes a Windows build, while macOS and Linux packaging are still undergoing testing.

The author is seeking feedback from the r/LocalLLaMA community to identify missing features or settings that would improve utility for daily local model workflows.