Lemonade v10.8 introduces dynamic VRAM management that auto-unloads idle models and downsizes KV-cache to reclaim GPU memory. It adds cloud offload support for OpenAI-compatible providers, enabling local-first model serving with optional cloud routing. A new MCP gateway exposes local models as tools via POST /mcp, allowing local models to be used as tools in MCP-aware applications.
media
r/LocalLLaMA
·
53d ago
·
open_models
Lemonade v10.8 Releases Auto Memory Management, Cloud Offload, and MCP Tool Support
from English
Related articles
arxiv
arXiv cs.LG
·
46d ago
·
2 views
ASCII Art Enables Text-Only LLMs to Control VLA Systems
A text-only large language model can be adapted into a Vision--Language--Action controller by using ASCII-rendered visual observations. This approach allows LLMs to interpret visual states through text, enabling them to follow natural-language instructions and generate executable actions in both simulation and on physical manipulators.
media
r/LocalLLaMA
·
46d ago
·
4 views
Qwen releases 35B-parameter MoE for agent environment simulation
Qwen has launched Qwen-AgentWorld-35B-A3B, a 35B-parameter MoE model with only about 3B active parameters per token. It is trained to simulate responses from MCP, terminal, software engineering, Android, web, and OS GUI environments by predicting next observations after agent actions, enabling efficient agent training and environment simulation without real tool execution.
lab
Claude Code Releases
·
2d ago
·
8 views
Claude Code v2.1.225 adds gateway spend-limit warnings and workspace trust prompts
Anthropic released Claude Code version 2.1.225, introducing new usage warnings for gateway spend limits and a workspace trust prompt for untrusted directories. The update also addresses several authentication issues, including transient 401 errors in headless sessions and intermittent failures on macOS keychain reads.
media
Hugging Face Forums
·
2d ago
·
1 view
LoopTroop: local GUI for long AI coding tasks using LLM councils and Ralph loops
LoopTroop is an open-source, local-first GUI application designed to manage multi-step coding tickets while preventing context rot. It employs a structured approach to avoid the issues associated with single-model, massive-prompt workflows.
lab
Claude Code Releases
·
2d ago
·
1 view
Claude Code v2.1.224 adds self-hosted runners and cross-session messaging
Anthropic has released Claude Code version 2.1.224, introducing significant new capabilities for deployment and session management alongside various bug fixes.