I built an agent Harness for Small Models. I got Qwen 3.5 4b managing servers.

The author developed a specialized agent harness designed to address the specific failure modes of small local models, such as failed tool calls and poor state tracking. This custom framework enables smaller models like Qwen 3.5 4b to effectively manage remote servers.

• The harness targets common issues including failed tool calls, poor environment variable verification, and lack of recovery mechanisms.
• It addresses small model halting during generation and poor separation of local versus remote tasks.
• The solution is built specifically for the Qwen and Gemma families of local models.
• A demonstration shows Qwen 3.5 4b managing remote servers within the harness environment.

The project aims to provide a more stable foundation for running agents on smaller, locally hosted models by tailoring the infrastructure to their specific limitations.