This paper outlines a systems-oriented workflow for embedded machine learning on microcontroller-class devices. It details key engineering decisions such as data sampling, feature extraction, class imbalance validation, model-runtime co-design, and streaming deployment, using inertial motion recognition and keyword spotting as case studies. The work provides practical design rules for robust on-device inference, including data curation, quantization, thresholding, scheduling, and field monitoring.
Embedded ML Workflow for Microcontroller Edge Devices
Claude Code v2.1.181 Release Notes
Claude Code v2.1.181 introduces support for setting config settings via prompt syntax like /config thinking=false, adds sandbox Apple Events support on macOS, and improves streaming, auto-retry, and subagent behavior. It also fixes numerous bugs related to startup, file handling, clipboard, and UI responsiveness across platforms.
GLM-5.2-FP8 HGX-H200 SGLang Docker Deployment Config
A user shares a Docker configuration for running GLM-5.2-FP8 on HGX-H200 hardware using SGLang. The setup achieves 262k context length and 70 tokens per second with 8 tensor parallelism, using a memory fraction of 0.83. The user notes that vLLM official recipes do not work on H200 due to KV cache FP8 quantization limitations on the DSV3 architecture.
Benchmarks of modded V620 with W6800 firmware on eBay
A modded V620 flashed with W6800 firmware enables mini-DisplayPort output but disables some compute cores, despite higher boost clocks. Benchmarks show Vulkan outperforms ROCm in tensor group (TG) tasks, while ROCm is faster in prompt processing (PP) at longer context depths, with significant performance gains in Q4_K_XL settings.
Qxern-v6 uses latent tokens and AST sidecar for faster, accurate code transfer
The Qxern-v6 system enables two LLMs to communicate via 32 compressed latent tokens while preserving exact symbol accuracy through an adaptive deterministic Abstract Syntax Tree (AST) sidecar. Built by a 15-year-old developer, the architecture uses Qwen2.5-Coder-1.5B to compress code and a frozen Qwen3.5-0.8B decoder to interpret it without seeing raw text.
Coding agent plugin tests show token savings do not equal cost reductions
An analysis of coding agent tasks using GPT-5.6-sol and Codex CLI 0.144.1 demonstrates that reducing context tokens by 90% does not result in proportional cost savings for the complete task.