ggml-cpu now supports K tails in Power10 Q8/Q4 MMA matmul, removing the requirement that K be divisible by kc. This enables more workloads to use the MMA kernel and reduces fallback to mnpack.
ggml-cpu adds K tails support for Power10 MMA Q8/Q4
from English