The vLLM project released version 0.25.1, which includes a bugfix for mixed-dtype allreduce RMSNorm quant fusions.

  • The update addresses an issue with mixed-dtype allreduce RMSNorm quant fusions in the framework.