vllm releases v0.24.0rc1, including a fix for topk histogram build issues on SM75. The change is cherry-picked from commit 191826e and signed off by Mohammad Miadh Angkad.
v0.24.0rc1: Fix topk histogram build on SM75
from English
vllm releases v0.24.0rc1, including a fix for topk histogram build issues on SM75. The change is cherry-picked from commit 191826e and signed off by Mohammad Miadh Angkad.