A user tested the GLM 5.2 model using FP8 precision and FP8 key-value cache quantization on an H200 GPU via SGLang. The evaluation was conducted on the Terminal-Bench 2.1 benchmark suite.

  • The model passed 71 out of 89 tasks, resulting in a score of 79.8%.
  • One task timed out and was not rerun, which may have affected the final score.
  • The test utilized 218,656,815 input tokens with a cache hit rate of 98.8%.

This demonstrates the performance of GLM 5.2 under specific quantization conditions on high-end hardware.