media r/LocalLLaMA · 18h ago · open_models

Base-10's Charlie O'Neill argues Kimi and GLM are better than Opus 5

from English

Charlie O'Neill of Base-10 discusses why the Kimi and GLM models are "almost objectively" superior to Opus 5 in a recent episode featuring Dwarkesh Patel.

The discussion addresses skepticism regarding AI progress, suggesting that researchers have found significant low-hanging fruit rather than hitting data plateaus. It also covers Patel's shift from skepticism to believing the industry is well on its way to creating AGI and RSI.

Importance 2/3 r/LocalLLaMA Moonshot AI OpenAI Zhipu AI Benchmark results

Read original

media Together AI Blog · 24d ago · 30 views

GLM-5.3 and GPT-5.6 Sol cascade solves 85.9% of DeepSWE tasks at $6.61

A comparative analysis of GLM-5.3 and GPT-5.6 Sol on the DeepSWE benchmark reveals that a cascading routing strategy outperforms either model used in isolation. By running GLM-5.3 first and escalating to GPT-5.6 Sol only when tests fail, the system solves 85.9% of tasks at $6.61 per task.

media Together AI Blog · 50d ago · 18 views

Kimi K3 beats GPT-5.6 Sol on DeepSWE pass@4 and costs 64% less

A comparison of Kimi K3 and GPT-5.6 Sol on the DeepSWE benchmark reveals that while GPT-5.6 Sol leads in single-shot quality (72.7% vs 68.5%), Kimi K3 achieves higher pass@k scores for k > 1 at a significantly lower cost.

media MarkTechPost · 58d ago · 43 views

Kimi K3, DeepSeek V4 Pro, and GLM-5.2 compared on benchmarks, license, and serving cost

A comparison of three open-weight sparse Mixture-of-Experts models—Moonshot AI's Kimi K3, DeepSeek V4 Pro, and Zhipu AI's GLM-5.2—evaluates their capabilities, licensing terms, and serving costs for long-horizon coding and agent workloads.

media r/LocalLLaMA · 89d ago · 5 views

GLM-5.2 Outperforms GPT-5.5 in AA-Briefcase Evaluation

Artificial Analysis' new agentic knowledge work evaluation, AA-Briefcase, shows GLM-5.2 surpassing GPT-5.5 in performance. The benchmark assesses real-world task execution and reasoning capabilities in knowledge work scenarios.

arxiv arXiv cs.AI · 2d ago · 10 views

Expert re-grading reveals frontier models near-saturation on physics benchmarks

A study auditing six widely used physics benchmarks finds that reported low scores for frontier language models are largely due to benchmarking errors rather than model deficiencies. Experts reviewed problem statements, reference solutions, and model responses, distinguishing genuine errors from grader mistakes, incorrect references, and ambiguous questions.