Apple is reportedly planning an M7 Ultra chip that will support up to 1.5 TB of unified memory.
The planned specification highlights a significant increase in memory capacity for future Apple silicon.
media
r/LocalLLaMA
·
73d ago
·
open_models
Apple plans M7 Ultra chip with up to 1.5 TB of unified memory
from English
Related articles
media
Hugging Face Forums
·
1h ago
·
1 view
Live
Apple M5 Macs: open model fit computed from specs
The article calculates which open large language models fit into the new Apple M5 series Macs (Mac mini, Mac Studio) by analyzing memory constraints rather than running benchmarks. It determines capacity based on Q4_K_M GGUF file sizes, KV cache requirements, and runtime overhead against the usable GPU memory.
arxiv
arXiv cs.CL
·
82d ago
·
10 views
BaseRT delivers best-in-class LLM inference on Apple Silicon via native Metal
Researchers present BaseRT, a native Metal inference runtime for large language models on Apple Silicon that achieves the highest reported inference throughput to date. By utilizing chip-specific kernel fusion and unified memory-aware optimization, it overcomes the overhead found in existing frameworks like llama.cpp and MLX.
media
r/LocalLLaMA
·
91d ago
·
1 view
Apple to Skip M6 Pro/Max Chips, Fast-Track M7 for Local AI
A recent report indicates that Apple plans to skip the release of M6 Pro and M6 Max chips in its upcoming lineup. Instead, the company intends to fast-track the development of the M7 chip series to better support local artificial intelligence workloads. This strategic shift suggests a prioritization of on-device AI capabilities over traditional performance increments for the Pro tier. The decision reflects Apple's growing emphasis on integrating advanced machine learning features directly into its hardware architecture. By accelerating the M7 timeline, Apple aims to provide more robust neural engine performance for running large language models locally. This move signals a significant pivot in Apple Silicon's development roadmap toward AI-centric design principles.
github
llama.cpp
·
5h ago
·
4 views
llama.cpp b11160 adds int8 coopmat1 matmul for AMD RDNA3/4 and IQ4_XS support
The llama.cpp project released version b11160, introducing an int8 cooperative matrix (coopmat1) implementation for Vulkan on AMD RDNA3 and RDNA4 architectures. This update includes a dedicated shader that probes coopmat values directly to improve performance.
media
Latent Space
·
11h ago
·
1 view
Meta Connect 2026 unveils Muse personal agent, VR glasses, and Charm keychain
At Meta Connect 2026, Meta presented its personal agent Muse as the center of a hardware-plus-agent strategy, introducing new features and devices while teasing a future frontier model. The company showcased Muse's expanded capabilities, including voice and real-time video interactions, alongside new hardware like VR glasses and the Charm keychain.