Initial testing of the DeepSeek v4 Flash model indicates notable enhancements in its user interface and user experience design skills. Despite these improvements, the model is noted to be token hungry.
media
r/LocalLLaMA
·
1h ago
·
open_models
Initial testing of DeepSeek v4 Flash shows significant improvements in UI/UX design capabilities
from English
Related articles
arxiv
arXiv cs.CL
·
4d ago
·
2 views
PIVOT shares prefix scans across query groups to accelerate token-level sparse attention
PIVOT (Proxy Indexing Via One full-prefix Traversal) is a training-free, drop-in replacement for the DeepSeek Sparse Attention (DSA) indexer that reduces computational redundancy by sharing one prefix scan across a group of nearby queries. Instead of scoring every preceding token for each query individually, PIVOT aggregates the group into a single proxy query to obtain a candidate set, from which top-k tokens are selected for each query.
lab
NVIDIA Research
·
4d ago
·
7 views
Clustered Codebook Quantization for 2D Gaussian-based Image Compression
Researchers present Cluster-Guided Vector Quantization (CGVQ), a method designed to improve the rate-distortion performance of Gaussian primitive-based image compression. The approach partitions Gaussian parameters into homogeneous groups prior to quantization, addressing the inefficiency caused by storing large numbers of floating-point parameters per primitive.
lab
Hugging Face Blog
·
9d ago
·
1 view
Diffusers adds native Nunchaku Lite 4-bit inference support
Hugging Face Diffusers now supports loading Nunchaku Lite checkpoints natively via `from_pretrained()`, eliminating the need for a separate inference engine or local CUDA compilation. This integration utilizes the SVDQuant method to run transformer layers with 4-bit weights and activations (W4A4), significantly reducing memory usage while improving inference speed.
media
Hugging Face Forums
·
16d ago
·
13 views
User requests INT8 ConvRot quantization for FireRed Image Edit v1.1
A user on the Hugging Face forums is inquiring about the potential development of an INT8 or FP8 ConvRot version for the FireRed Image Edit v1.1 model.
media
r/LocalLLaMA
·
19d ago
·
3 views
ZimengXiong ports Hunyuan3D to MLX for Apple Silicon and iPhone
Developer ZimengXiong has completed a Swift-MLX and Python MLX port of the Hunyuan3D-Paint and Hunyuan3D-Shape models, enabling local image-to-3D generation on Apple Silicon devices. The work is distributed as the open-source Modelr desktop app for macOS and iOS, along with source code for integrating the technology into Swift applications.