A hybrid ANN-SNN pipeline uses pretrained EfficientNet encoders and converts their activations to spike trains via rate-coding. The system trains a CoLaNET spiking classifier with local plasticity rules, achieving 99.09% accuracy on ImageNet's 64-class benchmark, matching conventional deep networks.
Hybrid ANN-SNN Pipeline with Local Plasticity
Repurposing Speech Classifier for Diffusion-Based Generation
A pretrained speech classifier is repurposed as a backbone for guided diffusion-based speech generation. By attaching a lightweight subnetwork and training it under denoising score matching, the approach achieves high speech quality with reduced memory and computational cost, using a single model instead of two separately trained components.
Learnable Global Merging for Variable-Length Tokenization in Diffusion Transformers
A novel variable-length tokenizer uses learnable global merging to enable cross-length representation alignment in diffusion models. This data-independent approach overcomes position-dependent semantics and improves the quality-compute trade-off on ImageNet 256×25-6 generation compared to prior methods.
SLAI T-Rex enables full-parameter post-training of DeepSeek-V4 on Ascend SuperPOD
SLAI introduces T-Rex, an end-to-end optimization framework for the full-parameter post-training of trillion-parameter-scale MoE models on Ascend NPU SuperPOD. Using the DeepSeek-V4 model family as the target workload, the system addresses memory pressure and communication overhead through hierarchical parallelism and kernel execution optimizations.
SLAI T-Rex enables full-parameter post-training of DeepSeek-V4 on Ascend SuperPOD
SLAI introduces T-Rex, an end-to-end optimization framework for the full-parameter post-training of trillion-parameter-scale MoE models on Ascend NPU SuperPOD. Using the DeepSeek-V4 model family as the target workload, the system addresses memory pressure and communication overhead through hierarchical parallelism and kernel execution optimizations.
NVIDIA NeMo Automodel enables distributed diffusion model fine-tuning with Hugging Face Diffusers
NVIDIA and Hugging Face have integrated NVIDIA NeMo Automodel with the 🤗 Diffusers library to provide production-grade, distributed training for open-source diffusion models. This collaboration allows users to fine-tune any Diffusers-format model on the Hugging Face Hub without requiring checkpoint conversion or model code rewrites.