Topic · Voice & audio
arxiv arXiv cs.CL · 2d ago · 13 views

NemotronLabs releases VoiceChat, an open full-duplex speech-to-speech model with tool calling

NemotronLabs has introduced VoiceChat, an open-weight full-duplex speech-to-speech model designed to integrate listening, transcription, reasoning, and speaking within a unified streaming architecture. The system combines a streaming speech encoder and decoder-only language model with parallel specialized output streams for agent text and structured function calls, alongside an auxiliary RNN-T branch for incremental user transcription.

arxiv arXiv cs.AI · 2d ago · 13 views

NemotronLabs releases VoiceChat, an open full-duplex speech-to-speech model with tool calling

NemotronLabs has introduced NemotronLabs VoiceChat, an open-weight full-duplex speech-to-speech model that integrates native tool-calling capabilities within a unified streaming architecture. The system combines a streaming speech encoder and decoder-only language model with parallel output streams for agent text and structured function calls, alongside an auxiliary RNN-T branch for incremental transcription and a streaming TTS decoder.

media Hugging Face Forums · 13d ago · 12 views

Aiden proposes splitting real-time voice and task execution into separate models

Aiden describes an architecture for agents that requires full-duplex voice conversation alongside complex visual reasoning and device actions, avoiding the limitation of a single model handling both. The solution splits responsibilities: a real-time voice model manages the conversation while a separate, stronger model executes background tasks, coordinating asynchronously via a task queue.