Lab · NVIDIA
arxiv arXiv cs.CL · 2d ago · 13 views

NemotronLabs releases VoiceChat, an open full-duplex speech-to-speech model with tool calling

NemotronLabs has introduced VoiceChat, an open-weight full-duplex speech-to-speech model designed to integrate listening, transcription, reasoning, and speaking within a unified streaming architecture. The system combines a streaming speech encoder and decoder-only language model with parallel specialized output streams for agent text and structured function calls, alongside an auxiliary RNN-T branch for incremental user transcription.

arxiv arXiv cs.AI · 2d ago · 13 views

NemotronLabs releases VoiceChat, an open full-duplex speech-to-speech model with tool calling

NemotronLabs has introduced NemotronLabs VoiceChat, an open-weight full-duplex speech-to-speech model that integrates native tool-calling capabilities within a unified streaming architecture. The system combines a streaming speech encoder and decoder-only language model with parallel output streams for agent text and structured function calls, alongside an auxiliary RNN-T branch for incremental transcription and a streaming TTS decoder.