Conversational Domain Adaptation of IndicTrans2 via Experience Replay and Model Soups
The authors adapt the open-source IndicTrans2-1B translation system to handle conversational register across 21 Indic languages using only public datasets. By combining experience replay with model souping, they achieve significant improvements in automatic metrics without degrading performance on general domain tasks.