Match Task to Objective Framework for Encoder-Decoder Models
This study introduces the Match Task to Objective (MTO) framework to align pre-training and fine-tuning objectives with specific tasks. The framework enables automated, unsupervised data adaptation and delivers performance gains of over 120% in few-shot settings, outperforming baselines in both few-shot and full-dataset scenarios. It also enhances prompt-tuning by providing effective soft prompt engineering guidance.