A study compares post-training methods including supervised fine-tuning (SFT), direct preference optimization (DPO), odds ratio preference optimization (ORPO), and group relative policy optimization (GRPO) on Qwen-based small language models for biomedical data-to-text generation.
- Aligned SLMs outperform proprietary models like GPT-5 in generating medicine package leaflets.
- ORPO outperforms SFT baselines in this specific task.
- GRPO yields the most robust cross-dataset performance among the alignment methods tested as well as GPT-5.
The findings suggest that carefully aligned small language models can achieve superior results compared to larger proprietary alternatives for specialized biomedical translation tasks.