TUNEAHEAD is a lightweight framework that predicts fine-tuning performance using meta-feature vectors from dataset descriptors and short probe runs. It outperforms baselines like Early-Stop Extrapolation and ProxyLM, achieving an RMSE of 1.47 percentage points and 95.1% of predictions within ±3 percentage points of true scores on 370 held-out runs.
TUNEAHEAD Predicts Fine-tuning Performance Before Training
from English