A Reddit user initiates a discussion regarding the feasibility of using Small Language Models (SLMs) for data compression by intentionally overfitting them on large datasets. The inquiry explores whether achieving "perfect" accuracy through this method can result in meaningful compression ratios. No specific technical results or benchmarks are provided in the source text.
Reddit discussion on using SLMs to compress data via overfitting
from English