Forewarned is Forearmed: When Non-Sequential Embedding Turns Into an Anomaly Detector
This paper analyzes non-sequential multimodal sentence-level embeddings, focusing on the SONAR model, to demonstrate that specific embedding dimensions are sensitive to perturbations and can indicate decoding anomalies. By leveraging consistency between successive encoding and decoding, the authors successfully build an accurate anomaly detector.