SimpleLoRIF Identifies Training Data Causing Safety Degradation in Fine‑Tuned LLMs

Fine‑tuning LLMs on instruction data can erode safety even without overtly harmful examples; SimpleLoRIF is a gradient embedding method that flags fine‑tuning examples whose gradients align with unsafe behavior, simplifying low‑rank attribution and limiting backpropagation to the final four layers.