arXiv CS AI
techLeft
RAPID: Reliability-Aware Pair Importance Distillationtranslating…
arXiv:2609.05481v1 Announce Type: new
Abstract: Inter example relational distillation transfers a teacher's representation geometry by matching relations among examples within a mini batch. Computing all pairs has quadratic complexity in the batch size, whereas uniform…
Keywords#Distillation#Importance#Importance Distillation#Pair#Pair Importance