Feature-based knowledge distillation framework (IMAGE)

Tsinghua University Press

Feature-based knowledge distillation framework

Caption

Feature-based knowledge distillation framework. During the distillation process, the teacher model  is kept frozen, and only the student model, specifically, its LLM backbone is optimized.

Credit

Communications in Transportation Research

Usage Restrictions

Credit must be given to the creator.

License

CC BY

Disclaimer: AAAS and EurekAlert! are not responsible for the accuracy of news releases posted to EurekAlert! by contributing institutions or for the use of any information through the EurekAlert system.