Effective Compression of Language Models by Combining Pruning and Knowledge Distillation

Chi-Yu ChiuDing-Yong HongPangfeng LiuJan-Jan Wu2024-10-112024-10-112024-07-02https://scholars.lib.ntu.edu.tw/handle/123456789/721985Effective Compression of Language Models by Combining Pruning and Knowledge Distillationconference paper10.1109/compsac61105.2024.00066