Improved Knowledge Distillation for Pre-trained Language Models via Knowledge Selection. EMNLP (Findings) 2022.

Release time:2024-01-09

Hits:

First Author:: Chenglong Wang,Yi Lu,Yongyu Mu,Yimin Hu,Tong Xiao,Jingbo Zhu.

Translation or Not:: no

Pre One:Multi-Path Transformer is Better: A Case Study on Neural Machine Translation. EMNLP (Findings) 2022.
Next One:The NiuTrans's Submission to the IWSLT22 English-to-Chinese Offline Speech Translation Task. IWSLT2022.