Learning Light-Weight Translation Models from Deep Transformer

Release time:2024-01-09

Hits:

First Author:: Bei Li, ZiyangWang, Hui Liu, Quan Du, Tong Xiao, Chunliang Zhang, Jingbo Zhu

Translation or Not:: no

Pre One:The NiuTrans's Submission to the IWSLT22 English-to-Chinese Offline Speech Translation Task. IWSLT2022.
Next One:An Efficient Transformer Decoder with Compressed Sub-layers. (AAAI2021)