Experiments with LVT and FRE for Transformer model

Add code
Apr 26, 2020
Ilshat Gibadullin, Aidar Valeev
Figure 1 for Experiments with LVT and FRE for Transformer model
Figure 2 for Experiments with LVT and FRE for Transformer model
Figure 3 for Experiments with LVT and FRE for Transformer model
Figure 4 for Experiments with LVT and FRE for Transformer model

Share this with someone who'll enjoy it:

Twitter IconFacebook IconLinkedin IconWhatsapp IconMessenger Icon

In this paper, we experiment with Large Vocabulary Trick and Feature-rich encoding applied to the Transformer model for Text Summarization. We could not achieve better results, than the analogous RNN-based sequence-to-sequence model, so we tried more models to find out, what improves the results and what deteriorates them.

View paper onarxiv icon

Share this with someone who'll enjoy it:

Twitter IconFacebook IconLinkedin IconWhatsapp IconMessenger Icon