Improving efficiency of sequence-to-sequence network