Introduction The paper "Attention Is All You Need" by Vaswani et al. (2017) introduced a new neural network architecture called the Transformer, which is based solely on self-attention mechanisms. The…