June 9, 2026
In 2017, eight scientists from the Google research team published in the journal Advances in Neural Info Processing Systems the remarkable article “Attention is all you need,” which introduced a Transformer neural network architecture. The paper has been cited over 173,000 times and ranks among the top 100 most cited papers of the 21st century. It builds on the attention principle introduced in 2014 by Bahdanau, Cho and Turing Award winner Bengio, who proposed neural machine transla ...

