Papers and Architectures

Bahdanau et al. (2014) - Attention Mechanisms

Bahdanau et al.'s 2014 paper introduced neural attention mechanisms, enabling …

Evolution of Model Architectures

From the Perceptron to Transformers, this article traces the historical …

Hochreiter & Schmidhuber (1997) - Long Short-Term Memory (LSTM)

LSTM networks, introduced by Hochreiter and Schmidhuber in 1997, solved the …

LeCun et al. - Convolutional Neural Networks (CNNs)

Yann LeCun's early work on convolutional neural networks established the …

Radford et al. - Generative Pretrained Transformers (GPT)

OpenAI's GPT series expanded the Transformer architecture into a generative …

Rosenblatt (1958) - The Perceptron

Frank Rosenblatt's 1958 introduction of the Perceptron marked the birth of …

Rumelhart et al. (1986) - Backpropagation

The 1986 revival of backpropagation by Rumelhart, Hinton, and Williams enabled …

Sutskever et al. (2014) - Encoder-Decoder Architectures

The encoder-decoder framework, introduced by Sutskever et al. (2014), enabled …

Turing (1950) - Computing Machinery and Intelligence

Alan Turing's 1950 paper proposed the imitation game - now known as the Turing …

Vaswani et al. (2017) - Transformers

Transformers, introduced by Vaswani et al. in 2017, revolutionized sequence …