Brief :

Before you read these articles, I think you have known about the Structure of Nerual Network, and to exercise my English Reading bility, I decide to write this series of pages in English.

RNN

RNN Structure

Encode-Decode

Encoder-Decoder

Attention

Attention Structure

Self-Attention

Self-Attention & Multi-Head Attention

Transformer

Transformer

Informer

Informer

Convolutional Self-Attention

Convolutional Self-Attention

Autoformer

Autoformer