Transformer and Attention

Created almost 6 years ago, updated 3 months ago

https://en.wikipedia.org/wiki/Transformer_(machine_learning_model)

Sequence Modeling with Neural Networks (Part 2): Attention Models

https://hackernoon.com/attention-mechanism-in-neural-network-30aaf5e39512

Transformers Comprise the Fourth Pillar of Deep Learning

Parents

NLP algorithms

Children

Attention mechanisms