2021-04-13
Transformer architecture Reference Transformer: A Novel Neural Network Architecture for Language Understanding - An introduction of Transformer from Google AI Blog Tutorials The Illustrated Transformer - Detailed explanation with tons of illustrations 👍🔥
2021-04-11
Human Attention The visual attention mechanism is a signal processing mechanism in the brain that is unique to human vision. By quickly scanning the global image, human vision obtains a target area to focus on, which is generally referred to as the focus of attention, and then devotes more attentional resources to this area to obtain more detailed information about the target to be focused on and suppress other useless information.
2021-04-11