📄 Attention Is All You Need
| Field | Value | |
|---|---|---|
| Title | Attention Is All You Need | |
| Authors | Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, Illia Polosukhin | |
| Affiliation | ||
| Conference | ||
| Year | 2023 | |
| DOI | 10.48550/arXiv.1706.03762 | |
| Zotero | Open in Zotero | |
| Paper / PDF | ||
| Keywords | [object Object],[object Object] |
Abstract
We propose a new simple network architecture, the Transformer, based solely on attention mechanisms, dispensing with recurrence and convolutions entirely.
We show that the Transformer generalizes well to other tasks by applying it successfully to English constituency parsing both with large and limited training data.
Summary
Key Ideas
Method
Strengths
Limitations
Notes
Annotations
We show that the Transformer generalizes well to other tasks by applying it successfully to English constituency parsing both with large and limited training data.
Page: