Skip to content

Commit

Permalink
vault backup: 2024-03-29 - 1 files
Browse files Browse the repository at this point in the history
Affected files:
Resources/Understanding Transformers.md
  • Loading branch information
swyx committed Mar 30, 2024
1 parent 0590d74 commit 3a2c205
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions Resources/Understanding Transformers.md
Original file line number Diff line number Diff line change
Expand Up @@ -11,6 +11,7 @@ ELI5: https://news.ycombinator.com/item?id=35977891
- 2018 - Noam Shazeer on why you should train >1B models https://youtu.be/9P_VAMyb-7k and https://youtu.be/P8FJVfg3Z44
- FT coverage of the paper authors and when and how they left https://archive.is/2023.07.23-044102/https://www.ft.com/content/37bb01af-ee46-4483-982f-ef3921436a50
- backstory on the title https://news.ycombinator.com/item?id=38758413
- aidan gomez [says](https://x.com/aidangomez/status/1773863558482202986?s=46&t=90xQ8sGy63D2OtiaoGJuww) the image was made with adobe illustrator
The Illustrated Transformer - [https://jalammar.github.io/illustrated-transformer/](https://jalammar.github.io/illustrated-transformer/)
- GPT in 60LOC https://jaykmody.com/blog/gpt-from-scratch/
- pre read https://jaykmody.com/blog/attention-intuition/
Expand Down

0 comments on commit 3a2c205

Please sign in to comment.