AI Upskilling (Part 2) – Readings
Some important papers in the history of AI since 2017 2017 Vaswani et al (2017) Attention Is All You Need URL: https://arxiv.org/abs/1706.03762v5 Why important – transformer architecture (working memory) 1. demo of neural net attention heads (like short-term or working memory (WM)) 2. simplified task – predicting the next item in the sequence from past …