You Could’ve Invented Transformers Proposal for a ‘You Could Have Invented Transformers’ tutorial; someone should write a series showing a logical recreation of Transformers from primitive n-gram language models to full-strength Transformers. [Return to blog index]