Bibliography (29):

  1. TalkRL: The Reinforcement Learning Podcast: Aravind Srinivas 2: Aravind Srinivas, Research Scientist at OpenAI, Returns to Talk Decision Transformer, VideoGPT, Choosing Problems, and Explore vs Exploit in Research Careers

  2. ODT: Online Decision Transformer

  3. Attention Is All You Need

  4. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

  5. GPT-3 Creative Fiction § Prompts As Programming

  6. Openai/gym: A Toolkit for Developing and Comparing Reinforcement Learning Algorithms.

  7. https://kzl.github.io/assets/decision_transformer.pdf

  8. https://github.com/kzl/decision-transformer

  9. MuZero: Mastering Atari, Go, Chess and Shogi by Planning with a Learned Model

  10. Reinforcement Learning Upside Down: Don’t Predict Rewards—Just Map Them to Actions

  11. Learning Relative Return Policies With Upside-Down Reinforcement Learning

  12. A Very Unlikely Chess Game

  13. Transformers Play Chess

  14. The Value Equivalence Principle for Model-Based Reinforcement Learning

  15. Shaking the foundations: delusions in sequence models for interaction and control

  16. Trajectory Transformer: Reinforcement Learning as One Big Sequence Modeling Problem

  17. GPT-2 Preference Learning for Music Generation § Decision Transformers: Preference Learning As Simple As Possible

  18. rnn-metadata#inline-metadata-trick

    [Transclude the forward-link's context]

  19. CTRL: A Conditional Transformer Language Model For Controllable Generation

  20. Towards a Human-like Open-Domain Chatbot

  21. Controllable Generation from Pre-trained Language Models via Inverse Prompting

  22. https://architext.design/about/

  23. DALL·E 1: Creating Images from Text: We’ve trained a neural network called DALL·E that creates images from text captions for a wide range of concepts expressible in natural language

  24. CLIP: Connecting Text and Images: We’re introducing a neural network called CLIP which efficiently learns visual concepts from natural language supervision. CLIP can be applied to any visual classification benchmark by simply providing the names of the visual categories to be recognized, similar to the ‘zero-shot’ capabilities of GPT-2 and GPT-3

  25. CogView: Mastering Text-to-Image Generation via Transformers

  26. Choose-Your-Own-Adventure AI Dungeon Games