Bibliography (32):

  1. https://research.google/blog/training-generalist-agents-with-multi-game-decision-transformers/

  2. Gato: A Generalist Agent

  3. Attention Is All You Need

  4. Decision Transformer: Reinforcement Learning via Sequence Modeling

  5. https://sites.google.com/view/multi-game-transformers

  6. Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problems

  7. https://arxiv.org/pdf/2205.15241.pdf#page=8

  8. https://arxiv.org/pdf/2205.15241.pdf#page=7

  9. โ€‹ โ€˜GPTโ€™ directory

  10. https://arxiv.org/pdf/2205.15241.pdf#page=17

  11. Large Batch Optimization for Deep Learning: Training BERT in 76 minutes

  12. Decoupled Weight Decay Regularization

  13. IMPALA: Scalable Distributed Deep-RL with Importance Weighted Actor-Learner Architectures

  14. https://arxiv.org/pdf/2205.15241.pdf#page=21

  15. An Optimistic Perspective on Offline Reinforcement Learning

  16. https://diyhpl.us/~nmz787/pdf/Human-level_control_through_deep_reinforcement_learning.pdf

  17. Off-Policy Deep Reinforcement Learning without Exploration

  18. Scaling Laws for Neural Language Models

  19. PaLM: Scaling Language Modeling with Pathways

  20. PlaNet: Learning Latent Dynamics for Planning from Pixels

  21. Dream to Control: Learning Behaviors by Latent Imagination

  22. DreamerV2: Mastering Atari with Discrete World Models

  23. Scaling Laws for Autoregressive Generative Modeling

  24. From Motor Control to Team Play in Simulated Humanoid Football

  25. Measuring Progress in Deep Reinforcement Learning Sample Efficiency

  26. GPT-3: Language Models are Few-Shot Learners

  27. Podracer architectures for scalable Reinforcement Learning

  28. Wikipedia Bibliography:

    1. Reinforcement learning

    2. Power law

    3. Tensor Processing Unit ยง Fourth generation TPUโ€‰โ€Š:

      https://en.wikipedia.org/wiki/Tensor_Processing_Unit#Fourth_generation_TPU

    4. Convolutional neural network

    5. Q-learning