RL scaling tag

[Warning: JS Disabled!]

[For support of website features (link annotation popups/popins & transclusions, collapsible sections, tablesorting, image zooming, sidenotes etc), you must enable JavaScript!]

See Also
Links
Miscellaneous
Link Bibliography

See Also

Parent

Links

“Scaling Laws for Single-agent Reinforcement Learning”, Hilton Et Al 2023

“Scaling laws for single-agent reinforcement learning”

“DreamerV3: Mastering Diverse Domains through World Models”, Hafner Et Al 2023

“DreamerV3: Mastering Diverse Domains through World Models”

“VeLO: Training Versatile Learned Optimizers by Scaling Up”, Metz Et Al 2022

“VeLO: Training Versatile Learned Optimizers by Scaling Up”

“Scaling Laws for Reward Model Overoptimization”, Gao Et Al 2022

“Scaling Laws for Reward Model Overoptimization”

“SAP: Bidirectional Language Models Are Also Few-shot Learners”, Patel Et Al 2022

“SAP: Bidirectional Language Models Are Also Few-shot Learners”

“Human-level Atari 200× Faster”, Kapturowski Et Al 2022

“Human-level Atari 200× faster”

“Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learned”, Ganguli Et Al 2022

“Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learned”

“AlexaTM 20B: Few-Shot Learning Using a Large-Scale Multilingual Seq2Seq Model”, Soltan Et Al 2022

“AlexaTM 20B: Few-Shot Learning Using a Large-Scale Multilingual Seq2Seq Model”

“TextWorldExpress: Simulating Text Games at One Million Steps Per Second”, Jansen & Côté2022

“TextWorldExpress: Simulating Text Games at One Million Steps Per Second”

“Video PreTraining (VPT): Learning to Act by Watching Unlabeled Online Videos”, Baker Et Al 2022

“Video PreTraining (VPT): Learning to Act by Watching Unlabeled Online Videos”

“Multi-Game Decision Transformers”, Lee Et Al 2022

“Multi-Game Decision Transformers”

“Task-Agnostic Continual Reinforcement Learning: In Praise of a Simple Baseline (3RL)”, Caccia Et Al 2022

“Task-Agnostic Continual Reinforcement Learning: In Praise of a Simple Baseline (3RL)”

“CT0: Fine-tuned Language Models Are Continual Learners”, Scialom Et Al 2022

“CT0: Fine-tuned Language Models are Continual Learners”

“Flexible Diffusion Modeling of Long Videos”, Harvey Et Al 2022

“Flexible Diffusion Modeling of Long Videos”

“Instruction Induction: From Few Examples to Natural Language Task Descriptions”, Honovich Et Al 2022

“Instruction Induction: From Few Examples to Natural Language Task Descriptions”

“Gato: A Generalist Agent”, Reed Et Al 2022

“Gato: A Generalist Agent”

“Data Distributional Properties Drive Emergent Few-Shot Learning in Transformers”, Chan Et Al 2022

“Data Distributional Properties Drive Emergent Few-Shot Learning in Transformers”

“Habitat-Web: Learning Embodied Object-Search Strategies from Human Demonstrations at Scale”, Ramrakhya Et Al 2022

“Habitat-Web: Learning Embodied Object-Search Strategies from Human Demonstrations at Scale”

“Do As I Can, Not As I Say (SayCan): Grounding Language in Robotic Affordances”, Ahn Et Al 2022

“Do As I Can, Not As I Say (SayCan): Grounding Language in Robotic Affordances”

“Socratic Models: Composing Zero-Shot Multimodal Reasoning With Language”, Zeng Et Al 2022

“Socratic Models: Composing Zero-Shot Multimodal Reasoning with Language”

“It Looks Like You’re Trying To Take Over The World”, Gwern 2022

“It Looks Like You’re Trying To Take Over The World”

“InstructGPT: Training Language Models to Follow Instructions With Human Feedback”, Ouyang Et Al 2022

“InstructGPT: Training language models to follow instructions with human feedback”

“A Data-driven Approach for Learning to Control Computers”, Humphreys Et Al 2022

“A data-driven approach for learning to control computers”

“EvoJAX: Hardware-Accelerated Neuroevolution”, Tang Et Al 2022

“EvoJAX: Hardware-Accelerated Neuroevolution”

“Accelerated Quality-Diversity for Robotics through Massive Parallelism”, Lim Et Al 2022

“Accelerated Quality-Diversity for Robotics through Massive Parallelism”

“Can Wikipedia Help Offline Reinforcement Learning?”, Reid Et Al 2022

“Can Wikipedia Help Offline Reinforcement Learning?”

“In Defense of the Unitary Scalarization for Deep Multi-Task Learning”, Kurin Et Al 2022

“In Defense of the Unitary Scalarization for Deep Multi-Task Learning”

“The Effects of Reward Misspecification: Mapping and Mitigating Misaligned Models”, Pan Et Al 2022

“The Effects of Reward Misspecification: Mapping and Mitigating Misaligned Models”

“WebGPT: Improving the Factual Accuracy of Language Models through Web Browsing”, Hilton Et Al 2021

“WebGPT: Improving the factual accuracy of language models through web browsing”

“WebGPT: Browser-assisted Question-answering With Human Feedback”, Nakano Et Al 2021

“WebGPT: Browser-assisted question-answering with human feedback”

“Acquisition of Chess Knowledge in AlphaZero”, McGrath Et Al 2021

“Acquisition of Chess Knowledge in AlphaZero”

“AW-Opt: Learning Robotic Skills With Imitation and Reinforcement at Scale”, Lu Et Al 2021

“AW-Opt: Learning Robotic Skills with Imitation and Reinforcement at Scale”

“An Explanation of In-context Learning As Implicit Bayesian Inference”, Xie Et Al 2021

“An Explanation of In-context Learning as Implicit Bayesian Inference”

“Procedural Generalization by Planning With Self-Supervised World Models”, Anand Et Al 2021

“Procedural Generalization by Planning with Self-Supervised World Models”

“MetaICL: Learning to Learn In Context”, Min Et Al 2021

“MetaICL: Learning to Learn In Context”

“T0: Multitask Prompted Training Enables Zero-Shot Task Generalization”, Sanh Et Al 2021

“T0: Multitask Prompted Training Enables Zero-Shot Task Generalization”

“Collaborating With Humans without Human Data”, Strouse Et Al 2021

“Collaborating with Humans without Human Data”

“Bridge Data: Boosting Generalization of Robotic Skills With Cross-Domain Datasets”, Ebert Et Al 2021

“Bridge Data: Boosting Generalization of Robotic Skills with Cross-Domain Datasets”

“Learning to Walk in Minutes Using Massively Parallel Deep Reinforcement Learning”, Rudin Et Al 2021

“Learning to Walk in Minutes Using Massively Parallel Deep Reinforcement Learning”

“Recursively Summarizing Books With Human Feedback”, Wu Et Al 2021

“Recursively Summarizing Books with Human Feedback”

“FLAN: Finetuned Language Models Are Zero-Shot Learners”, Wei Et Al 2021

“FLAN: Finetuned Language Models Are Zero-Shot Learners”

“Learning Language-Conditioned Robot Behavior from Offline Data and Crowd-Sourced Annotation”, Nair Et Al 2021

“Learning Language-Conditioned Robot Behavior from Offline Data and Crowd-Sourced Annotation”

“WarpDrive: Extremely Fast End-to-End Deep Multi-Agent Reinforcement Learning on a GPU”, Lan Et Al 2021

“WarpDrive: Extremely Fast End-to-End Deep Multi-Agent Reinforcement Learning on a GPU”

“Multi-Task Self-Training for Learning General Representations”, Ghiasi Et Al 2021

“Multi-Task Self-Training for Learning General Representations”

“Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learning”, Makoviychuk Et Al 2021

“Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learning”

“Open-Ended Learning Leads to Generally Capable Agents”, Team Et Al 2021

“Open-Ended Learning Leads to Generally Capable Agents”

“Megaverse: Simulating Embodied Agents at One Million Experiences per Second”, Petrenko Et Al 2021

“Megaverse: Simulating Embodied Agents at One Million Experiences per Second”

“Evaluating Large Language Models Trained on Code”, Chen Et Al 2021

“Evaluating Large Language Models Trained on Code”

“Unbiased Gradient Estimation in Unrolled Computation Graphs With Persistent Evolution Strategies”, Vicol Et Al 2021

“Unbiased Gradient Estimation in Unrolled Computation Graphs with Persistent Evolution Strategies”

“Multimodal Few-Shot Learning With Frozen Language Models”, Tsimpoukelli Et Al 2021

“Multimodal Few-Shot Learning with Frozen Language Models”

“Brax—A Differentiable Physics Engine for Large Scale Rigid Body Simulation”, Freeman Et Al 2021

“Brax—A Differentiable Physics Engine for Large Scale Rigid Body Simulation”

“PIGLeT: Language Grounding Through Neuro-Symbolic Interaction in a 3D World”, Zellers Et Al 2021

“PIGLeT: Language Grounding Through Neuro-Symbolic Interaction in a 3D World”

“From Motor Control to Team Play in Simulated Humanoid Football”, Liu Et Al 2021

“From Motor Control to Team Play in Simulated Humanoid Football”

“Reward Is Enough”, Silver Et Al 2021

“Reward is enough”

“MuZero Unplugged: Online and Offline Reinforcement Learning by Planning With a Learned Model”, Schrittwieser Et Al 2021

“MuZero Unplugged: Online and Offline Reinforcement Learning by Planning with a Learned Model”

“Podracer Architectures for Scalable Reinforcement Learning”, Hessel Et Al 2021

“Podracer architectures for scalable Reinforcement Learning”

“Scaling Scaling Laws With Board Games”, Jones2021

“Scaling Scaling Laws with Board Games”

“Large Batch Simulation for Deep Reinforcement Learning”, Shacklett Et Al 2021

“Large Batch Simulation for Deep Reinforcement Learning”

“Investment vs. Reward in a Competitive Knapsack Problem”, Neumann & Gros2021

“Investment vs. reward in a competitive knapsack problem”

“NNUE: The Neural Network of the Stockfish Chess Engine”, Goucher2021

“NNUE: The neural network of the Stockfish chess engine”

“Imitating Interactive Intelligence”, Abramson Et Al 2020

“Imitating Interactive Intelligence”

“Scaling down Deep Learning”, Greydanus2020

“Scaling down Deep Learning”

“Understanding RL Vision: With Diverse Environments, We Can Analyze, Diagnose and Edit Deep Reinforcement Learning Models Using Attribution”, Hilton Et Al 2020

“Understanding RL Vision: With diverse environments, we can analyze, diagnose and edit deep reinforcement learning models using attribution”

“Meta-trained Agents Implement Bayes-optimal Agents”, Mikulik Et Al 2020

“Meta-trained agents implement Bayes-optimal agents”

“Measuring Progress in Deep Reinforcement Learning Sample Efficiency”, Anonymous2020

“Measuring Progress in Deep Reinforcement Learning Sample Efficiency”

“Learning to Summarize from Human Feedback”, Stiennon Et Al 2020

“Learning to summarize from human feedback”

“Measuring Hardware Overhang”, Hippke 2020

“Measuring hardware overhang”

“Sample Factory: Egocentric 3D Control from Pixels at 100,000 FPS With Asynchronous Reinforcement Learning”, Petrenko Et Al 2020

“Sample Factory: Egocentric 3D Control from Pixels at 100,000 FPS with Asynchronous Reinforcement Learning”

“The Scaling Hypothesis”, Gwern 2020

“The Scaling Hypothesis”

“Agent57: Outperforming the Human Atari Benchmark”, Puigdomènech Et Al 2020

“Agent57: Outperforming the human Atari benchmark”

“Deep Neuroethology of a Virtual Rodent”, Merel Et Al 2020

“Deep neuroethology of a virtual rodent”

“Near-perfect Point-goal Navigation from 2.5 Billion Frames of Experience”, Wijmans & Kadian2020

“Near-perfect point-goal navigation from 2.5 billion frames of experience”

“Procgen Benchmark: We’re Releasing Procgen Benchmark, 16 Simple-to-use Procedurally-generated Environments Which Provide a Direct Measure of How Quickly a Reinforcement Learning Agent Learns Generalizable Skills”, Cobbe Et Al 2019

“Procgen Benchmark: We’re releasing Procgen Benchmark, 16 simple-to-use procedurally-generated environments which provide a direct measure of how quickly a reinforcement learning agent learns generalizable skills”

“DD-PPO: Learning Near-Perfect PointGoal Navigators from 2.5 Billion Frames”, Wijmans Et Al 2019

“DD-PPO: Learning Near-Perfect PointGoal Navigators from 2.5 Billion Frames”

“Grandmaster Level in StarCraft II Using Multi-agent Reinforcement Learning”, Vinyals Et Al 2019

“Grandmaster level in StarCraft II using multi-agent reinforcement learning”

“Solving Rubik’s Cube With a Robot Hand”, OpenAI Et Al 2019

“Solving Rubik’s Cube with a Robot Hand”

“Fine-Tuning Language Models from Human Preferences”, Ziegler Et Al 2019

“Fine-Tuning Language Models from Human Preferences”

“Emergent Tool Use from Multi-Agent Interaction § Surprising Behavior”, Baker Et Al 2019

“Emergent Tool Use from Multi-Agent Interaction § Surprising behavior”

“Meta Reinforcement Learning”, Weng2019

“Meta Reinforcement Learning”

“Human-level Performance in 3D Multiplayer Games With Population-based Reinforcement Learning”, Jaderberg Et Al 2019

“Human-level performance in 3D multiplayer games with population-based reinforcement learning”

“AI-GAs: AI-generating Algorithms, an Alternate Paradigm for Producing General Artificial Intelligence”, Clune2019

“AI-GAs: AI-generating algorithms, an alternate paradigm for producing general artificial intelligence”

“Meta-learning of Sequential Strategies”, Ortega Et Al 2019

“Meta-learning of Sequential Strategies”

“Habitat: A Platform for Embodied AI Research”, Savva Et Al 2019

“Habitat: A Platform for Embodied AI Research”

“The Bitter Lesson”, Sutton2019

“The Bitter Lesson”

“Benchmarking Classic and Learned Navigation in Complex 3D Environments”, Mishkin Et Al 2019

“Benchmarking Classic and Learned Navigation in Complex 3D Environments”

“Dota 2 With Large Scale Deep Reinforcement Learning: §4.3: Batch Size”, Berner & Al 2019 (page 13)

“Dota 2 with Large Scale Deep Reinforcement Learning: §4.3: Batch Size”

“How AI Training Scales”, McCandlish Et Al 2018

“How AI Training Scales”

“An Empirical Model of Large-Batch Training”, McCandlish Et Al 2018

“An Empirical Model of Large-Batch Training”

“Bayesian Layers: A Module for Neural Network Uncertainty”, Tran Et Al 2018

“Bayesian Layers: A Module for Neural Network Uncertainty”

“Quantifying Generalization in Reinforcement Learning”, Cobbe Et Al 2018

“Quantifying Generalization in Reinforcement Learning”

“One-Shot High-Fidelity Imitation: Training Large-Scale Deep Nets With RL”, Paine Et Al 2018

“One-Shot High-Fidelity Imitation: Training Large-Scale Deep Nets with RL”

“Robot Learning in Homes: Improving Generalization and Reducing Dataset Bias”, Gupta Et Al 2018

“Robot Learning in Homes: Improving Generalization and Reducing Dataset Bias”

“Human-level Performance in First-person Multiplayer Games With Population-based Deep Reinforcement Learning”, Jaderberg Et Al 2018

“Human-level performance in first-person multiplayer games with population-based deep reinforcement learning”

“QT-Opt: Scalable Deep Reinforcement Learning for Vision-Based Robotic Manipulation”, Kalashnikov Et Al 2018

“QT-Opt: Scalable Deep Reinforcement Learning for Vision-Based Robotic Manipulation”

“Playing Atari With Six Neurons”, Cuccu Et Al 2018

“Playing Atari with Six Neurons”

“AI and Compute”, Amodei Et Al 2018

“AI and Compute”

“One Big Net For Everything”, Schmidhuber2018

“One Big Net For Everything”

“Interactive Grounded Language Acquisition and Generalization in a 2D World”, Yu Et Al 2018

“Interactive Grounded Language Acquisition and Generalization in a 2D World”

“Emergence of Locomotion Behaviors in Rich Environments”, Heess Et Al 2017

“Emergence of Locomotion behaviors in Rich Environments”

“Deep Reinforcement Learning from Human Preferences”, Christiano Et Al 2017

“Deep reinforcement learning from human preferences”

“Research Ideas”, Branwen2017

“Research Ideas”

“Evolution Strategies As a Scalable Alternative to Reinforcement Learning”, Salimans Et Al 2017

“Evolution Strategies as a Scalable Alternative to Reinforcement Learning”

“Why Tool AIs Want to Be Agent AIs”, Gwern 2016

“Why Tool AIs Want to Be Agent AIs”

“On Learning to Think: Algorithmic Information Theory for Novel Combinations of Reinforcement Learning Controllers and Recurrent Neural World Models”, Schmidhuber2015

“On Learning to Think: Algorithmic Information Theory for Novel Combinations of Reinforcement Learning Controllers and Recurrent Neural World Models”

“Gorila: Massively Parallel Methods for Deep Reinforcement Learning”, Nair Et Al 2015

“Gorila: Massively Parallel Methods for Deep Reinforcement Learning”

“Algorithmic Progress in Six Domains”, Grace2013

“Algorithmic Progress in Six Domains”

“Robot Predictions Evolution”, Moravec2004

“Robot Predictions Evolution”

“When Will Computer Hardware Match the Human Brain?”, Moravec1998

“When will computer hardware match the human brain?”

“Human Window on the World”, Michie1985

“Human Window on the World”

“Submission #6347: Chef Stef’s NES Arkanoid ‘Warpless’ In 11:11.18”

“Submission #6347: Chef Stef’s NES Arkanoid 'warpless' in 11:11.18”

“Training a CUDA TDS Ant Using C++ ARS Linear Policy: The Video Is Real-time, After a Few Minutes (in the 30 Million Steps) the Training Curve Is Flat (I Trained Until a Billion Steps). Note That This Ant Is PD Control, and Not Identical to Either MuJoCo or PyBullet Ant, so the Training Curves Are Not Comparable Yet. Will Fix That.”

“Training a CUDA TDS Ant using C++ ARS Linear policy: The video is real-time, after a few minutes (in the 30 million steps) the training curve is flat (I trained until a billion steps). Note that this Ant is PD control, and not identical to either MuJoCo or PyBullet Ant, so the training curves are not comparable yet. Will fix that.”

“Ilya Sutskever: Deep Learning | AI Podcast #94 With Lex Fridman”

“Ilya Sutskever: Deep Learning | AI Podcast #94 with Lex Fridman”

“If You Want to Solve a Hard Problem in Reinforcement Learning, You Just Scale. It’s Just Gonna Work Just like Supervised Learning. It’s the Same, the Same Story Exactly. It Was Kind of Hard to Believe That Supervised Learning Can Do All Those Things, but It’s Not Just Vision, It’s Everything and the Same Thing Seems to Hold for Reinforcement Learning Provided You Have a Lot of Experience.”

“If you want to solve a hard problem in reinforcement learning, you just scale. It's just gonna work just like supervised learning. it's the same, the same story exactly. It was kind of hard to believe that supervised learning can do all those things, but it's not just vision, it's everything and the same thing seems to hold for reinforcement learning provided you have a lot of experience.”

Miscellaneous

Link Bibliography

https://arxiv.org/abs/2301.04104#deepmind: “DreamerV3: Mastering Diverse Domains through World Models”⁠, Danijar Hafner, Jurgis Pasukonis, Jimmy Ba, Timothy Lillicrap

link-bibliography
https://arxiv.org/abs/2210.10760#openai: “Scaling Laws for Reward Model Overoptimization”⁠, Leo Gao, John Schulman, Jacob Hilton

link-bibliography
https://arxiv.org/abs/2209.14500: “SAP: Bidirectional Language Models Are Also Few-shot Learners”⁠, Ajay Patel, Bryan Li, Mohammad Sadegh Rasooli, Noah Constant, Colin Raffel, Chris Callison-Burch

link-bibliography
https://arxiv.org/abs/2209.07550#deepmind: “Human-level Atari 200× Faster”⁠, Steven Kapturowski, Víctor Campos, Ray Jiang, Nemanja Rakićević, Hado van Hasselt, Charles Blundell, Adrià Puigdomènech Badia

link-bibliography
https://www.anthropic.com/red_teaming.pdf: “Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learned”⁠, Deep Ganguli, Liane Lovitt, Jackson Kernion, Amanda Askell, Yuntao Bai, Saurav Kadavath, Ben Mann, Ethan Perez

link-bibliography
https://arxiv.org/abs/2208.01448#amazon: “AlexaTM 20B: Few-Shot Learning Using a Large-Scale Multilingual Seq2Seq Model”⁠, Saleh Soltan, Shankar Ananthakrishnan, Jack FitzGerald, Rahul Gupta, Wael Hamza, Haidar Khan, Charith Peris

link-bibliography
https://arxiv.org/abs/2206.11795#openai: “Video PreTraining (VPT): Learning to Act by Watching Unlabeled Online Videos”⁠, Bowen Baker, Ilge Akkaya, Peter Zhokhov, Joost Huizinga, Jie Tang, Adrien Ecoffet, Brandon Houghton, Raul Sampedro

link-bibliography
https://arxiv.org/abs/2205.15241#google: “Multi-Game Decision Transformers”⁠, Kuang-Huei Lee, Ofir Nachum, Mengjiao Yang, Lisa Lee, Daniel Freeman, Winnie Xu, Sergio Guadarrama, Ian Fischer

link-bibliography
https://arxiv.org/abs/2205.12393#facebook: “CT0: Fine-tuned Language Models Are Continual Learners”⁠, Thomas Scialom, Tuhin Chakrabarty, Smaranda Muresan

link-bibliography
https://arxiv.org/abs/2205.06175#deepmind: “Gato: A Generalist Agent”⁠, Scott Reed, Konrad Zolna, Emilio Parisotto, Sergio Gomez Colmenarejo, Alexander Novikov, Gabriel Barth-Maron

link-bibliography
https://arxiv.org/abs/2204.03514#facebook: “Habitat-Web: Learning Embodied Object-Search Strategies from Human Demonstrations at Scale”⁠, Ram Ramrakhya, Eric Undersander, Dhruv Batra, Abhishek Das

link-bibliography
https://arxiv.org/abs/2204.01691#google: “Do As I Can, Not As I Say (SayCan): Grounding Language in Robotic Affordances”⁠, Michael Ahn, Anthony Brohan, Noah Brown, Yevgen Chebotar, Omar Cortes, Byron David, Chelsea Finn, Keerthana Gopalakrishnan

link-bibliography
https://arxiv.org/abs/2204.00598#google: “Socratic Models: Composing Zero-Shot Multimodal Reasoning With Language”⁠, Andy Zeng, Adrian Wong, Stefan Welker, Krzysztof Choromanski, Federico Tombari, Aveek Purohit, Michael Ryoo

link-bibliography
clippy: “It Looks Like You’re Trying To Take Over The World”⁠, gwern

link-bibliography
https://arxiv.org/abs/2201.03544: “The Effects of Reward Misspecification: Mapping and Mitigating Misaligned Models”⁠, Alexander Pan, Kush Bhatia, Jacob Steinhardt

link-bibliography
https://openai.com/research/webgpt: “WebGPT: Improving the Factual Accuracy of Language Models through Web Browsing”⁠, Jacob Hilton, Suchir Balaji, Reiichiro Nakano, John Schulman

link-bibliography
https://arxiv.org/abs/2112.09332#openai: “WebGPT: Browser-assisted Question-answering With Human Feedback”⁠, Reiichiro Nakano, Jacob Hilton, Suchir Balaji, Jeff Wu Long Ouyang, Christina Kim, Christopher Hesse

link-bibliography
https://arxiv.org/abs/2111.09259#deepmind: “Acquisition of Chess Knowledge in AlphaZero”⁠, Thomas McGrath, Andrei Kapishnikov, Nenad Tomašev, Adam Pearce, Demis Hassabis, Been Kim, Ulrich Paquet

link-bibliography
https://arxiv.org/abs/2111.01587#deepmind: “Procedural Generalization by Planning With Self-Supervised World Models”⁠, Ankesh Anand, Jacob Walker, Yazhe Li, Eszter Vértes, Julian Schrittwieser, Sherjil Ozair, Théophane Weber

link-bibliography
https://arxiv.org/abs/2109.10862#openai: “Recursively Summarizing Books With Human Feedback”⁠, Jeff Wu, Long Ouyang, Daniel M. Ziegler, Nisan Stiennon, Ryan Lowe, Jan Leike, Paul Christiano

link-bibliography
https://proceedings.mlr.press/v139/vicol21a.html: “Unbiased Gradient Estimation in Unrolled Computation Graphs With Persistent Evolution Strategies”⁠, Paul Vicol, Luke Metz, Jascha Sohl-Dickstein

link-bibliography
https://arxiv.org/abs/2106.13281#google: “Brax—A Differentiable Physics Engine for Large Scale Rigid Body Simulation”⁠, C. Daniel Freeman, Erik Frey, Anton Raichuk, Sertan Girgin, Igor Mordatch, Olivier Bachem

link-bibliography
https://arxiv.org/abs/2105.12196#deepmind: “From Motor Control to Team Play in Simulated Humanoid Football”⁠, Siqi Liu, Guy Lever, Zhe Wang, Josh Merel, S. M. Ali Eslami, Daniel Hennes, Wojciech M. Czarnecki, Yuval Tassa

link-bibliography
https://www.sciencedirect.com/science/article/pii/S0004370221000862#deepmind: “Reward Is Enough”⁠, David Silver, Satinder Singh, Doina Precup, Richard S. Sutton

link-bibliography
https://arxiv.org/abs/2104.06294#deepmind: “MuZero Unplugged: Online and Offline Reinforcement Learning by Planning With a Learned Model”⁠, Julian Schrittwieser, Thomas Hubert, Amol Mandhane, Mohammadamin Barekatain, Ioannis Antonoglou, David Silver

link-bibliography
https://arxiv.org/abs/2104.06272#deepmind: “Podracer Architectures for Scalable Reinforcement Learning”⁠, Matteo Hessel, Manuel Kroiss, Aidan Clark, Iurii Kemaev, John Quan, Thomas Keck, Fabio Viola, Hado van Hasselt

link-bibliography
https://arxiv.org/abs/2012.05672#deepmind: “Imitating Interactive Intelligence”⁠, Interactive Agents Group (Josh Abramson, Arun Ahuja, Arthur Brussee, Federico Carnevale, Mary Cassin

link-bibliography
https://greydanus.github.io/2020/12/01/scaling-down/: “Scaling down Deep Learning”⁠, Sam Greydanus

link-bibliography
scaling-hypothesis: “The Scaling Hypothesis”⁠, gwern

link-bibliography
https://www.deepmind.com/blog/agent57-outperforming-the-human-atari-benchmark: “Agent57: Outperforming the Human Atari Benchmark”⁠, Adrià Puigdomènech, Bilal Piot, Steven Kapturowski, Pablo Sprechmann, Alex Vitvitskyi, Daniel Guo, Charles Blundell

link-bibliography
https://openreview.net/forum?id=SyxrxR4KPS#deepmind: “Deep Neuroethology of a Virtual Rodent”⁠, Josh Merel, Diego Aldarondo, Jesse Marshall, Yuval Tassa, Greg Wayne, Bence Olveczky (DM/Harvard)

link-bibliography
https://openai.com/research/procgen-benchmark: “Procgen Benchmark: We’re Releasing Procgen Benchmark, 16 Simple-to-use Procedurally-generated Environments Which Provide a Direct Measure of How Quickly a Reinforcement Learning Agent Learns Generalizable Skills”⁠, Karl Cobbe, Christopher Hesse, Jacob Hilton, John Schulman

link-bibliography
https://arxiv.org/abs/1911.00357#facebook: “DD-PPO: Learning Near-Perfect PointGoal Navigators from 2.5 Billion Frames”⁠, Erik Wijmans, Abhishek Kadian, Ari Morcos, Stefan Lee, Irfan Essa, Devi Parikh, Manolis Savva, Dhruv Batra

link-bibliography
2019-vinyals.pdf#deepmind: “Grandmaster Level in StarCraft II Using Multi-agent Reinforcement Learning”⁠, Oriol Vinyals, Igor Babuschkin, Wojciech M. Czarnecki, Michaël Mathieu, Andrew Dudzik, Junyoung Chung

link-bibliography
https://openai.com/research/emergent-tool-use#surprisingbehaviors: “Emergent Tool Use from Multi-Agent Interaction § Surprising Behavior”⁠, Bowen Baker, Ingmar Kanitscheider, Todor Markov, Yi Wu, Glenn Powell, Bob McGrew, Igor Mordatch

link-bibliography
2019-jaderberg.pdf#deepmind: “Human-level Performance in 3D Multiplayer Games With Population-based Reinforcement Learning”⁠, Max Jaderberg, Wojciech M. Czarnecki, Iain Dunning, Luke Marris, Guy Lever, Antonio Garcia Castañeda

link-bibliography
https://arxiv.org/abs/1904.01201#facebook: “Habitat: A Platform for Embodied AI Research”⁠, Manolis Savva, Abhishek Kadian, Oleksandr Maksymets, Yili Zhao, Erik Wijmans, Bhavana Jain, Julian Straub

link-bibliography
https://openai.com/research/how-ai-training-scales: “How AI Training Scales”⁠, Sam McCandlish, Jared Kaplan, Dario Amodei

link-bibliography
https://openai.com/research/ai-and-compute: “AI and Compute”⁠, Dario Amodei, Danny Hernandez, Girish Sastry, Jack Clark, Greg Brockman, Ilya Sutskever

link-bibliography
idea: “Research Ideas”⁠, Gwern Branwen

link-bibliography
tool-ai: “Why Tool AIs Want to Be Agent AIs”⁠, gwern

link-bibliography
https://www.frc.ri.cmu.edu/~hpm/project.archive/robot.papers/2004/Predictions.html: “Robot Predictions Evolution”⁠, Hans Moravec

link-bibliography

[ Submit Anonymous Feedback ]

[Quote Of The Day] [Site Of The Day]

[Annotation Of The Day]