- See Also
-
Gwern
- “Movie Reviews”, Gwern 2014
- “Anime Reviews”, Gwern 2010
- “Utext: Rich Unicode Documents”, Gwern 2023
- “Miscellaneous”, Gwern 2009
- “Novelty Nets: Classifier Anti-Guidance”, Gwern 2024
- “InvertOrNot.com Proposal”, Gwern 2021
- “The Second Apocalypse: Freedom In An Unfree Universe”, Gwern 2017
- “Review Of The Quantum Thief Trilogy”, Gwern 2022
- “Interpreting ‘Suzanne Delage’ As Dracula”, Gwern 2009
- “Research Ideas”, Gwern 2017
-
Links
- “A Jamming Transition from Under- to Over-Parametrization Affects Loss Landscape and Generalization”, Spigler et al 2018
- “Measles Virus Infection Diminishes Preexisting Antibodies That Offer Protection from Other Pathogens”, Mina et al 2019
- “Static Typing for a Faulty Lambda Calculus”, Walker et al 2006
- “Identifying and Attacking the Saddle Point Problem in High-Dimensional Non-Convex Optimization”, Dauphin et al 2014
- “Underspecification Presents Challenges for Credibility in Modern Machine Learning”, D’Amour et al 2020
- “Momentum Residual Neural Networks”, Sander et al 2021
- “Deep Learning Through the Lens of Example Difficulty”, Baldock et al 2021
- “Quantifying Memorization Across Neural Language Models”, Carlini et al 2022
- “SemantiCodec: An Ultra Low Bitrate Semantic Audio Codec for General Sound”, Liu et al 2024
- “Recovery of ‘Lost’ Infant Memories in Mice”, Guskjolen et al 2018
- “The Australian Paradox: a Substantial Decline in Sugars Intake over the Same Timeframe That Overweight and Obesity Have Increased”, Barclay & Brand-Miller 2011
- “The Fading Memories of Youth: The Mystery of ‘Infantile Amnesia’ Suggests Memory Works Differently in the Developing Brain”, Reardon 2024
- “Supplementary Materials for Grounded Language Acquisition through the Eyes and Ears of a Single Child”, Vong 2024
- “Grounded Language Acquisition through the Eyes and Ears of a Single Child”, Vong et al 2024
- “The Legend of John Von Neumann”, Halmos 1973
- “Discussion: John Von Neumann—A Case Study of Scientific Creativity”, Aspray et al 1989
- “Development of Autobiographical Memory in Children With Autism Spectrum Disorders: Deficits, Gains, and Predictors of Performance”, Goddard et al 2013
- “Development of Autobiographical Memory in Autism Spectrum Disorders”, Goddard 2018
- “The ‘Memory System’ of Prelinguistic Infants”, Rovee-Collier 1990
- “Remembering versus Knowing the Past: Children′s Explicit and Implicit Memories for Pictures”, Drummey & Newcombe 1995
- “Solomon V. Shereshevsky: The Great Russian Mnemonist”, Mecacci 2013
- “Maternal Separation Results in Early Emergence of Adult-Like Fear and Extinction Learning in Infant Rats”, Callaghan & Richardson 2011
- “Hippocampal Neurogenesis Regulates Forgetting During Adulthood and Infancy”, Akers et al 2014
- “A Price to Pay for Adult Neurogenesis”, Mongiat & Schinder 2014
- “5 Years Later: Children’s Memory for Medical Emergencies”, Peterson & Whalen 2001
- “Topology and Geometry of Half-Rectified Network Optimization”, Freeman & Bruna 2016
- “Visualizing the Loss Landscape of Neural Nets”, Li et al 2017
- “Loss Surfaces, Mode Connectivity, and Fast Ensembling of DNNs”, Garipov et al 2018
- “Essentially No Barriers in Neural Network Energy Landscape”, Draxler et al 2018
- “Towards Understanding Learning Representations: To What Extent Do Different Neural Networks Learn the Same Representation”, Wang et al 2018
- “Linear Mode Connectivity and the Lottery Ticket Hypothesis”, Frankle et al 2019
- “Going Beyond Linear Mode Connectivity: The Layerwise Linear Feature Connectivity”, Zhou et al 2023
- “Proving Linear Mode Connectivity of Neural Networks via Optimal Transport”, Ferbach et al 2023
- “Limited Data, Unlimited Potential: A Study on ViTs Augmented by Masked Autoencoders”, Das et al 2023
- “Simultaneous Linear Connectivity of Neural Networks modulo Permutation”, Sharma et al 2024
- “Building a Large Japanese Web Corpus for Large Language Models”, Okazaki et al 2024
- “Immune Activation State Modulates Infant Engram Expression across Development”, Power et al 2023
- “Sleep and the Price of Plasticity: from Synaptic and Cellular Homeostasis to Memory Consolidation and Integration”, Tononi & Cirelli 2014
- “Early Memories of Individuals on the Autism Spectrum Assessed Using Online Self-Reports”, Zamoscik et al 2016
- “Infantile Amnesia Reflects a Developmental Critical Period for Hippocampal Learning”, Travaglia et al 2016
- “It's All in the Details: Relations Between Young Children's Developing Pattern Separation Abilities and Hippocampal Subfield Volumes”, Canada et al 2019
- “Early Life Experiences Selectively Mature Learning and Memory Abilities”, Bessières et al 2020
- “SAYCam: A Large, Longitudinal Audiovisual Dataset Recorded From the Infant's Perspective”, Sullivan et al 2021
- “Getting Over It Developer Reacts to 1 Minute 24 Second Speedrun”, Foddy/a 2020 {#foddy/a-2020-Section}
- “A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity”, Lee et al 2024
- “Variation in Hospitalization Costs, Charges, and Lengths of Hospital Stay for Coronavirus Disease 2019 Patients Treated With Venovenous Extracorporeal Membrane Oxygenation in the United States: A Cohort Study”, Mazzeffi et al 2023
- “Eyes and IQ: A Meta-Analysis of the Relationship between Intelligence and ‘Reading the Mind in the Eyes’”, Baker et al 2015
- “Spacing Learning Events Over Time: What the Research Says”, Thalheimer 2006
- “Quasi-Equivalence of Width and Depth of Neural Networks”, Fan et al 2020
- “Survival Instinct in Offline Reinforcement Learning”, Li et al 2023
- Wikipedia
- Miscellaneous
- Link Bibliography
See Also
Gwern
“Movie Reviews”, Gwern 2014
“Anime Reviews”, Gwern 2010
“Utext: Rich Unicode Documents”, Gwern 2023
“Miscellaneous”, Gwern 2009
“Novelty Nets: Classifier Anti-Guidance”, Gwern 2024
“InvertOrNot.com Proposal”, Gwern 2021
“The Second Apocalypse: Freedom In An Unfree Universe”, Gwern 2017
“Review Of The Quantum Thief Trilogy”, Gwern 2022
“Interpreting ‘Suzanne Delage’ As Dracula”, Gwern 2009
“Research Ideas”, Gwern 2017
Links
“A Jamming Transition from Under- to Over-Parametrization Affects Loss Landscape and Generalization”, Spigler et al 2018
A jamming transition from under- to over-parametrization affects loss landscape and generalization
“Measles Virus Infection Diminishes Preexisting Antibodies That Offer Protection from Other Pathogens”, Mina et al 2019
Measles virus infection diminishes preexisting antibodies that offer protection from other pathogens
“Static Typing for a Faulty Lambda Calculus”, Walker et al 2006
“Identifying and Attacking the Saddle Point Problem in High-Dimensional Non-Convex Optimization”, Dauphin et al 2014
Identifying and attacking the saddle point problem in high-dimensional non-convex optimization
“Underspecification Presents Challenges for Credibility in Modern Machine Learning”, D’Amour et al 2020
Underspecification Presents Challenges for Credibility in Modern Machine Learning
“Momentum Residual Neural Networks”, Sander et al 2021
“Deep Learning Through the Lens of Example Difficulty”, Baldock et al 2021
“Quantifying Memorization Across Neural Language Models”, Carlini et al 2022
“SemantiCodec: An Ultra Low Bitrate Semantic Audio Codec for General Sound”, Liu et al 2024
SemantiCodec: An Ultra Low Bitrate Semantic Audio Codec for General Sound
“Recovery of ‘Lost’ Infant Memories in Mice”, Guskjolen et al 2018
“The Australian Paradox: a Substantial Decline in Sugars Intake over the Same Timeframe That Overweight and Obesity Have Increased”, Barclay & Brand-Miller 2011
“The Fading Memories of Youth: The Mystery of ‘Infantile Amnesia’ Suggests Memory Works Differently in the Developing Brain”, Reardon 2024
“Supplementary Materials for Grounded Language Acquisition through the Eyes and Ears of a Single Child”, Vong 2024
“Grounded Language Acquisition through the Eyes and Ears of a Single Child”, Vong et al 2024
Grounded language acquisition through the eyes and ears of a single child
“The Legend of John Von Neumann”, Halmos 1973
“Discussion: John Von Neumann—A Case Study of Scientific Creativity”, Aspray et al 1989
Discussion: John von Neumann—A Case Study of Scientific Creativity
“Development of Autobiographical Memory in Children With Autism Spectrum Disorders: Deficits, Gains, and Predictors of Performance”, Goddard et al 2013
“Development of Autobiographical Memory in Autism Spectrum Disorders”, Goddard 2018
Development of Autobiographical Memory in Autism Spectrum Disorders
“The ‘Memory System’ of Prelinguistic Infants”, Rovee-Collier 1990
“Remembering versus Knowing the Past: Children′s Explicit and Implicit Memories for Pictures”, Drummey & Newcombe 1995
Remembering versus Knowing the Past: Children′s Explicit and Implicit Memories for Pictures
“Solomon V. Shereshevsky: The Great Russian Mnemonist”, Mecacci 2013
“Maternal Separation Results in Early Emergence of Adult-Like Fear and Extinction Learning in Infant Rats”, Callaghan & Richardson 2011
“Hippocampal Neurogenesis Regulates Forgetting During Adulthood and Infancy”, Akers et al 2014
Hippocampal Neurogenesis Regulates Forgetting During Adulthood and Infancy
“A Price to Pay for Adult Neurogenesis”, Mongiat & Schinder 2014
“5 Years Later: Children’s Memory for Medical Emergencies”, Peterson & Whalen 2001
“Topology and Geometry of Half-Rectified Network Optimization”, Freeman & Bruna 2016
Topology and Geometry of Half-Rectified Network Optimization
“Visualizing the Loss Landscape of Neural Nets”, Li et al 2017
“Loss Surfaces, Mode Connectivity, and Fast Ensembling of DNNs”, Garipov et al 2018
Loss Surfaces, Mode Connectivity, and Fast Ensembling of DNNs
“Essentially No Barriers in Neural Network Energy Landscape”, Draxler et al 2018
“Towards Understanding Learning Representations: To What Extent Do Different Neural Networks Learn the Same Representation”, Wang et al 2018
“Linear Mode Connectivity and the Lottery Ticket Hypothesis”, Frankle et al 2019
“Going Beyond Linear Mode Connectivity: The Layerwise Linear Feature Connectivity”, Zhou et al 2023
Going Beyond Linear Mode Connectivity: The Layerwise Linear Feature Connectivity
“Proving Linear Mode Connectivity of Neural Networks via Optimal Transport”, Ferbach et al 2023
Proving Linear Mode Connectivity of Neural Networks via Optimal Transport
“Limited Data, Unlimited Potential: A Study on ViTs Augmented by Masked Autoencoders”, Das et al 2023
Limited Data, Unlimited Potential: A Study on ViTs Augmented by Masked Autoencoders
“Building a Large Japanese Web Corpus for Large Language Models”, Okazaki et al 2024
Building a Large Japanese Web Corpus for Large Language Models
“Immune Activation State Modulates Infant Engram Expression across Development”, Power et al 2023
Immune activation state modulates infant engram expression across development
“Sleep and the Price of Plasticity: from Synaptic and Cellular Homeostasis to Memory Consolidation and Integration”, Tononi & Cirelli 2014
“Early Memories of Individuals on the Autism Spectrum Assessed Using Online Self-Reports”, Zamoscik et al 2016
Early Memories of Individuals on the Autism Spectrum Assessed Using Online Self-Reports
“Infantile Amnesia Reflects a Developmental Critical Period for Hippocampal Learning”, Travaglia et al 2016
Infantile amnesia reflects a developmental critical period for hippocampal learning
“It's All in the Details: Relations Between Young Children's Developing Pattern Separation Abilities and Hippocampal Subfield Volumes”, Canada et al 2019
“Early Life Experiences Selectively Mature Learning and Memory Abilities”, Bessières et al 2020
Early life experiences selectively mature learning and memory abilities
“SAYCam: A Large, Longitudinal Audiovisual Dataset Recorded From the Infant's Perspective”, Sullivan et al 2021
SAYCam: A Large, Longitudinal Audiovisual Dataset Recorded From the Infant's Perspective
“Getting Over It Developer Reacts to 1 Minute 24 Second Speedrun”, Foddy/a 2020 {#foddy/a-2020-Section}
Getting Over It Developer Reacts to 1 Minute 24 Second Speedrun
“A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity”, Lee et al 2024
A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity
“Variation in Hospitalization Costs, Charges, and Lengths of Hospital Stay for Coronavirus Disease 2019 Patients Treated With Venovenous Extracorporeal Membrane Oxygenation in the United States: A Cohort Study”, Mazzeffi et al 2023
“Eyes and IQ: A Meta-Analysis of the Relationship between Intelligence and ‘Reading the Mind in the Eyes’”, Baker et al 2015
“Spacing Learning Events Over Time: What the Research Says”, Thalheimer 2006
“Quasi-Equivalence of Width and Depth of Neural Networks”, Fan et al 2020
“Survival Instinct in Offline Reinforcement Learning”, Li et al 2023
Wikipedia
-
Pykrete:
Miscellaneous
-
https://twitter.com/joecappadona/status/1785048197024399641
: -
https://archive.org/details/LuriaTheMindOfAMnemonist
:View External Link:
-
https://archive.org/details/poemschieflyofea00wordrich/page/346/mode/2up
:View External Link:
https://archive.org/details/poemschieflyofea00wordrich/page/346/mode/2up
-
https://blog.funcall.org//lisp%20psychoacoustics/2024/05/01/worlds-loudest-lisp-program/
-
https://laion.ai/laion-400-open-dataset/
:View External Link:
-
https://lareviewofbooks.org/article/the-pets-war-on-hilda-keans-the-great-cat-and-dog-massacre/
-
https://old.reddit.com/r/mlscaling/search?q=flair%3AData&restrict_sr=on&include_over_18=on
-
https://windowsontheory.org/2019/12/05/deep-double-descent/
: -
https://www.atlasobscura.com/articles/in-the-1970s-the-us-navy-tried-to-talk-like-whales
-
https://www.geoffreylitt.com/2023/03/25/llm-end-user-programming
-
https://www.newyorker.com/science/annals-of-medicine/how-ecmo-is-redefining-death
-
https://www.sensetime.com/en/news-detail/51167731?categoryId=1072
-
https://www.wired.com/story/china-brain-computer-interfaces-neuralink-neucyber-neurotech/
: -
https://www.wired.com/story/master-algorithm-pedro-domingos/
:View External Link:
https://www.wired.com/story/master-algorithm-pedro-domingos/
Link Bibliography
-
2006-walker.pdf
: “Static Typing for a Faulty Lambda Calculus”, -
https://www.science.org/content/article/are-your-earliest-childhood-memories-still-lurking-your-mind-or-gone-forever
: “The Fading Memories of Youth: The Mystery of ‘Infantile Amnesia’ Suggests Memory Works Differently in the Developing Brain”, -
2024-vong.pdf
: “Grounded Language Acquisition through the Eyes and Ears of a Single Child”, -
2018-goddard.pdf
: “Development of Autobiographical Memory in Autism Spectrum Disorders”, -
2014-mongiat.pdf
: “A Price to Pay for Adult Neurogenesis”, -
https://www.youtube.com/watch?v=dGU5_UUalPA
: “Getting Over It Developer Reacts to 1 Minute 24 Second Speedrun”{#foddy/a-2020 .link-modified-recently .link-annotated}, -
2014-baker.pdf
: “Eyes and IQ: A Meta-Analysis of the Relationship between Intelligence and ‘Reading the Mind in the Eyes’”,