T5: Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
2024-rannentriki-figure5-dynamicevaluationstillhelpsevenwithfinetuning.png
β dynamic-evaluation#scaling-laws
The Forward-Forward Algorithm: Some Preliminary Investigations
Mind the Gap: Assessing Temporal Generalization in Neural Language Models Β§ Dynamic Evaluation
Recurrent Neural Network Based Language Model Β§ Dynamic Evaluation
On the generalization of language models from in-context learning and finetuning: a controlled study
Just read twice: closing the recall gap for recurrent language models
Current Limitations of Language Models: What You Need is Retrieval
Can Long-Context Language Models Subsume Retrieval, RAG, SQL, and More?
Where does In-context Learning Happen in Large Language Models?
Simple and Scalable Strategies to Continually Pre-train Large Language Models
Wikipedia Bibliography:
