Bibliography (45):

  1. http://robotics.stanford.edu/~amaas/papers/relu_hybrid_icml2013_final.pdf

  2. Swish: Searching for Activation Functions

  3. https://arxiv.org/pdf/1804.00222.pdf#page=17&org=deepmind

  4. ‘MLP NN’ directory

  5. https://www.planchet.net/EXT/ISFA/1226.nsf/769998e0a65ea348c1257052003eb94f/e7dc33e4da12c5a9c12576d8002e442b/$FILE/Jones01.pdf

  6. Practical Bayesian Optimization of Machine Learning Algorithms

  7. Algorithms for Hyper-Parameter Optimization

  8. https://www.jmlr.org/papers/volume13/bergstra12a/bergstra12a.pdf

  9. NEAT: Evolving Neural Networks through Augmenting Topologies

  10. Neural Architecture Search with Reinforcement Learning

  11. Designing Neural Network Architectures using Reinforcement Learning

  12. Learning Transferable Architectures for Scalable Image Recognition

  13. Large-Scale Evolution of Image Classifiers

  14. Learning to Learn Using Gradient Descent

  15. Gradient-based Hyperparameter Optimization through Reversible Learning

  16. Learning to learn by gradient descent by gradient descent

  17. Learning to Learn without Gradient Descent by Gradient Descent

  18. Learning to Optimize Neural Nets

  19. Learned Optimizers that Scale and Generalize

  20. Neural Optimizer Search With Reinforcement Learning

  21. Prototypical Networks for Few-shot Learning

  22. MAML: Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks

  23. Evolved Policy Gradients

  24. Evolution Strategies as a Scalable Alternative to Reinforcement Learning

  25. Matching Networks for One Shot Learning

  26. Optimization as a Model for Few-Shot Learning

  27. A Simple Neural Attentive Meta-Learner

  28. WaveNet: A Generative Model for Raw Audio

  29. Supervising Unsupervised Learning

  30. Learning a synaptic learning rule

  31. On the Optimization of a Synaptic Learning Rule