Bibliography (9):

1. Maxout Networks

2. On the number of response regions of deep feed forward networks with piece-wise linear activations

3. 2014-montufar-figure1-binaryclassificationdecisionboundaryofshallowvsdeepneuralnetworkshowingdeeperequalssmoother.png

4. https://arxiv.org/pdf/1402.1869#page=14

5. 2014-pascanu-figure2-topologyofdeepnetworksinfoldingaroundaxislayerbylayer.png

6. Wikipedia Bibliography:

   1. https://en.wikipedia.org/wiki/Feedforward_neural_networks  :

      https://en.wikipedia.org/wiki/Feedforward_neural_networks

   2. https://en.wikipedia.org/wiki/Piecewise_linear_function  :

      https://en.wikipedia.org/wiki/Piecewise_linear_function

   3. Activation function

   4. Rectifier (neural networks)