Bibliography:

  1. Maxout Networks

  2. On the number of response regions of deep feed forward networks with piece-wise linear activations

  3. https://arxiv.org/pdf/1402.1869#page=14

  4. 2014-pascanu-figure2-topologyofdeepnetworksinfoldingaroundaxislayerbylayer.png

  5. Wikipedia Bibliography:

    1. Rectifier (neural Networks)