Bibliography:
Maxout Networks
On the number of response regions of deep feed forward networks with piece-wise linear activations
https://arxiv.org/pdf/1402.1869#page=14
https://arxiv.org/pdf/1402.1869#page=14
2014-pascanu-figure2-topologyofdeepnetworksinfoldingaroundaxislayerbylayer.png
2014-pascanu-figure2-topologyofdeepnetworksinfoldingaroundaxislayerbylayer.png
Wikipedia Bibliography:
Rectifier (neural Networks)