Version 2.8
This release introduces several parameterized activation functions:
- The old
ELU
function had a hardcoded withalpha = 1.0
. Other values ofalpha
are now allowed. - Added
LeakyReLU
(thanks @aghosh). - Added
Swish
(https://arxiv.org/abs/1710.05941, thanks again @aghosh)