Transfer Functions

Our current implementation supports the following transfer functions:

• Linear transfer function

• Hyperbolic tangent transfer function

• Sigmoid transfer function

• Hard Sigmoid transfer function

• ELU (Exponential Linear Unit)

• SELU (Scaled Exponential Linear Unit)

• RELU (Rectified Linear Unit)

• Soft Plus transfer function

• Exponential transfer function

• Softsign transfer function

• Softmax transfer function