Skip to content

activations

fastforward.nn.activations.QuantizedActivation #

Bases: QuantizedModule

Base class for quantized activations.

__init_quantization__() #

fastforward.nn.activations.QuantizedRelu #

Bases: ReLU, QuantizedActivation

Applies quantized Relu.

Quantizers#

  1. input_quantizer: input activation before relu is applied.
  2. output_quantizer: output activation after relu is applied.

__init_quantization__() #

forward(input) #

fastforward.nn.activations.QuantizedSilu #

Bases: SiLU, QuantizedActivation

Applies quantized Silu.

Quantizers#

  1. input_quantizer: input activation before silu is applied.
  2. output_quantizer: output activation after silu is applied.

__init_quantization__() #

forward(input) #