tl.zoo.utils#
Init file for the utils module.
Functions
|
Apply activation function to a tensor. |
|
Convolution building block. |
|
Construct a convolution block (for Basenji/Enformer). |
|
Dense building block. |
|
Construct a residual dilated convolution block. |
|
Construct a feedforward block (for Enformer), consisting of Residual(LayerNorm+PointwiseConv+Dropout+ReLU+PointwiseConv+Dropout). |
|
Pass input layer through hidden layers. |
|
Construct a MHA block (for Enformer/Borzoi), consisting of Residual(LayerNorm+MHSelfAttention+Dropout). |
|
Apply activation function to a tensor. |