ConvGLUDecoder
CNN based encoder. Inputs are padded on both sides before passing through a 1D CNN, a GLU activation function, a skip connection, an optional dropout layer and a fully connected linear layer.
forward
Output from the previous encoder layer. Shape of (batch size, sequence length, hidden dim / number of “channels”).