BatchMatMulActivation

class BatchMatMulActivation(batch, in_features, out_features, bias=True, nonlinear_mode='identity', **kwargs)[source]

Batched matmul with activation(only relu supported), no transpose anywhere.