Abstract: Traditional Multi-Layer Perceptrons (MLPs) typically employ fixed activation functions and large weight matrices to learn the complex patterns present in these representations. This leads ...