New complex-valued activation functions

Abstract

We present a new type of activation functions for a complex-valued neural network (CVNN). A proposed activation function is constructed such that it fixes a given ellipse. We obtain an application to a complex-valued Hopfield neural network (CVHNN) using a special form of the introduced complex functions as an activation function. Considering the interesting geometric properties of the plane curve ellipse such as focusing property, we emphasize that these properties may have possible applications in various neural networks.