Determining the Number of Neurons in Artificial Neural Networks for Approximation, Trained with Algorithms Using the Jacobi Matrix
Determining the Number of Neurons in Artificial Neural Networks for Approximation, Trained with Algorithms Using the Jacobi Matrix

Summary/Abstract: How can we determine the optimal number of neurons when constructing an artificial neural network? This is one of the most frequently asked questions when working with this type of artificial intelligence. Experience has brought the understanding that it takes an individual approach for each task to specify the number of neurons. Our method is based on the requirement of algorithms looking for a minimum of functions of type 𝑺􁈺𝒛􁈻 􀵌 Σ 􁈾𝝋𝒊 𝒎 􁈺𝒛 􁈻􁈿𝟐 𝒊􀭀𝟏 that satisfy the inequality 𝒑 􀵑 𝒎, where p is the dimensionality of the argument z, and m is the number of functions. Formulas for an upper limit of the required neurons are proposed for networks with one hidden layer and for networks with r hidden layers with an equal number of neurons.

• Details
• Contents