Knowledge and Information Systems, ( ISI ), Volume (30), No (1), Year (2012-3) , Pages (135-154)

Title : ( A general insight into the effect of neuron structure on classification )

Authors: Hadi Sadoghi Yazdi , Alireza Rowhanimanesh , Hamidreza Modares ,

Citation: BibTeX | EndNote

Abstract

This paper gives a general insight into how the neuron structure in a multilayer perceptron (MLP) can affect the ability of neurons to deal with classification. Most of the common neuron structures are based on monotonic activation functions and linear input mappings. In comparison, the proposed neuron structure utilizes a nonmonotonic activation function and/or a nonlinear input mapping to increase the power of a neuron. An MLP of these high power neurons usually requires a less number of hidden nodes than conventional MLP for solving classification problems. The fewer number of neurons is equivalent to the smaller number of network weights that must be optimally determined by a learning algorithm. The performance of learning algorithm is usually improved by reducing the number of weights, i.e., the dimension of the search space. This usually helps the learning algorithm to escape local optimums, and also, the convergence speed of the algorithm is increased regardless of which algorithm is used for learning. Several 2-dimensional examples are provided manually to visualize how the number of neurons can be reduced by choosing an appropriate neuron structure. Moreover, to show the efficiency of the proposed scheme in solving real-world classification problems, the Iris data classification problem is solved using an MLP whose neurons are equipped by nonmonotonic activation functions, and the result is compared with two well-known monotonic activation functions.

Keywords

Neuron structure Nonmonotonic activation function Nonlinear input mapping Classification Multilayer perceptron (MLP) Iris data classification
برای دانلود از شناسه و رمز عبور پرتال پویا استفاده کنید.

@article{paperid:1022797,
author = {Sadoghi Yazdi, Hadi and Rowhanimanesh, Alireza and Modares, Hamidreza},
title = {A general insight into the effect of neuron structure on classification},
journal = {Knowledge and Information Systems},
year = {2012},
volume = {30},
number = {1},
month = {March},
issn = {0219-1377},
pages = {135--154},
numpages = {19},
keywords = {Neuron structure Nonmonotonic activation function Nonlinear input mapping Classification Multilayer perceptron (MLP) Iris data classification},
}

[Download]

%0 Journal Article
%T A general insight into the effect of neuron structure on classification
%A Sadoghi Yazdi, Hadi
%A Rowhanimanesh, Alireza
%A Modares, Hamidreza
%J Knowledge and Information Systems
%@ 0219-1377
%D 2012

[Download]