Object

Title: New neural transfer functions

Contributor:

Korbicz, Józef - red. ; Uciński, Dariusz - red.

Group publication title:

AMCS, volume 7 (1997)

Abstract:

The choice of transfer functions in neural networks is of crucial importance to their performance. Although sigmoidal transfer functions are the most common, there is no a-priori reason why they should be optimal in all cases. In this article, advantages of various neural transfer functions are discussed and several new types of functions are introduced. ; Universal transfer functions, parameterized to change from a localized to a delocalized type, are of greatest interest. Biradial functions are formed from products or linear combinations of two sigmoids. Products of N biradial functions in an N-dimensional input space give densities of arbitrary shapes, offering great flexibility in modelling the probability density of the input vectors. ; Extensions of biradial functions, offering a good tradeoff between the complexity of transfer functions and flexibility of the densities they are able to represent, are proposed. Biradial functions can be used as transfer functions in many types of neural networks, such as RBF, RAN, FSM and IncNet. Using such functions and going into the hard limit (steep slopes) facilitates logical interpretation of the network performance, i.e. extraction of logical rules from the training data.

Publisher:

Zielona Góra: Uniwersytet Zielonogórski

Resource Identifier:

oai:zbc.uz.zgora.pl:57831

Pages:

639-658

Source:

AMCS, volume 7, number 3 (1997) ; click here to follow the link

Language:

eng

Rights:

Biblioteka Uniwersytetu Zielonogórskiego

Edition name Date
New neural transfer functions Sep 2, 2021

Objects

Similar

This page uses 'cookies'. More information