Korbicz, Józef (1951- ) - red. ; Uciński, Dariusz - red.
The choice of transfer functions in neural networks is of crucial importance to their performance. Although sigmoidal transfer functions are the most common, there is no a-priori reason why they should be optimal in all cases. In this article, advantages of various neural transfer functions are discussed and several new types of functions are introduced. ; Universal transfer functions, parameterized to change from a localized to a delocalized type, are of greatest interest. Biradial functions are formed from products or linear combinations of two sigmoids. Products of N biradial functions in an N-dimensional input space give densities of arbitrary shapes, offering great flexibility in modelling the probability density of the input vectors. ; Extensions of biradial functions, offering a good tradeoff between the complexity of transfer functions and flexibility of the densities they are able to represent, are proposed. Biradial functions can be used as transfer functions in many types of neural networks, such as RBF, RAN, FSM and IncNet. Using such functions and going into the hard limit (steep slopes) facilitates logical interpretation of the network performance, i.e. extraction of logical rules from the training data.
Zielona Góra: Uniwersytet Zielonogórski
AMCS, volume 7, number 3 (1997) ; click here to follow the link
Biblioteka Uniwersytetu Zielonogórskiego
Nov 5, 2024
Nov 23, 2020
93
https://zbc.uz.zgora.pl/repozytorium/publication/64517
Edition name | Date |
---|---|
New neural transfer functions | Nov 5, 2024 |
Beliczyński, Bartłomiej - red.
Krasoń, Ewa Kaczorek, Tadeusz - ed.
Trzaska, Zdzisław W. Kaczorek, Tadeusz - ed.
Xu, Li Saito, Osami Abe, Kenichi Kaczorek, Tadeusz - ed.
Young, K. David Yu, Xinghuo - red.
Xu, Jian-Xin Song, Yanbin Yu, Xinghuo - red.
Stotsky, Alexander A. Hedrick, J. Karl Yip, P.P. Yu, Xinghuo - red.
Hara, Masaaki Furuta, Katsuhisa Pan, Yaodong Hoshino, Tasuku Yu, Xinghuo - red.