Obiekt
Tytuł: The performance profile: A multi-criteria performance evaluation method for test-based problems
Współtwórca:
Korbicz, Józef - red. ; Uciński, Dariusz - red.
Tytuł publikacji grupowej:
Abstract:
In test-based problems, solutions produced by search algorithms are typically assessed using average outcomes of interactions with multiple tests. This aggregation leads to information loss, which can render different solutions apparently indifferent and hinder comparison of search algorithms. ; In this paper we introduce the "performance profile", a generic, domain-independent, multi-criteria performance evaluation method that mitigates this problem by characterizing the performance of a solution by a "vector" of outcomes of interactions with tests of various difficulty. To demonstrate the usefulness of this gauge, we employ it to analyze the behavior of Othello and Iterated Prisoner`s Dilemma players produced by five (co)evolutionary algorithms as well as players known from previous publications. ; Performance profiles reveal interesting differences between the players, which escape the attention of the scalar performance measure of the expected utility. In particular, they allow us to observe that evolution with random sampling produces players coping well against the mediocre opponents, while the coevolutionary and temporal difference learning strategies play better against the high-grade opponents. ; We postulate that performance profiles improve our understanding of characteristics of search algorithms applied to arbitrary test-based problems, and can prospectively help design better methods for interactive domains.
Wydawca:
Zielona Góra: Uniwersytet Zielonogórski
Identyfikator zasobu:
DOI:
Strony:
Źródło:
AMCS, volume 26, number 1 (2016) ; kliknij tutaj, żeby przejść
Jezyk:
Prawa do dysponowania publikacją:
Biblioteka Uniwersytetu Zielonogórskiego
Kolekcje, do których przypisany jest obiekt:
- Repozytorium > Jednostki organizacyjne > Wydział Informatyki, Elektrotechniki i Automatyki
- Repozytorium > Typy utworów > Artykuły
- Repozytorium > Czasopisma naukowe i serie wydawnicze UZ > International Journal of Applied Mathematics and Computer Science (AMCS) > International Journal of Applied Mathematics and Computer Science (AMCS) (2016)
Data ostatniej modyfikacji:
2024-05-09
Data dodania obiektu:
2024-05-09
Liczba wyświetleń treści obiektu:
3
Wszystkie dostępne wersje tego obiektu:
https://zbc.uz.zgora.pl/repozytorium/publication/88952
Wyświetl opis w formacie RDF:
Wyświetl opis w formacie OAI-PMH:
-
International Journal of Applied Mathematics and Computer Science (AMCS)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 26 (2016)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 26, number 1 (2016)
- Positivity and stability of fractional descriptor time-varying discrete-time linear systems
- An integrodifferential approach to modeling, control, state estimation and optimization for heat transfer systems
- Nonlinear analysis of vehicle control actuations based on controlled invariant sets
- Robust fault detection of singular LPV systems with multiple time-varying delays
- Efficient RGB-D data processing for feature-based self-localization of mobile robots
- RGB-D terrain perception and dense mapping for legged robots
- Efficient generation of 3D surfel maps using RGB-D sensors
- Connections between object classification criteria using an ultrasonic bi-sonar system
- Stability analysis and H[the sign of infinity] control of discrete T-S fuzzy hyperbolic systems
- A mathematical model for file fragment diffusion and a neural predictor to manage priority queues over BitTorrent
- Adaptive predictions of the euro/złoty currency exchange rate using state space wavelet networks and forecast combinations
- A dynamic model of classifier competence based on the local fuzzy confusion matrix and the random reference classifier
- Using the one-versus-rest strategy with samples balancing to improve pairwise coupling classification
- Note onset detection in musical signals via neural-network-based multi-ODF fusion
- The performance profile: A multi-criteria performance evaluation method for test-based problems
- Simultaneous routing and flow rate optimization in energy-aware computer networks
- Modelling DNA and RNA secondary structures using matrix insertion-deletion systems
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 26, number 2 (2016)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 26, number 3 (2016)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 26, number 4 (2016)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 26, number 1 (2016)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 25 (2015)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 24 (2014)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 23 (2013)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 22 (2012)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 21 (2011)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 20 (2010)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 19 (2009)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 18 (2008)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 17 (2007)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 16 (2006)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 15 (2005)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 13 (2003)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 12 (2002)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 11 (2001)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 10 (2000)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 9 (1999)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 8 (1998)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 7 (1997)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 6 (1996)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 5 (1995)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 4 (1994)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 3 (1993)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 2 (1992)
-
International Journal of Applied Mathematics and Computer Science (AMCS),volume 1 (1991)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 26 (2016)
| Nazwa wydania | Data |
|---|---|
| The performance profile: A multi-criteria performance evaluation method for test-based problems | 2024-05-09 |
