Obiekt
Tytuł: Evolving small-board go players using coevolutionary Temporal Difference Learning with archives
Współtwórca:
Korbicz, Józef (1951- ) - red. ; Uciński, Dariusz - red.
Tytuł publikacji grupowej:
Abstract:
We apply Coevolutionary Temporal Difference Learning (CTDL) to learn small-board Go strategies represented as weighted piece counters. CTDL is a randomized learning technique which interweaves two search processes that operate in the intra-game and inter-game mode. Intra-game learning is driven by gradient-descent Temporal Difference Learning (TDL), a reinforcement learning method that updates the board evaluation function according to differences observed between its values for consecutively visited game states. ; For the inter-game learning component, we provide a coevolutionary algorithm that maintains a sample of strategies and uses the outcomes of games played between them to iteratively modify the probability distribution, according to which new strategies are generated and added to the sample. We analyze CTDL?s sensitivity to all important parameters, including the trace decay constant that controls the lookahead horizon of TDL, and the relative intensity of intra-game and inter-game learning. ; We also investigate how the presence of memory (an archive) affects the search performance, and find out that the archived approach is superior to other techniques considered here and produces strategies that outperform a handcrafted weighted piece counter strategy and simple liberty-based heuristics. This encouraging result can be potentially generalized not only to other strategy representations used for small-board Go, but also to various games and a broader class of problems, because CTDL is generic and does not rely on any problem-specific knowledge.
Wydawca:
Zielona Góra: Uniwersytet Zielonogórski
Identyfikator zasobu:
DOI:
Strony:
Źródło:
AMCS, Volume 21, Number 4 (2011) ; kliknij tutaj, żeby przejść
Jezyk:
Prawa do dysponowania publikacją:
Biblioteka Uniwersytetu Zielonogórskiego
Kolekcje, do których przypisany jest obiekt:
- Zielonogórska Biblioteka Cyfrowa > Repozytorium > Jednostki organizacyjne > Wydział Informatyki, Elektrotechniki i Automatyki
- Zielonogórska Biblioteka Cyfrowa > Repozytorium > Typy utworów > Artykuły
- Zielonogórska Biblioteka Cyfrowa > Repozytorium > Czasopisma naukowe i serie wydawnicze UZ > International Journal of Applied Mathematics and Computer Science (AMCS)
- Zielonogórska Biblioteka Cyfrowa > Repozytorium > Czasopisma naukowe i serie wydawnicze UZ > International Journal of Applied Mathematics and Computer Science (AMCS) > International Journal of Applied Mathematics and Computer Science (AMCS) (2011)
Data ostatniej modyfikacji:
2024-11-05
Data dodania obiektu:
2018-08-28
Liczba wyświetleń treści obiektu:
3 642
Wszystkie dostępne wersje tego obiektu:
https://zbc.uz.zgora.pl/publication/55055
Wyświetl opis w formacie RDF:
Wyświetl opis w formacie OAI-PMH:
-
International Journal of Applied Mathematics and Computer Science (AMCS)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 26 (2016)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 25 (2015)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 24 (2014)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 23 (2013)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 22 (2012)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 21 (2011)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 21, number 1 (2011)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 21, number 2 (2011)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 21, number 3 (2011)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 21, number 4 (2011)
- International Journal of Applied Mathematics and Computer Science (AMCS), volume 21, number 4 (2011) - spis treści
- Delay-dependent generalized h2 control for discrete T-S fuzzy large-scale stochastic systems with mixed delays
- LMI-based adaptive fuzzy integral sliding mode control of mismatched uncertain systems
- Observer-based fault-tolerant control against sensor failures for fuzzy systems with time delays
- Novel optimal recursive filter for state and fault estimation of linear stochastic systems with unknown disturbances
- Fault tolerance in networked control systems under intermittent observations
- Existence and exponential stability of a periodic solution for fuzzy cellular neural networks with time-varying delays
- Optimization-based approach to path planning for closed chain robot systems
- Intelligent decision-making system for autonomous robots
- Adaptive control scheme based on the least squares support vector machine network
- Positive stable realizations of fractional continuous-time linear systems
- Estimation of feedwater heater parameters based on a grey-box approach
- Evolving small-board go players using coevolutionary Temporal Difference Learning with archives
- A fine-grained arc-consistency algorithm for non-normalized constraint satisfaction problems
- Knowledge discovery in data using formal concept analysis and random projections
- Partitioned iterated function systems with division and a fractal dependence graph in recognition of 2D shapes
- A well-posed multiscale regularization scheme for digital image denoising
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 21, number 1 (2011)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 20 (2010)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 19 (2009)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 18 (2008)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 17 (2007)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 16 (2006)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 15 (2005)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 13 (2003)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 12 (2002)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 11 (2001)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 10 (2000)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 9 (1999)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 8 (1998)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 7 (1997)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 6 (1996)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 5 (1995)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 4 (1994)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 3 (1993)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 2 (1992)
-
International Journal of Applied Mathematics and Computer Science (AMCS),volume 1 (1991)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 26 (2016)
| Nazwa wydania | Data |
|---|---|
| Evolving small-board go players using coevolutionary Temporal Difference Learning with archives | 2024-11-05 |
