Object
Title: Evolving small-board go players using coevolutionary Temporal Difference Learning with archives
Contributor:
Korbicz, Józef (1951- ) - red. ; Uciński, Dariusz - red.
Group publication title:
Abstract:
We apply Coevolutionary Temporal Difference Learning (CTDL) to learn small-board Go strategies represented as weighted piece counters. CTDL is a randomized learning technique which interweaves two search processes that operate in the intra-game and inter-game mode. Intra-game learning is driven by gradient-descent Temporal Difference Learning (TDL), a reinforcement learning method that updates the board evaluation function according to differences observed between its values for consecutively visited game states. ; For the inter-game learning component, we provide a coevolutionary algorithm that maintains a sample of strategies and uses the outcomes of games played between them to iteratively modify the probability distribution, according to which new strategies are generated and added to the sample. We analyze CTDL?s sensitivity to all important parameters, including the trace decay constant that controls the lookahead horizon of TDL, and the relative intensity of intra-game and inter-game learning. ; We also investigate how the presence of memory (an archive) affects the search performance, and find out that the archived approach is superior to other techniques considered here and produces strategies that outperform a handcrafted weighted piece counter strategy and simple liberty-based heuristics. This encouraging result can be potentially generalized not only to other strategy representations used for small-board Go, but also to various games and a broader class of problems, because CTDL is generic and does not rely on any problem-specific knowledge.
Publisher:
Zielona Góra: Uniwersytet Zielonogórski
Resource Identifier:
DOI:
Pages:
Source:
AMCS, Volume 21, Number 4 (2011) ; click here to follow the link
Language:
Rights:
Biblioteka Uniwersytetu Zielonogórskiego
Object collections:
- Digital Library of Zielona Góra > Repository > Faculties > Faculty of Computer, Electrical and Control Engineering
- Digital Library of Zielona Góra > Repository > Types of work > Articles
- Digital Library of Zielona Góra > Repository > Scientific journals and UZ publishing series > International Journal of Applied Mathematics and Computer Science (AMCS)
- Digital Library of Zielona Góra > Repository > Scientific journals and UZ publishing series > International Journal of Applied Mathematics and Computer Science (AMCS) > International Journal of Applied Mathematics and Computer Science (AMCS) (2011)
Last modified:
Nov 5, 2024
In our library since:
Aug 28, 2018
Number of object content hits:
3 642
All available object's versions:
https://zbc.uz.zgora.pl/publication/55055
Show description in RDF format:
Show description in OAI-PMH format:
-
International Journal of Applied Mathematics and Computer Science (AMCS)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 26 (2016)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 25 (2015)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 24 (2014)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 23 (2013)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 22 (2012)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 21 (2011)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 21, number 1 (2011)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 21, number 2 (2011)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 21, number 3 (2011)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 21, number 4 (2011)
- International Journal of Applied Mathematics and Computer Science (AMCS), volume 21, number 4 (2011) - spis treści
- Delay-dependent generalized h2 control for discrete T-S fuzzy large-scale stochastic systems with mixed delays
- LMI-based adaptive fuzzy integral sliding mode control of mismatched uncertain systems
- Observer-based fault-tolerant control against sensor failures for fuzzy systems with time delays
- Novel optimal recursive filter for state and fault estimation of linear stochastic systems with unknown disturbances
- Fault tolerance in networked control systems under intermittent observations
- Existence and exponential stability of a periodic solution for fuzzy cellular neural networks with time-varying delays
- Optimization-based approach to path planning for closed chain robot systems
- Intelligent decision-making system for autonomous robots
- Adaptive control scheme based on the least squares support vector machine network
- Positive stable realizations of fractional continuous-time linear systems
- Estimation of feedwater heater parameters based on a grey-box approach
- Evolving small-board go players using coevolutionary Temporal Difference Learning with archives
- A fine-grained arc-consistency algorithm for non-normalized constraint satisfaction problems
- Knowledge discovery in data using formal concept analysis and random projections
- Partitioned iterated function systems with division and a fractal dependence graph in recognition of 2D shapes
- A well-posed multiscale regularization scheme for digital image denoising
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 21, number 1 (2011)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 20 (2010)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 19 (2009)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 18 (2008)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 17 (2007)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 16 (2006)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 15 (2005)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 13 (2003)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 12 (2002)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 11 (2001)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 10 (2000)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 9 (1999)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 8 (1998)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 7 (1997)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 6 (1996)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 5 (1995)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 4 (1994)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 3 (1993)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 2 (1992)
-
International Journal of Applied Mathematics and Computer Science (AMCS),volume 1 (1991)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 26 (2016)
| Edition name | Date |
|---|---|
| Evolving small-board go players using coevolutionary Temporal Difference Learning with archives | Nov 5, 2024 |
