index of games

Here are the games mentioned on this site, with links to the pages they’re mentioned on. Games mentioned in passing, with no actual analysis, aren’t included.

Jay : game learning : index of games

backgammon

the neural net backgammon programs (and subsidiary pages)

TD learning as a mutation

game links

online papers:

- "Automated feature selection to maximize learning in artificial intelligence"

- "Learning and improving backgammon strategy"

- "TDLeaf(lambda): Combining temporal difference learning with game tree search"

- "TD learning of game evaluation functions with hierarchical neural architectures"

Bolo

interesting pages

game links

bridge

online papers:

- "Pragmatic reasoning in bridge"

- "Strategic planning for imperfect-information games"

checkers (8x8 draughts)

interesting pages

online papers:

- "Co-evolving checkers playing programs using only win, lose, or draw"

- "Derivative evaluation function learning using genetic operators"

- "Learning models of the opponent strategy in game playing"

- "Learning of resource allocation strategies for game playing"

- "The M* algorithm: Incorporating opponent models into adversary search"

- "NeuroDraughts: an application of temporal difference learning to draughts"

- "NeuroDraughts: the role of representation, search, training regime, and architecture in a TD draughts player"

online software:

- NeuroDraughts

chess

game links

the Morph project

NeuroChess

SAL

chess GA experiments

historical interest: Deep Thought

online papers:

- "Chunking for experience"

- "A grandmaster chess machine"

- "Generalizing closed world specialization: a chess endgame application"

- "How hard is the correct coding of an easy endgame?"

- "Learning logical exceptions in chess"

- "KnightCap: A chess program that learns by combining TD(lambda) with minimax search"

- "Machine learning in computer chess: The next generation"

- "Neural networks and chess"

- "On the automatic generation of case libraries by chunking chess games"

- "Programmes d'échecs de championnat: Architecture logicielle, synthèse de fonctions d'évaluation, parallélisme de recherche"

- "TDLeaf(lambda): Combining temporal difference learning with game tree search"

- "Temporal difference learning and chess"

online software:

- Chenard

- crafty

- KnightCap

- Nessi

- Octavius

- zzzzzz

connect-four

SAL

online papers:

- "Artificial neural nets applied to strategic games"

differential games

see pursuit-evasion games, below; most of them are differential games

draughts - also see checkers

interesting pages

go

Nici Schraudolph's go networks

game links

interesting pages

online papers:

- "Adaptive critic design in learning to play game of go"

- "Coevolutionary search among adversaries"

- "Evolving go playing strategy in neural networks"

- "Evolving neural networks to play go" (two papers of this title)

- "Exploratory learning in the game of go"

- "Go and genetic programming"

- "Go, SVM, go"

- "The Golem go program"

- "Information about the go program I'm writing"

- "The integration of a priori knowledge into a go playing neural network"

- "A machine learning approach to the game of go"

- "Machine learning, game play, and go"

- "Methods for competitive co-evolution: Finding opponents worth beating" (7x7 go)

- "Monte Carlo go"

- "Unsupervised learning of go patterns"

online software:

- GNU Go

- OpenGo

- PubGo+

nim

the Morph project

online papers:

- "Methods for competitive co-evolution: Finding opponents worth beating"

othello

game links

the strong learning othello programs - Bill, Hannibal, Keyano, Kitty, Logistello, Zebra

marker-based neurogenetic algorithm

SANE neurogenetic algorithm

online papers:

- "Automatic feature generation for problem solving systems"

- "Feature discovery for inductive concept learning"

- "Feature discovery for problem solving systems"

- "Genetic Othello v1.02"

- "Genetische Algorithmen zur Bestimmung heuristischer Bewertungsfunktionen bei Spielen"

- "A hybrid theory of feature generation"

- "Learning of position evaluation in the game of othello"

- "Using experience-based learning in game playing"

online software:

- Neurothello

ping pong

See table tennis, below.

poker

interesting pages

online papers:

- "Opponent modeling in poker"

pursuit-evasion games

pursuit-evasion games

reversi

See othello, above.

shogi

game links

soccer

robotic soccer

interesting pages - ASCII soccer (soccer-like game)

online papers:

- "Markov games as a framework for multi-agent reinforcement learning" (simplified, slightly soccer-like task)

table tennis (aka ping pong)

interesting pages

tic-tac-toe

the Morph project

SAL

historical interest: MENACE

online papers:

- "Bottom-Up Recognition Learning: A compilation-based model of limited-lookahead learning"

- "Coevolving high-level representations"

- "Competitive environments evolve better solutions for complex tasks"

- "Evolutionary induction of subroutines"

- "Explorations of the practical issues of learning prediction-control tasks using temporal difference learning methods"

- "Learning models of the opponent strategy in game playing"

- "Learning to play games from experience: An application of artificial neural networks and temporal difference learning"

- "The M* algorithm: Incorporating opponent models into adversary search"

- "Methods for competitive co-evolution: Finding opponents worth beating"

- "Modular neural networks for learning context-dependent game strategies"

- "Multi-criteria reinforcement learning"

- "TD learning of game evaluation functions with hierarchical neural architectures"

video games

online papers:

- "An adaptive video game using the method of temporal differences"

- "Incorporating advice into agents that learn from reinforcements" (two papers of this title)

- "Temporal differences-based policy iteration and applications in neuro-dynamic programming" (tetris)

other games

abalone - interesting pages

Battlecruiser: 3000AD - less-interesting pages

blackjack - online papers

a cube-control game in a virtual world - interesting pages

Diplomacy - less-interesting pages

dots and boxes - online papers

fandango - interesting pages

fortress - online software

hex - less-interesting pages

kinglet - online papers

malawi - online papers

mastermind - interesting pages

matrix games - interesting pages

ninuki-renju (aka Pente) - online software

nine men's morris - online papers

Quixo - online papers

RARS - interesting pages

senet - online papers

symmetric chess-like games - the Metagame project

tetris - rational search

turncoat-chess - the Metagame project

xconq - less-interesting pages

