AlphaGo

Computer go bot developed by Google DeepMind.

Algorithm

Combines MCTS with two neural networks: a policy network and a value network.

DeepMind published the algorithm in the journal Nature: https://storage.googleapis.com/deepmind-media/alphago/AlphaGoNaturePaper.pdf

Accomplishments

October 2015 - First AI program to defeat a professional player on a 19x19 board without any handicap. This was against the French player Fan Hui (2p) who lost 0-5[1].

March 2016 - Defeated Lee Sedol 4-1 in a 5-game match with a prize purse of one million USD. AlphaGo won the first three games by resignation. Then, in the fourth game, Lee Sedol played a tesuji in the centre that led to victory after it had looked like AlphaGo had been winning in the opening. AlphaGo made several clear mistakes before resigning, showing how its policy networks are susceptible to over-valuing forcing moves if they lead to a higher perceived winning percentage. In a close match, Lee resigned the fifth game, giving a final score of 4-1 for AlphaGo. Lee had been winning early in the game after AlphaGo could not correctly read out a two-stone edge squeeze and made a mistake locally, but later in the game he neglected to play a more aggressive extension in the upper part of the board, instead preferring to play safe and make eye shape. When Lee resigned, AlphaGo was estimated to be winning by about 2.5 points, with 7.5 komi under Chinese scoring.

December 2016-January 2017 - Defeated top pro players 60 times in a row online, playing anonymously as "Master". A 61st game was called off because AlphaGo's opponent disconnected. The games were played with short time controls on Tygem and FoxGo ?. It seems clear that AlphaGo is now superhuman at the game of Go, and pros probably need to take at least a 2 stone handicap to be even with it.

May 2017 - Defeated Ke Jie 3-0 in a 3-game match during the Future of Go Summit in Wuzhen, China.



[1] These are the results of the five formal games with longer time controls. Five informal games with shorter time controls were also played and Fan Hui won two of them by resignation (see Silver et al. 2016; p. 493). The kifu of the formal games seem to be available at page 488 (op. cit.).

AlphaGo vs. Lee Sedol Challenge match 2016

External Links

Nature News http://www.nature.com/news/google-ai-algorithm-masters-ancient-game-of-go-1.19234

http://www.nature.com/news/google-ai-algorithm-masters-ancient-game-of-go-1.19234 Silver et al., "Mastering the game of Go with deep neural networks and tree search," Nature 529, 484-489 (2016) http://www.nature.com/nature/journal/v529/n7587/full/nature16961.html

http://www.nature.com/nature/journal/v529/n7587/full/nature16961.html Google DeepMind http://deepmind.com/alpha-go.html

http://deepmind.com/alpha-go.html Documentary on youtube: https://www.youtube.com/watch?v=WXuK6gekU1Y

AlphaGo quick online games against many professionals 2016/2017

Between 2016-12-29 and 2017-01-05 AlphaGo played games under aliases Magist and Master(P) on Tygem and Foxy servers against tens of professional players, among them the highest ranking players of the time Ke Jie 9p and Park Junghwan 9p. This collection consists of 60 games which all AlphaGo won (except one in which opponent connection was lost and is marked as tie).

60 Games and commentaries

SGF collection of 60 games by Marcel Grünauer http://rechne.net/dl/the_master_files.zip or as pdf: https://www.mindo.io/alphago_60_games.pdf

Games 1-41 could be viewed on browser at http://www.go-baduk-weiqi.de/masterp-schlaegt-go-profis/ (German site) and games 42-60 http://www.go-baduk-weiqi.de/masterp-alias-mastergo-spielt-60zu0/ (in German)

Here are commentaries or analysis by various people on game by game (player names fixed per https://www.reddit.com/r/baduk/comments/5ozzp7/complete_list_of_masters_opponents/ ).

01 2016-12-29 Magist - (manhan7(P)) Pan Tingyu (潘亭宇)

English, video, Tyler Oyakawa ~3D https://www.youtube.com/watch?v=ABRLrxT9dkw&t=126s

English, video, Michael Redmond 9p https://www.youtube.com/watch?v=9z1aRyynaBI

Corresponding sgf-file with variations: http://www.usgo.org/news/wp-content/uploads/2017/03/master01_NNannotated.sgf

02 2016-12-29 Magist - (bandari(P)) Zhang Ziliang

English, video, Tyler Oyakawa ~3D Who is Master(P) #2 https://www.youtube.com/watch?v=9bUu2XFLxWw

English, video, Michael Redmond 9p https://www.youtube.com/watch?v=LJ8d_KTKZ-Q

Corresponding sgf-file with variations: http://www.usgo.org/news/wp-content/uploads/2017/03/master02_NN_annotated.sgf

03 2016-12-29 (ShengR(P)) Ding Shixiong - Magist

04 2016-12-29 Magist - (wohu(P)) Xie Erhao

English, video, Michael Redmond 9p https://www.youtube.com/watch?v=3jGkC9jeU5s

Corresponding sgf-file with variations: http://www.usgo.org/news/wp-content/uploads/2017/03/master04_Xie_Erhao.sgf

05 2016-12-29 (trace(P)) Yu Zhiying - Magist

English, video, Brady Daniels ~3d, AlphaGo - Whatever You Do Is Wrong, https://youtu.be/6rB2cYOeppQ

06 2016-12-29 ( AoXiang ?(P)) Li Xiangyu - Magist

07 2016-12-29 (cfs(P)) Qiao Zhijian - Magist

08 2016-12-29 Magist - (3qiKing(P)) Han Yizhou

09 2016-12-29 (Hopeldo(P)) Meng Tailing - Magist

Chinese video, ??, https://www.youtube.com/watch?v=IoPpCQgB4BY (no longer available?)

English, video, Michael Redmond 9p https://www.youtube.com/watch?v=PZW_HXg714s

Corresponding sgf-file with variations: http://www.usgo.org/news/wp-content/uploads/2017/03/master09_Meng_Tailing.sgf

10 2016-12-30 Magist - (Hopeldo(P)) Meng Tailing

Chinese video, Mi Yuting 9p (is it he?), https://www.youtube.com/watch?v=CqUgsydtO_Y (no longer available?)

11 2016-12-30 Master - ( FengYu ?(P)) Chen Hao

12 2016-12-30 Master - (atomy(P)) Liu Yuhang ==== (this really is #13)

English, video, Tyler Oyakawa ~3D Who is Master(P)? #3 https://www.youtube.com/watch?v=8zuBPi9BjLo

13 2016-12-30 Master - (YuSSSS(P)) Wang Haoyang ==== (this really is #12)

14 2016-12-30 (Chop(P)) Yan Zaiming - Master

15 2016-12-30 Magister - (XIUZHI(P)) Park Junghwan

16 2016-12-30 Master - (lxlx(P)) Lian Xiao

English, video, Brady Daniels ~3d, Appreciating AlphaGo, https://youtu.be/YtQM8fx87PU

17 2016-12-30 Master - (lxlx(P)) Lian Xiao

English, video, Michael Redmond 9p https://www.youtube.com/watch?v=2BCcxfyvh1w

Corresponding sgf-file with variations: http://www.usgo.org/news/wp-content/uploads/2017/03/master17_Lian_Xiao.sgf

18 2016-12-30 (Kiss88(P)) Ke Jie - Master

English, video, Haylee 4p, Haylee's World of Go/Baduk, AlphaGo's Online Game Review 1 - Ke Jie, https://www.youtube.com/watch?v=b_24iaUMRFs

English, text comments in SGF viewer, 6d, https://gokibitz.com/kifu/S16_4wYrg

Chinese, video, https://www.youtube.com/watch?v=ZrOuXGH3Jg8 (no longer available?)

English video, Jennie Shen 2p translating commentaries of Meng Tailing 6p and adding own analysis, https://www.youtube.com/watch?v=8AqoP_N2WVU

19 2016-12-30 Master - (Kiss88(P)) Ke Jie

English, video, Haylee 4p, Haylee's World of Go/Baduk, AlphaGo's Online Game Review 2 - Ke Jie, https://www.youtube.com/watch?v=_NR_K4oPtCU

20 2016-12-30 (XIUZHI(P)) Park Junghwan - Master

English, video, Haylee 4p, Haylee's World of Go/Baduk, AlphaGo's Online Game Review 3 - Park Junghwan https://www.youtube.com/watch?v=xrOv9lqi4xE

Chinese video, Mi Yuting 9p with Meng Tailing 6p??, https://www.youtube.com/watch?v=52GT2XiptwU (no longer available?)

English, video, Michael Redmond 9p https://www.youtube.com/watch?v=9D7h3ROQzAI

Corresponding sgf-file with variations: http://www.usgo.org/news/wp-content/uploads/2017/04/master15_ParkJunghwan_Master_Redmond.sgf

Remark: In the video and sgf-file the game is erroneously referred to as #15.

21 2016-12-31 Master - (Loong(P)) Chen Yaoye

22 2016-12-31 Master - (Loong(P)) Chen Yaoye

English video, Michael Redmond 9p https://www.youtube.com/watch?v=G5OKn2lWICk

Corresponding sgf-file with variations: http://www.usgo.org/news/wp-content/uploads/2017/05/RR08-master22_Master-Chen_Yaoye-2_final.sgf

23 2016-12-31 (abc2080(P)) Kim Junghyun - Master

English, video, Tyler Oyakawa ~3d(?), Who is Master(P)? #5 vs Kim Jiseok https://www.youtube.com/watch?v=y0KQ0z8Cxx4

English, video, Michael Redmond 9p https://www.youtube.com/watch?v=RJh_EJcDx8Q

24 2016-12-31 (XIUZHI(P)) Park Junghwan - Master

English video, Jennie Shen 2p translating commentaries of Meng Tailing 6p and adding own analysis, https://www.youtube.com/watch?v=aTbxf8-w6AE

25 2016-12-31 Master - (XIUZHI(P)) Park Junghwan

English, video, Haylee 4p, Haylee's World of Go/Baduk, AlphaGo's Online Game Review 4 - Park Junghwan https://www.youtube.com/watch?v=bO9CvC7lZ-o

English translated SGF, http://lifein19x19.com/forum/viewtopic.php?p=215719#p215719

26 2016-12-31 (dauning(P)) Yun Chanhee - Master

English, video, Dwyrin 5d, AlphaGo vs Tygem - An 8p Falls to Master(P), https://www.youtube.com/watch?v=z9P8wG6b4-8

27 2016-12-31 (ddcg) Fan Tingyu - Master

English, video, Brady Daniels ~3d, AlphaGo - Whatever You Do Is Wrong, https://youtu.be/6rB2cYOeppQ?t=19m36s

28 2016-12-31 (Hopeldo(P)) Meng Tailing - Master

29 2016-12-31 Master - (Strive(P)) Mi Yuting

English translation, Mi Yuting 9p with Meng Tailing 6p, Text in SGF viewer in Forum, http://www.lifein19x19.com/forum/viewtopic.php?p=215654#p215654

Chinese video, ??, https://www.youtube.com/watch?v=ifKtZFGaO5k (no longer available?)

English video, Jennie Shen 2p translating commentaries of Meng Tailing 6p and adding own analysis, https://www.youtube.com/watch?v=0y7DUHzWOEg

30 2016-12-31 Master - (930115) Tang Weixing

Chinese video, Tang Weixing 9p with Meng Tailing 6p, https://www.youtube.com/watch?v=khOMKHTWOgw (no longer available?)

English subtitled video, Tang Weixing 9p and Meng Tailing 6p, https://www.youtube.com/watch?v=QupHEQbuc30

English video, Jennie Shen 2p translating commentaries of Meng Tailing 6p and adding own analysis, https://www.youtube.com/watch?v=T7dJbrNPLZs

31 2017-01-01 (black2012) Li Qincheng - Master

English video, Michael Redmond 9p https://www.youtube.com/watch?v=d_LJnMlwPeQ

Corresponding sgf-file with variations: http://www.usgo.org/news/wp-content/uploads/2017/05/RR11-master31_Li_Qincheng-Master_final.sgf

32 2017-01-02 Master - (星宿老仙) Gu Li

English, video, Michael Redmond 9p https://www.youtube.com/watch?v=YmH7ChHp6rM

Corresponding sgf-file with variations: http://www.usgo.org/news/wp-content/uploads/2017/04/2016.04.22_RR12-master32-Master-Gu_Li_kgs-variations04.03.sgf

33 2017-01-02 (星宿老仙) Gu Li - Master

English, video, Michael Redmond 9p https://www.youtube.com/watch?v=Ymgv3kdLLXg

Corresponding sgf-file with variations: http://www.usgo.org/news/wp-content/uploads/2017/04/RR13-master33_Gu_Li_02_annotated.sgf

34 2017-01-02 (jingjing) Dang Yifei - Master

35 2017-01-02 Master - (kuangren) Jiang Weijie

English, video, Michael Redmond 9p https://www.youtube.com/watch?v=1vVe1pKmhQ4

Corresponding sgf-file with variations: http://www.usgo.org/news/wp-content/uploads/2017/05/RR14_master35_Jiang_Weijie_01_annotated-final.sgf

36 2017-01-02 (INDIANA13) Gu Zihao - Master

English video, Michael Redmond 9p https://www.youtube.com/watch?v=gWabLAkvpIQ

Corresponding sgf-file with variations: http://www.usgo.org/news/wp-content/uploads/2017/05/RR15_master36_Gu_Zihao_01_final.sgf

37 2017-01-02 (pyh) Park Yeonghun - Master

English video, Ryan Li 1p & Stephanie Yin 1p, https://www.youtube.com/watch?v=tgPuGxqlQrY

38 2017-01-02 (天选) Tuo Jiaxi - Master

39 2017-01-02 (jpgo01) Iyama Yuta - Master

40 2017-01-02 Master - (愿我能) Meng Tailing

Chinese video, Mi Yuting 9p (is it he?), https://www.youtube.com/watch?v=ip4J4KT-ZWI (no longer available?)

41 2017-01-02 (airforce9) Kim Jiseok

Haylee: AlphaGo's Online Game Review 5 - Kim Jiseok : https://www.youtube.com/watch?v=on314lXDv9Q

42 2017-01-03 (smile) Yang Dingxin - Master

43 2017-01-03 (piaojie) Kang Dongyun - Master

44 2017-01-03 Master - (spinmove) An Sungjoon

45 2017-01-03 (leaf) Shi Yue - Master

English video, Ryan Li 1p & Stephanie Yin 1p, https://www.youtube.com/watch?v=8ye-L4JdAxM

46 2017-01-03 Master - (剑过无声) Lian Xiao

47 2017-01-03 (段誉) Tan Xiao - Master

English video, Michael Redmond 9p https://www.youtube.com/watch?v=zYOQ2Xwpedg

Corresponding sgf-file with variations: http://www.usgo.org/news/wp-content/uploads/2017/05/RR16_master47_Tan_Xiao_FINAL.sgf

48 2017-01-03 Master - (maker) Park Junghwan

English, video, Nick Sibicky(4D) Go Lecture #233 - Alpha Go Strikes Back! https://www.youtube.com/watch?v=v8Eh41m7gVA

English video, Michael Redmond 9p https://www.youtube.com/watch?v=aXsZGEqe1kA

Corresponding sgf-file with variations: http://www.usgo.org/news/wp-content/uploads/2017/05/2017.05.14_master48_Park_Jungwhan_final.sgf

49 2017-01-03 Master - (wonfun) Weon Seongjin

50 2017-01-03 Master - (潜伏) Ke Jie

English video, Simon Janin (3D) https://www.youtube.com/watch?v=XqCSwmcJqlQ

English, video, Michael Redmond 9p https://www.youtube.com/watch?v=O375GjxwhhQ

Corresponding sgf-file with variations: http://www.usgo.org/news/wp-content/uploads/2017/05/2017.04.27_master-ke-jie51-kgscomments-final.sgf

51 2017-01-04 Master - (周俊勳) Zhou Junxun

52 2017-01-04 Master - (ykpcx) Fan Tingyu

53 2017-01-04 (kongm) Huang Yunsong - Master

54 2017-01-04 (聂卫平) Nie Weiping - Master

55 2017-01-04 Master - (谜团) Chen Yaoye

56 2017-01-04 (shadowpow) Cho Hanseung - Master

57 2017-01-04 (nparadigm) Shin Jinseo - Master

58 2017-01-04 Master - (小香馋猫) Chang Hao

59 2017-01-04 (Eason) Zhou Ruiyang - Master

60 2017-01-04 Master - (古力) Gu Li

News links on quick games

Yonhap News Agency S. Korean Go master says upgraded AlphaGo 'too strong' for humans http://english.yonhapnews.co.kr/news/2017/01/10/0200000000AEN20170110005500315.html

http://english.yonhapnews.co.kr/news/2017/01/10/0200000000AEN20170110005500315.html Korean JoongAng Daily, Learning from AlphaGo http://koreajoongangdaily.joins.com/news/article/article.aspx?aid=3028376





AlphaGo Zero 2017

25 minute video of some of the 80 self-play games released of AlphaGo Zero against older AlphaGo Master version on YouTube: 1 2 3 4 5

See also