Editing 1002: Game AIs

Jump to: navigation, search

Warning: You are not logged in. Your IP address will be publicly visible if you make any edits. If you log in or create an account, your edits will be attributed to your username, along with other benefits.

The edit can be undone. Please check the comparison below to verify that this is what you want to do, and then save the changes below to finish undoing the edit.
Latest revision Your text
Line 14: Line 14:
 
: These games are considered "solved", meaning the ideal maneuver for each game state (Tic-Tac-Toe, Connect Four) or each of the limited starting positions (Checkers) has already been calculated. Computers aren't so much playing as they are recalculating the list of ideal maneuvers. The same could be said for the computer's human opponent, just at a slower pace.
 
: These games are considered "solved", meaning the ideal maneuver for each game state (Tic-Tac-Toe, Connect Four) or each of the limited starting positions (Checkers) has already been calculated. Computers aren't so much playing as they are recalculating the list of ideal maneuvers. The same could be said for the computer's human opponent, just at a slower pace.
  
*'''{{w|Tic-tac-toe}}''' or '''Noughts and Crosses''' in most of the rest of the British Commonwealth countries is a pencil-and-paper game for two players, X and O, who take turns marking the spaces in a 3×3 grid. This game nearly always ends in a tie, regardless of whether humans or computers play it because the total number of positions is small. Randall posted a complete guide to the winning tactics more than a year before as [[832: Tic-Tac-Toe]].
+
*'''{{w|Tic-tac-toe}}''' or '''Noughts and Crosses''' in most of the rest of the British Commonwealth countries is a pencil-and-paper game for two players, X and O, who take turns marking the spaces in a 3×3 grid. This game nearly always ends in a tie, regardless of whether humans or computers play it, because the total number of positions is small.
  
 
*'''{{w|Nim}}''' is a mathematical game of strategy in which two players take turns removing objects from distinct heaps. On each turn, a player must remove at least one object, and may remove any number of objects provided they all come from the same heap.
 
*'''{{w|Nim}}''' is a mathematical game of strategy in which two players take turns removing objects from distinct heaps. On each turn, a player must remove at least one object, and may remove any number of objects provided they all come from the same heap.
Line 20: Line 20:
 
*'''{{w|Ghost (game)|Ghost}}''' is a spoken word game in which players take turns adding letters to a growing word fragment. The loser is the first person who completes a valid word or who creates a fragment that cannot be the start of a word. Randall himself has written a perfect solution to Ghost, [https://blog.xkcd.com/2007/12/31/ghost/ which he posted on his blog]. Depending on the dictionary used, either the first player can always force a win, or the second player can.
 
*'''{{w|Ghost (game)|Ghost}}''' is a spoken word game in which players take turns adding letters to a growing word fragment. The loser is the first person who completes a valid word or who creates a fragment that cannot be the start of a word. Randall himself has written a perfect solution to Ghost, [https://blog.xkcd.com/2007/12/31/ghost/ which he posted on his blog]. Depending on the dictionary used, either the first player can always force a win, or the second player can.
  
*'''{{w|Connect Four}}''' (or '''Captain's Mistress''', '''Four Up''', '''Plot Four''', '''Find Four''', '''Fourplay''', '''Four in a Row''', '''Four in a Line''') is a two-player game in which the players first choose a color and then take turns dropping their colored discs from the top into a seven-column, six-row vertically-suspended grid. Randall made a reference of this game at [[1767: US State Names]].
+
*'''{{w|Connect Four}}''' (or '''Captain's Mistress''', '''Four Up''', '''Plot Four''', '''Find Four''', '''Fourplay''', '''Four in a Row''', '''Four in a Line''') is a two-player game in which the players first choose a color and then take turns dropping their colored discs from the top into a seven-column, six-row vertically-suspended grid.
  
*'''{{w|Gomoku}}''' (or '''Gobang''', '''Five in a Row''') is an abstract strategy board game. It is traditionally played with go pieces (black and white stones) on a go board (19x19 intersections); however, because once placed, pieces are not moved or removed from the board, Gomoku may also be played as a paper and pencil game. This game is known in several countries under different names.
+
*'''{{w|Gomoku}}''' (or '''Gobang''', '''Five in a Row''') is an abstract strategy board game. It is traditionally played with go pieces (black and white stones) on a go board (19x19 intersections); however, because once placed, pieces are not moved or removed from the board, gomoku may also be played as a paper and pencil game. This game is known in several countries under different names.
 
:Black plays first, and players alternate in placing a stone of their color on an empty intersection. The winner is the first player to get an unbroken row of five stones horizontally, vertically, or diagonally.
 
:Black plays first, and players alternate in placing a stone of their color on an empty intersection. The winner is the first player to get an unbroken row of five stones horizontally, vertically, or diagonally.
  
Line 33: Line 33:
 
*'''{{w|Scrabble}}''' is a word game in which two to four players score points by forming words from individual lettered tiles on a gameboard marked with a 15-by-15 grid.
 
*'''{{w|Scrabble}}''' is a word game in which two to four players score points by forming words from individual lettered tiles on a gameboard marked with a 15-by-15 grid.
  
*'''{{w|Counter-Strike|CounterStrike}}''' most likely refers to the popular multiplayer shooter video game series about terrorists and counter-terrorists. Counter-Strike is notorious for the large variety of cheating tools that have been made for it; a computer would have essentially perfect accuracy and reflexes, essentially making it the {{w|aimbot}} from hell. It is theoretically possible for a skilled player to beat such an AI, but it would be ''extremely'' difficult to do so. '''{{w|Counter-Strike:_Condition_Zero|Condition Zero}}''' has pre-set PvE scenarios called '''Deleted Scenes''', but the AI used for enemies isn't particularly skilled and can be beaten by an average player.
+
*'''{{w|Counter-Strike|CounterStrike}}''' most likely refers to the popular multiplayer shooter video game about terrorists and counter-terrorists. Counter-Strike is notorious for the large variety of cheating tools that have been made for it; a computer would have essentially perfect accuracy and reflexes, essentially making it the {{w|aimbot}} from hell. It is theoretically possible for a skilled player to beat an AI, but it would be ''extremely'' difficult to do so.
  
 
*'''{{w|Beer pong}}''' (or '''Beirut''') is a drinking game in which players throw a ping pong ball across a table with the intent of landing the ball in a cup of beer on the other end.
 
*'''{{w|Beer pong}}''' (or '''Beirut''') is a drinking game in which players throw a ping pong ball across a table with the intent of landing the ball in a cup of beer on the other end.
Line 50: Line 50:
 
:The below games are incredibly difficult to "solve" due to the near-infinite number of possible positions. Computers built in the early 21st century would take years to calculate a single "ideal" move. Worse, the human opponent has the ability to "bluff"; that is, to make a bad move, thus baiting the computer into a trap. Complex algorithms have been devised to make moves in a reasonable timeframe, but so far they are all highly vulnerable to bluffing. As mentioned in the comic, focused research and development is working on refining these algorithms to play the games better.
 
:The below games are incredibly difficult to "solve" due to the near-infinite number of possible positions. Computers built in the early 21st century would take years to calculate a single "ideal" move. Worse, the human opponent has the ability to "bluff"; that is, to make a bad move, thus baiting the computer into a trap. Complex algorithms have been devised to make moves in a reasonable timeframe, but so far they are all highly vulnerable to bluffing. As mentioned in the comic, focused research and development is working on refining these algorithms to play the games better.
  
*'''{{w|StarCraft}}''' is a military real-time strategy video game series. The game revolves around three species, Terran (humans), Zerg, and Protoss, fighting for dominance in a distant part of the Milky Way galaxy known as the Koprulu Sector. Players must gather resources, build buildings and units, attack the opponent's base, and defend their base. While even average Starcraft players can defeat the AIs that originally shipped with the games, Starcraft has since been adopted as a standard benchmark for AI research, largely because of its excellent balance. Thanks to that attention, computers can now defeat at least 99.8% of all players, and the trend does not look promising for humans.
+
*'''{{w|StarCraft}}''' is a military science fiction real-time strategy video game. The game revolves around three species fighting for dominance in a distant part of the Milky Way galaxy known as the Koprulu Sector: the Terrans, humans exiled from Earth skilled at adapting to any situation; the Zerg, a race of insectoid aliens in pursuit of genetic perfection, obsessed with assimilating other races; and the Protoss, a humanoid species with advanced technology and psionic abilities, attempting to preserve their civilization and strict philosophical way of living from the Zerg. While even average Starcraft players can defeat the AIs that originally shipped with the games, Starcraft has since been adopted as a standard benchmark for AI research, largely because of its excellent balance. Thanks to that attention, computers can now challenge some expert players, and the trend does not look promising for human players <br/>'''Update:''' In a series of test matches held on December 19, 2018, [https://deepmind.com/blog/alphastar-mastering-real-time-strategy-game-starcraft-ii/ AlphaStar decisively beat Team Liquid’s Grzegorz "MaNa" Komincz, one of the world’s strongest professional StarCraft players].
  
*'''{{w|Poker}}''' is a family of card games involving betting and individualistic play whereby the winner is determined by the ranks and combinations of their cards, some of which remain hidden until the end of the game. It is also, however, a game of deception and intimidation, the ubiquitous "poker face" being considered the most important part of the game.<br>
+
*'''{{w|Poker}}''' is a family of card games involving betting and individualistic play whereby the winner is determined by the ranks and combinations of their cards, some of which remain hidden until the end of the game. It is also, however, a game of deception and intimidation, the ubiquitous "poker face" being considered the most important part of the game.<br/>'''Update:''' In a 20-day poker tournament from January 11 to 31, 2017, the poker AI {{w|Libratus}} [https://www.theverge.com/2017/1/31/14451616/ai-libratus-beat-humans-poker-cmu-tournament won against four top-class human poker players].
'''Update:''' In a 20-day poker tournament from January 11 to 31, 2017, the poker AI {{w|Libratus}} [https://www.theverge.com/2017/1/31/14451616/ai-libratus-beat-humans-poker-cmu-tournament won against four top-class human poker players].
 
  
*'''{{w|Arimaa}}''' is a two-player abstract strategy board game that can be played using the same equipment as chess. Arimaa was designed to be more difficult for artificial intelligences to play than chess. Arimaa was invented by Omar Syed, an Indian American computer engineer trained in artificial intelligence. Syed was inspired by Garry Kasparov's defeat at the hands of the chess computer Deep Blue to design a new game which could be played with a standard chess set, would be difficult for computers to play well, but would have rules simple enough for his then four-year-old son Aamir to understand.<br>
+
*'''{{w|Arimaa}}''' is a two-player abstract strategy board game that can be played using the same equipment as chess. Arimaa was designed to be more difficult for artificial intelligences to play than chess. Arimaa was invented by Omar Syed, an Indian American computer engineer trained in artificial intelligence. Syed was inspired by Garry Kasparov's defeat at the hands of the chess computer Deep Blue to design a new game which could be played with a standard chess set, would be difficult for computers to play well, but would have rules simple enough for his then four-year-old son Aamir to understand.<br/>'''Update:''' on April 18, 2015, a computer won [http://arimaa.com/arimaa/challenge/ the "Arimaa Challenge"], so this comic is now out of date with respect to Arimaa; it should move above ''Starcraft'' or ''Jeopardy!''.
'''Update:''' on April 18, 2015, a computer won [http://arimaa.com/arimaa/challenge/ the "Arimaa Challenge"], so this comic is now out of date with respect to Arimaa; it should move above ''Starcraft'' or ''Jeopardy!''.
 
  
*'''{{w|Go (game)|Go}}''' is an ancient board game for two players that originated in China more than 2,000 years ago. The game is noted for being rich in strategy despite its relatively simple rules. The game is played by two players who alternately place black and white stones on the vacant intersections (called "points") of a grid of 19×19 lines (beginners often play on smaller 9×9 and 13×13 boards). The object of the game is to use one's stones to control a larger amount of territory of the board than the opponent. That computers would soon beat humans was the subject in [[1263: Reassuring]].<br>
+
*'''{{w|Go (game)|Go}}''' is an ancient board game for two players that originated in China more than 2,000 years ago. The game is noted for being rich in strategy despite its relatively simple rules. The game is played by two players who alternately place black and white stones on the vacant intersections (called "points") of a grid of 19×19 lines (beginners often play on smaller 9×9 and 13×13 boards). The object of the game is to use one's stones to control a larger amount of territory of the board than the opponent. That computers would soon beat humans was the subject in [[1263: Reassuring]].<br/>'''Update:''' on March 15, 2016, Google's {{w|AlphaGo versus Lee Sedol|AlphaGo beat Lee Sedol}}, who was often seen as the dominant human player over the last decade, 4 games to 1 in a widely viewed match, and {{w|Computer Go}} was expected to become more dominant over time. In May 2017, Google's AI AlphaGo [http://www.irishtimes.com/business/technology/google-ai-becomes-world-s-top-ranking-go-player-1.3097756 defeated the world's top human Go player]. This was referenced three months later in [[1875: Computers vs Humans]].
'''Update:''' on March 15, 2016, Google's {{w|AlphaGo versus Lee Sedol|AlphaGo beat Lee Sedol}}, who was often seen as the dominant human player over the last decade, 4 games to 1 in a widely viewed match, and {{w|Computer Go}} was expected to become more dominant over time. In May 2017, Google's AI AlphaGo [http://www.irishtimes.com/business/technology/google-ai-becomes-world-s-top-ranking-go-player-1.3097756 defeated the world's top human Go player]. This was referenced three months later in [[1875: Computers vs Humans]].
+
 
 +
*'''{{w|Snakes and Ladders}}''' (or '''Chutes and Ladders''') is an ancient Indian {{w|race game}}, where the moves are decided entirely by die rolls. A number of tiles are connected by pictures of ladders and snakes (or chutes) which makes the game piece jump forward or backward, respectively. Since the game is decided by pure chance, it occupies the limbo where a computer will always be ''exactly'' as likely to win as a human (indeed, Randall's arrow points at the dividing line between 'humans beat computers' and 'computers cannot compete').
  
 
===Computers cannot compete===
 
===Computers cannot compete===
  
*'''{{w|Snakes and Ladders}}''' (or '''Chutes and Ladders''') is an ancient Indian {{w|race game}}, where the moves are decided entirely by die rolls or other random number generators. (However, any person or computer choosing the numbers needed directly is called "cheating".) A number of tiles are connected by pictures of ladders and snakes (or chutes) which makes the game piece jump forward or backward, respectively. Since the game is decided by pure chance, it occupies the limbo where a computer will always be ''exactly'' as likely to win as a human (indeed, Randall's arrow points at the dividing line between 'humans beat computers' and 'computers cannot compete').
+
*'''{{w|Mao (card game)|Mao}}''' (or '''Mau''') is a card game of the Shedding family, in which the aim is to get rid of all of the cards in hand without breaking certain unspoken rules. The game is from a subset of the Stops family, and is similar in structure to the card game Uno.
 
+
:The game forbids its players from explaining the rules, and new players are often told only "the only rule you may be told is this one." The ultimate goal of the game is to be the first player to get rid of all the cards in their hand. Computers would have a difficult time integrating into Mao either because they would know all the rules -- and thus be disqualified or simply ignored by the players -- or would need a complicated learning engine that quite simply doesn't exist.
*'''{{w|Mao (card game)|Mao}}''' is a card game similar to {{w|Crazy Eights}} or {{w|Uno}}, with the twist that new players aren't told any of the rules and have to deduce them by trial and error. (The rules are sometimes summarized as "The only rule I can tell you is this one"). The goal of the game is to be the first player to get rid of all the cards in their hand, at which point that player invents a new rule and adds it to the ones already in the game. Computers would have a difficult time integrating into Mao as they would need a complicated learning engine capable of deducing rules with no prior training, and would also need the ability to be able to invent rules itself.
 
  
 
*'''{{w|Seven minutes in heaven|Seven Minutes in Heaven}}''' is a teenagers' party game first recorded as being played in Cincinnati in the early 1950s. Two people are selected to go into a closet or other dark enclosed space and do whatever they like for seven minutes. Sexual activities are allowed; however kissing and making out are more common.
 
*'''{{w|Seven minutes in heaven|Seven Minutes in Heaven}}''' is a teenagers' party game first recorded as being played in Cincinnati in the early 1950s. Two people are selected to go into a closet or other dark enclosed space and do whatever they like for seven minutes. Sexual activities are allowed; however kissing and making out are more common.
:Because this is not a competitive game, players cannot "outplay" or "lose to" each other, regardless of whether they are humans or computers. Additionally, as the game is focused on human interaction, there's not a whole lot a modern computer can ''do'' in the closet. It would need some kind of robotic body in order to interact with its human partner, and emotion engines that could feel pleasure and displeasure in order to make decisions. The title text claims that {{w|Honda|Honda Motor Company}} has invented a "{{w|RealDoll}}" (sex toy shaped like a mannequin) with rudimentary Seven Minutes in Heaven capabilities, but they pale in comparison to a human's (specifically, Jeopardy champion Ken Jennings).
+
:As the game is focused on human interaction, there's not a whole lot a modern computer can ''do'' in the closet. It would need some kind of robotic body in order to interact with its human partner, and emotion engines that could feel pleasure and displeasure in order to make decisions. The title text claims that {{w|Honda|Honda Motor Company}} has invented a "{{w|RealDoll}}" (sex toy shaped like a mannequin) with rudimentary Seven Minutes in Heaven capabilities, but they pale in comparison to a human's.
  
 
And finally
 
And finally
Line 75: Line 73:
 
:The only hint at the true creation of the game ironically comes from the last Calvinball strip, in which a game of football quickly devolves into a game of Calvinball. Calvin remarks that "sooner or later, all our games turn into Calvinball," suggesting a similar scenario that directly led to the creation of the sport. Calvin and Hobbes usually play by themselves, although in one storyline Rosalyn (Calvin's baby-sitter) plays in return for Calvin doing his homework, and plays very well once she realizes that the rules are made up on the spot.
 
:The only hint at the true creation of the game ironically comes from the last Calvinball strip, in which a game of football quickly devolves into a game of Calvinball. Calvin remarks that "sooner or later, all our games turn into Calvinball," suggesting a similar scenario that directly led to the creation of the sport. Calvin and Hobbes usually play by themselves, although in one storyline Rosalyn (Calvin's baby-sitter) plays in return for Calvin doing his homework, and plays very well once she realizes that the rules are made up on the spot.
 
:The only consistent rules state that Calvinball may never be played with the same rules twice, and you need to wear a mask, no questions asked. Scoring is also arbitrary, with Hobbes at times reporting scores of "Q to 12" and "oogy to boogy." The only recognizable sports Calvinball resembles are the ones it emulates (i.e., a cross between croquet, polo, badminton, capture the flag, and volleyball.)
 
:The only consistent rules state that Calvinball may never be played with the same rules twice, and you need to wear a mask, no questions asked. Scoring is also arbitrary, with Hobbes at times reporting scores of "Q to 12" and "oogy to boogy." The only recognizable sports Calvinball resembles are the ones it emulates (i.e., a cross between croquet, polo, badminton, capture the flag, and volleyball.)
::Long story short, the game is a manifestation of pure chaos and the human imagination, far beyond the meager capabilities of silicon and circuitry, at least so far. The closest thing you could possibly get is having an AI automatically generate rules on the fly, similar to something like the currently-existent {{w|AI Dungeon}} or a similarly robust text algorithm; but even still, the computer would be unable to ''act'' upon these new rules in that state.
+
::Long story short, the game is a manifestation of pure chaos and the human imagination, far beyond the meager capabilities of silicon and circuitry, at least so far.
  
 
==Transcript==
 
==Transcript==
:[A diagram with a caption above the diagram. The left column describes various levels of skill for the most capable computers in decreasing performance against humans.  The right side lists games in each particular section, in increasing game difficulty.  There are labels denoting the hard and easy ends of the diagram.]
+
:Difficulty of Various Games for Computers
 
 
:Caption: Difficulty of Various Games for Computers
 
  
:Top of Diagram: <big>Easy</big>
+
:[A diagram. The left column describes various levels of skill for the most capable computers in decreasing performance against humans.  The right side lists games in each particular section, in increasing game difficulty.  There are labels denoting the hard and easy ends of the diagram.]
  
:;Solved <small>Computers can play perfectly</small>
+
:<big>Easy</big>
 +
----
 +
:;Solved
 +
:;<small>Computers can play perfectly</small>
  
 
::;Solved for all possible positions
 
::;Solved for all possible positions
Line 100: Line 99:
 
:;Computers can beat top humans
 
:;Computers can beat top humans
  
:::Scrabble
+
::Scrabble
:::CounterStrike
+
::CounterStrike
:::Beer Pong <small>(UIUC robot)</small>
+
::Beer Pong <small>(UIUC robot)</small>
:::Reversi
+
::Reversi
:::Chess
+
::Chess
  
:::* February 10, 1996: First win by computer against top human
+
::* February 10, 1996: First win by computer against top human
:::* November 21, 2005: Last win by human against top computer
+
::* November 21, 2005: Last win by human against top computer
  
:::Jeopardy
+
::Jeopardy
  
 
:;Computers still lose to top humans <small>(but focused R&D could change this)</small>
 
:;Computers still lose to top humans <small>(but focused R&D could change this)</small>
  
:::StarCraft
+
::StarCraft
:::Poker
+
::Poker
:::Arimaa
+
::Arimaa
:::Go
+
::Go
 +
::Snakes and Ladders
  
 
:;Computers may ''never'' outplay humans
 
:;Computers may ''never'' outplay humans
  
:::Snakes and Ladders
+
::Mao
:::Mao
+
::Seven Minutes in Heaven
:::Seven Minutes in Heaven
+
::Calvinball
:::Calvinball
+
----
 
+
:<big>Hard</big>
:Bottom of Diagram: <big>Hard</big>
 
  
 
{{comic discussion}}
 
{{comic discussion}}
 
[[Category:Charts]]
 
[[Category:Charts]]
 
[[Category:Video games]]
 
[[Category:Video games]]
[[Category:Board games]]
 
[[Category:Games]]
 
 
[[Category:Chess]]
 
[[Category:Chess]]
 
[[Category:Calvin and Hobbes]]
 
[[Category:Calvin and Hobbes]]
 
[[Category:Artificial Intelligence]]
 
[[Category:Artificial Intelligence]]

Please note that all contributions to explain xkcd may be edited, altered, or removed by other contributors. If you do not want your writing to be edited mercilessly, then do not submit it here.
You are also promising us that you wrote this yourself, or copied it from a public domain or similar free resource (see explain xkcd:Copyrights for details). Do not submit copyrighted work without permission!

To protect the wiki against automated edit spam, we kindly ask you to solve the following CAPTCHA:

Cancel | Editing help (opens in new window)