{"id":5204,"date":"2022-12-07T10:00:00","date_gmt":"2022-12-07T10:00:00","guid":{"rendered":"https:\/\/modernsciences.org\/staging\/4414\/?p=5204"},"modified":"2022-11-25T06:35:03","modified_gmt":"2022-11-25T06:35:03","slug":"an-ai-named-cicero-can-beat-humans-in-diplomacy-a-complex-alliance-building-game-heres-why-thats-a-big-deal","status":"publish","type":"post","link":"https:\/\/modernsciences.org\/staging\/4414\/an-ai-named-cicero-can-beat-humans-in-diplomacy-a-complex-alliance-building-game-heres-why-thats-a-big-deal\/","title":{"rendered":"An AI named Cicero can beat humans in Diplomacy, a complex alliance-building game. Here\u2019s why that\u2019s a big deal"},"content":{"rendered":"\n  <figure>\n    <img  decoding=\"async\"  src=\"data:image\/png;base64,iVBORw0KGgoAAAANSUhEUgAAAAEAAAABAQMAAAAl21bKAAAAA1BMVEUAAP+KeNJXAAAAAXRSTlMAQObYZgAAAAlwSFlzAAAOxAAADsQBlSsOGwAAAApJREFUCNdjYAAAAAIAAeIhvDMAAAAASUVORK5CYII=\"  class=\" pk-lazyload\"  data-pk-sizes=\"auto\"  data-pk-src=\"https:\/\/images.theconversation.com\/files\/497134\/original\/file-20221123-12-zkmjtk.jpeg?ixlib=rb-1.1.0&#038;rect=10%2C10%2C6699%2C4456&#038;q=45&#038;auto=format&#038;w=754&#038;fit=clip\" >\n      <figcaption>\n        \n        <span class=\"attribution\"><span class=\"source\">Shutterstock<\/span><\/span>\n      <\/figcaption>\n  <\/figure>\n\n<span><a href=\"https:\/\/theconversation.com\/profiles\/toby-walsh-51\" target=\"_blank\" rel=\"noopener\">Toby Walsh<\/a>, <em><a href=\"https:\/\/theconversation.com\/institutions\/unsw-sydney-1414\" target=\"_blank\" rel=\"noopener\">UNSW Sydney<\/a><\/em><\/span>\n\n<p>In a rare piece of good news from Meta, artificial intelligence researchers at the company have just announced <a href=\"https:\/\/www.science.org\/doi\/10.1126\/science.ade9097\" target=\"_blank\" rel=\"noopener\">a scientific breakthrough<\/a>. Their AI program named Cicero can now play the board game Diplomacy at a human level. <\/p>\n\n<p>Now, before you get too excited, Cicero isn\u2019t playing at superhuman level. It was beaten by around 10% of the humans it played against. By comparison, in previous AI milestones, like AI beating humans in chess or Go, humans have long been completely surpassed. <\/p>\n\n<p>DeepMind\u2019s Go-playing AI is, for example, a \u201cGo god\u201d \u2013 according to the Chinese grandmaster Ke Jie. Even the human Go world champion would now lose 100-0 to the computer. <\/p>\n\n<p>Diplomacy is a simplified and abstract game, involving rival armies and navies invading, or not invading, each others\u2019 territories. It\u2019s fair to say it lacks the complexity and subtlety of the sort of diplomacy undertaken in the corridors of the United Nations.<\/p>\n\n<p>Nevertheless, the news of Cicero\u2019s performance was one in the eye for tech rivals such as Google, who owns DeepMind. The CEO and founder of DeepMind, Demis Hassabis, is a Diplomacy expert. He won the World Team Championship in 2004, and was 4th in the world in the 2006 World Championship. <\/p>\n\n<p>I expect Hassabis would be able to beat Cicero easily because of some of the limitations I will point out shortly. <\/p>\n\n<h2 id=\"the-game-of-diplomacy\">The game of Diplomacy<\/h2>\n\n<p>Diplomacy is what AI researchers call a \u201cseven player, zero sum and deterministic game of imperfect information\u201d. A seven player game is much harder to solve than a two player game such as chess or Go. You must consider the many possible strategies of not one but six other players. This makes it much harder to write an AI to play the game. <\/p>\n\n<p>Diplomacy is also a game of imperfect information, because players make moves simultaneously. Unlike games such as chess or Go, where you know everything about your opponent\u2019s moves, players in Diplomacy make moves not knowing what their opponents are about to do. They must therefore predict their opponents\u2019 next actions. This also adds to the challenge of writing an AI to play it.<\/p>\n\n<figure class=\"align-center zoomable\">\n            <a href=\"https:\/\/images.theconversation.com\/files\/497135\/original\/file-20221124-18-xi02zl.png?ixlib=rb-1.1.0&amp;q=45&amp;auto=format&amp;w=1000&amp;fit=clip\" target=\"_blank\" rel=\"noopener\"><img  decoding=\"async\"  alt=\"\"  src=\"data:image\/png;base64,iVBORw0KGgoAAAANSUhEUgAAAAEAAAABAQMAAAAl21bKAAAAA1BMVEUAAP+KeNJXAAAAAXRSTlMAQObYZgAAAAlwSFlzAAAOxAAADsQBlSsOGwAAAApJREFUCNdjYAAAAAIAAeIhvDMAAAAASUVORK5CYII=\"  class=\" pk-lazyload\"  data-pk-sizes=\"auto\"  data-ls-sizes=\"(min-width: 1466px) 754px, (max-width: 599px) 100vw, (min-width: 600px) 600px, 237px\"  data-pk-src=\"https:\/\/images.theconversation.com\/files\/497135\/original\/file-20221124-18-xi02zl.png?ixlib=rb-1.1.0&amp;q=45&amp;auto=format&amp;w=754&amp;fit=clip\"  data-pk-srcset=\"https:\/\/images.theconversation.com\/files\/497135\/original\/file-20221124-18-xi02zl.png?ixlib=rb-1.1.0&amp;q=45&amp;auto=format&amp;w=600&amp;h=551&amp;fit=crop&amp;dpr=1 600w, https:\/\/images.theconversation.com\/files\/497135\/original\/file-20221124-18-xi02zl.png?ixlib=rb-1.1.0&amp;q=30&amp;auto=format&amp;w=600&amp;h=551&amp;fit=crop&amp;dpr=2 1200w, https:\/\/images.theconversation.com\/files\/497135\/original\/file-20221124-18-xi02zl.png?ixlib=rb-1.1.0&amp;q=15&amp;auto=format&amp;w=600&amp;h=551&amp;fit=crop&amp;dpr=3 1800w, https:\/\/images.theconversation.com\/files\/497135\/original\/file-20221124-18-xi02zl.png?ixlib=rb-1.1.0&amp;q=45&amp;auto=format&amp;w=754&amp;h=692&amp;fit=crop&amp;dpr=1 754w, https:\/\/images.theconversation.com\/files\/497135\/original\/file-20221124-18-xi02zl.png?ixlib=rb-1.1.0&amp;q=30&amp;auto=format&amp;w=754&amp;h=692&amp;fit=crop&amp;dpr=2 1508w, https:\/\/images.theconversation.com\/files\/497135\/original\/file-20221124-18-xi02zl.png?ixlib=rb-1.1.0&amp;q=15&amp;auto=format&amp;w=754&amp;h=692&amp;fit=crop&amp;dpr=3 2262w\" ><\/a>\n            <figcaption>\n              <span class=\"caption\">This digital Diplomacy board shows the different land and sea territories players must traverse.<\/span>\n              <span class=\"attribution\"><span class=\"source\">Wikimedia<\/span><\/span>\n            <\/figcaption>\n          <\/figure>\n\n<p>Finally, Diplomacy is a zero sum game in which if you win, I lose. And the outcome is deterministic and not dependent on chance. Nonetheless, before victory or defeat, it still pays for players to form alliances and team up on each other. Indeed, one of the real challenges in playing the game is managing the informal negotiations with other players before making simultaneous moves. <\/p>\n\n<p>The main reason Cicero\u2019s performance is a scientific breakthrough is that it can both play the game well, and also perform these informal negotiations. This combination of natural language processing and strategic reasoning is a first for any game-playing AI.<\/p>\n\n<h2 id=\"beating-cicero\">Beating Cicero<\/h2>\n\n<p>A close reading of the <a href=\"https:\/\/www.science.org\/doi\/10.1126\/science.ade9097\" target=\"_blank\" rel=\"noopener\">paper Meta published<\/a> about Cicero in the prestigious journal Science offers a couple of clues about how you can beat it.<\/p>\n\n<p>First, Cicero is almost entirely honest (unlike the <a href=\"https:\/\/education.nationalgeographic.org\/resource\/cicero\" target=\"_blank\" rel=\"noopener\">famous Roman<\/a> it\u2019s named after). On the other hand, Diplomacy is a game of betrayal and dishonesty. Players offer to form alliances but often instantly renege on these deals. Cicero does not. It always plays straight. <\/p>\n\n<p>Honesty is a surprisingly effective strategy in Diplomacy \u2013 but not if your opponents know you will never betray them. This is the catch. Cicero played anonymously, so its human opponents probably wouldn\u2019t have worked this out. But if you know this fact, it will be easy to take advantage.<\/p>\n\n<p>Second, Cicero (this time like his namesake) is very talkative. Expert players of Diplomacy exchange twice the number of messages with other players than non-experts. The trick is to form alliances, and reassure your opponents of your intent. Cicero also exchanges twice the number messages of the human players it tends to beat. <\/p>\n\n<p>Of course, being a bot, it is much easier for Cicero to handle six simultaneous conversations. And this, I would say, is an unfair advantage of being a computer in this scenario.<\/p>\n\n<h2 id=\"what-next\">What next?<\/h2>\n\n<p>It\u2019s not clear how Meta intends to build on this research. A computer that can reason about the beliefs, goals, and intentions of others, as well as persuade and build relationships through dialogue, is a powerful tool. It\u2019s one that could be easily misused. Let\u2019s not forget how several years ago Facebook (which is owned by Meta) came in for a lot of justified criticism for an experiment to <a href=\"https:\/\/www.theatlantic.com\/technology\/archive\/2014\/06\/everything-we-know-about-facebooks-secret-mood-manipulation-experiment\/373648\/\" target=\"_blank\" rel=\"noopener\">manipulate users\u2019 emotions<\/a>.<\/p>\n\n<p>Yet it\u2019s hard to say exactly what the real-world applications of Cicero might be. After all, diplomacy in the real world is neither zero sum nor deterministic. Two countries can both agree not to go to war, and both will win. <\/p>\n\n<p>Then there are multitudes of random factors that can change an outcome. The Spanish Armada, for example, lost more ships to unexpected summer storms than to enemy fire. <\/p>\n\n<p>Whatever Meta\u2019s intent, the breakthrough is another example of how large tech companies are taking over the AI race with billion dollar investments that can\u2019t be matched by the public sector. Cicero was produced by a team of more than 25 researchers. Nobody working in a university has these sorts of resources to throw at solving a board game. <\/p>\n\n<p>As an AI researcher at one of those universities, I am conflicted. I\u2019m reminded of a famous graffito at Pompeii <a href=\"http:\/\/www.3pp.website\/2011\/05\/from-pompeii-to-cyberspace-transcending.html\" target=\"_blank\" rel=\"noopener\">which said<\/a><\/p>\n\n<blockquote>\n<p>Suti Ciciiro vapla bis<\/p>\n<\/blockquote>\n\n<p>\u201cYou will like Cicero, or you will be whipped\u201d. <!-- Below is The Conversation's page counter tag. Please DO NOT REMOVE. --><img  loading=\"lazy\"  decoding=\"async\"  src=\"data:image\/png;base64,iVBORw0KGgoAAAANSUhEUgAAAAEAAAABAQMAAAAl21bKAAAAA1BMVEUAAP+KeNJXAAAAAXRSTlMAQObYZgAAAAlwSFlzAAAOxAAADsQBlSsOGwAAAApJREFUCNdjYAAAAAIAAeIhvDMAAAAASUVORK5CYII=\"  alt=\"The Conversation\"  width=\"1\"  height=\"1\"  style=\"border: none !important; box-shadow: none !important; margin: 0 !important; max-height: 1px !important; max-width: 1px !important; min-height: 1px !important; min-width: 1px !important; opacity: 0 !important; outline: none !important; padding: 0 !important\"  referrerpolicy=\"no-referrer-when-downgrade\"  class=\" pk-lazyload\"  data-pk-sizes=\"auto\"  data-pk-src=\"https:\/\/counter.theconversation.com\/content\/195208\/count.gif?distributor=republish-lightbox-basic\" ><!-- End of code. If you don't see any code above, please get new code from the Advanced tab after you click the republish button. The page counter does not collect any personal data. More info: https:\/\/theconversation.com\/republishing-guidelines --><\/p>\n\n\n\n<p><span><a href=\"https:\/\/theconversation.com\/profiles\/toby-walsh-51\" target=\"_blank\" rel=\"noopener\">Toby Walsh<\/a>, Professor of AI at UNSW, Research Group Leader, <em><a href=\"https:\/\/theconversation.com\/institutions\/unsw-sydney-1414\" target=\"_blank\" rel=\"noopener\">UNSW Sydney<\/a><\/em><\/span><\/p>\n\n<p>This article is republished from <a href=\"https:\/\/theconversation.com\" target=\"_blank\" rel=\"noopener\">The Conversation<\/a> under a Creative Commons license. Read the <a href=\"https:\/\/theconversation.com\/an-ai-named-cicero-can-beat-humans-in-diplomacy-a-complex-alliance-building-game-heres-why-thats-a-big-deal-195208\" target=\"_blank\" rel=\"noopener\">original article<\/a>.<\/p>\n\n","protected":false},"excerpt":{"rendered":"Shutterstock Toby Walsh, UNSW Sydney In a rare piece of good news from Meta, artificial intelligence researchers at&hellip;\n","protected":false},"author":290,"featured_media":5188,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"nf_dc_page":"","fifu_image_url":"","fifu_image_alt":"","footnotes":""},"categories":[17,16],"tags":[334,650,129,474],"class_list":{"0":"post-5204","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-math-and-the-sciences","8":"category-tech","9":"tag-artificial-intelligence","10":"tag-cicero","11":"tag-mathematics","12":"tag-the-conversation","13":"cs-entry","14":"cs-video-wrap"},"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/modernsciences.org\/staging\/4414\/wp-json\/wp\/v2\/posts\/5204","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/modernsciences.org\/staging\/4414\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/modernsciences.org\/staging\/4414\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/modernsciences.org\/staging\/4414\/wp-json\/wp\/v2\/users\/290"}],"replies":[{"embeddable":true,"href":"https:\/\/modernsciences.org\/staging\/4414\/wp-json\/wp\/v2\/comments?post=5204"}],"version-history":[{"count":1,"href":"https:\/\/modernsciences.org\/staging\/4414\/wp-json\/wp\/v2\/posts\/5204\/revisions"}],"predecessor-version":[{"id":5205,"href":"https:\/\/modernsciences.org\/staging\/4414\/wp-json\/wp\/v2\/posts\/5204\/revisions\/5205"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/modernsciences.org\/staging\/4414\/wp-json\/wp\/v2\/media\/5188"}],"wp:attachment":[{"href":"https:\/\/modernsciences.org\/staging\/4414\/wp-json\/wp\/v2\/media?parent=5204"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/modernsciences.org\/staging\/4414\/wp-json\/wp\/v2\/categories?post=5204"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/modernsciences.org\/staging\/4414\/wp-json\/wp\/v2\/tags?post=5204"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}