{"id":13080,"date":"2024-11-25T10:00:00","date_gmt":"2024-11-25T10:00:00","guid":{"rendered":"https:\/\/modernsciences.org\/staging\/4414\/?p=13080"},"modified":"2024-11-13T07:12:36","modified_gmt":"2024-11-13T07:12:36","slug":"could-we-ever-decipher-an-alien-language-uncovering-how-ai-communicates-may-be-the-key","status":"publish","type":"post","link":"https:\/\/modernsciences.org\/staging\/4414\/could-we-ever-decipher-an-alien-language-uncovering-how-ai-communicates-may-be-the-key\/","title":{"rendered":"Could we ever decipher an alien language? Uncovering how AI communicates may be the\u00a0key"},"content":{"rendered":"\n<div class=\"theconversation-article-body\">\n    <figure>\n      <img  decoding=\"async\"  src=\"data:image\/png;base64,iVBORw0KGgoAAAANSUhEUgAAAAEAAAABAQMAAAAl21bKAAAAA1BMVEUAAP+KeNJXAAAAAXRSTlMAQObYZgAAAAlwSFlzAAAOxAAADsQBlSsOGwAAAApJREFUCNdjYAAAAAIAAeIhvDMAAAAASUVORK5CYII=\"  class=\" pk-lazyload\"  data-pk-sizes=\"auto\"  data-pk-src=\"https:\/\/images.theconversation.com\/files\/630304\/original\/file-20241106-19-65h2b9.jpg?ixlib=rb-4.1.0&#038;rect=8%2C44%2C5982%2C2946&#038;q=45&#038;auto=format&#038;w=754&#038;fit=clip\" >\n        <figcaption>\n          \n          <span class=\"attribution\"><a class=\"source\" href=\"https:\/\/www.shutterstock.com\/image-illustration\/computer-generated-green-alien-hieroglyphs-symbols-2094917944\" target=\"_blank\" rel=\"noopener\">AlexDreamliner\/Shutterstock<\/a><\/span>\n        <\/figcaption>\n    <\/figure>\n\n  <span><a href=\"https:\/\/theconversation.com\/profiles\/olaf-lipinski-2225352\" target=\"_blank\" rel=\"noopener\">Olaf Lipinski<\/a>, <em><a href=\"https:\/\/theconversation.com\/institutions\/university-of-southampton-1093\" target=\"_blank\" rel=\"noopener\">University of Southampton<\/a><\/em><\/span>\n\n  <p>In the 2016 science fiction movie Arrival, a linguist is faced with the daunting task of deciphering an alien language consisting of palindromic phrases, which read the same backwards as they do forwards, written with circular symbols. As she discovers various clues, different nations around the world interpret the messages differently \u2013 with some assuming they convey a threat.<\/p>\n\n<p>If humanity ended up in such a situation today, our best bet may be to turn to research uncovering how artificial intelligence (AI) develops languages.<\/p>\n\n<p>But what exactly defines a language? Most of us use at least one to communicate with people around us, but how did it come about? Linguists have been pondering <a href=\"https:\/\/www.pnas.org\/doi\/abs\/10.1073\/pnas.96.14.8028\" target=\"_blank\" rel=\"noopener\">this very question for decades<\/a>, yet there is no easy way <a href=\"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpsyg.2014.00401\" target=\"_blank\" rel=\"noopener\">to find out how language evolved<\/a>. <\/p>\n\n<p>Language is ephemeral, it leaves no examinable trace in the fossil records. Unlike bones, we can\u2019t dig up ancient languages to study how they developed over time.<\/p>\n\n<p>While we may be unable to study the true evolution of human language, perhaps a simulation could provide some insights. That\u2019s where AI comes in \u2013 a fascinating field of research called <a href=\"https:\/\/arxiv.org\/abs\/2403.11958\" target=\"_blank\" rel=\"noopener\">emergent communication<\/a>, which I have spent the last three years studying. <\/p>\n\n<p>To simulate how language may evolve, we give agents (AIs) simple tasks that require communication, like a game where one robot must guide another to a specific location on a grid without showing it a map. We provide (almost) no restrictions on what they can say or how \u2013 we simply give them the task and let them solve it however they want. <\/p>\n\n<p>Because solving these tasks requires the agents to communicate with each other, we can study how their communication evolves over time to get an idea of how language might evolve.<\/p>\n\n<p>Similar <a href=\"https:\/\/pubmed.ncbi.nlm.nih.gov\/18667697\/\" target=\"_blank\" rel=\"noopener\">experiments have been done with humans<\/a>. Imagine you, an English speaker, are paired with a non-English speaker. Your task is to instruct your partner to pick up a green cube from an assortment of objects on a table. <\/p>\n\n<p>You might try to gesture a cube shape with your hands and point at grass outside the window to indicate the colour green. Over time you\u2019d develop a sort of proto-language together. Maybe you\u2019d create specific gestures or symbols for \u201ccube\u201d and \u201cgreen\u201d. Through repeated interactions, these improvised signals would become more refined and consistent, forming a basic communication system.<\/p>\n\n<p>This works similarly for AI. Through <a href=\"https:\/\/mitpress.mit.edu\/9780262039246\/reinforcement-learning\/\" target=\"_blank\" rel=\"noopener\">trial and error, they learn<\/a> to communicate about objects they see, and their conversation partners learn to understand them. <\/p>\n\n<p>But how do we know what they\u2019re talking about? If they only develop this language with their artificial conversation partner and not with us, how do we know what each word means? After all, a specific word could mean \u201cgreen\u201d, \u201ccube\u201d, or worse \u2013 both. This challenge of interpretation is a key part of my research.<\/p>\n\n<h2 id=\"cracking-the-code\">Cracking the code<\/h2>\n\n<p>The task of understanding AI language may seem almost impossible at first. If I tried speaking Polish (my mother tongue) to a collaborator who only speaks English, we couldn\u2019t understand each other or even know where each word begins and ends. <\/p>\n\n<p>The challenge with AI languages is even greater, as they might organise information in ways completely foreign to human linguistic patterns.<\/p>\n\n<p>Fortunately, linguists have developed <a href=\"https:\/\/openreview.net\/forum?id=b4t9_XASt6G\" target=\"_blank\" rel=\"noopener\">sophisticated<\/a> <a href=\"https:\/\/openreview.net\/forum?id=Sbgb7b0Q-5\" target=\"_blank\" rel=\"noopener\">tools<\/a> using information theory to interpret unknown languages. <\/p>\n\n<p>Just as archaeologists piece together ancient languages from fragments, we use patterns in AI conversations to understand their linguistic structure. Sometimes we find <a href=\"https:\/\/www.pnas.org\/doi\/10.1073\/pnas.2016569118\" target=\"_blank\" rel=\"noopener\">surprising similarities<\/a> to human languages, and other times we discover <a href=\"https:\/\/openreview.net\/forum?id=B4xM-Qb0mbq\" target=\"_blank\" rel=\"noopener\">entirely novel ways of communication<\/a>. <\/p>\n\n\n\n<p>These tools help us peek into the \u201cblack box\u201d of AI communication, revealing how artificial agents develop their own unique ways of sharing information.<\/p>\n\n<p>My recent work focuses on using what the agents see and say to interpret their language. Imagine having a transcript of a conversation in a language unknown to you, along with what each speaker was looking at. We can match patterns in the transcript to objects in the participant\u2019s field of vision, building statistical connections between words and objects.<\/p>\n\n<p>For example, perhaps the phrase \u201cyayo\u201d coincides with a bird flying past \u2013 we could guess that \u201cyayo\u201d is the speaker\u2019s word for \u201cbird\u201d. Through careful analysis of these patterns, we can begin to decode the meaning behind the communication. <\/p>\n\n<p>In <a href=\"https:\/\/arxiv.org\/abs\/2406.07277\" target=\"_blank\" rel=\"noopener\">the latest paper<\/a> by me and my colleagues, to appear in the conference proceedings of Neural Information Processing Systems (NeurIPS), we show that such methods can be used to reverse-engineer at least parts of the AIs\u2019 language and syntax, giving us insights into how they might structure communication.<\/p>\n\n<h2 id=\"aliens-and-autonomous-systems\">Aliens and autonomous systems<\/h2>\n\n<p>How does this connect to aliens? The methods we\u2019re developing for understanding AI languages could help us decipher any future alien communications. <\/p>\n\n<p>If we are able to obtain some written alien text together with some context (such as visual information relating to the text), we could <a href=\"https:\/\/www.semanticscholar.org\/paper\/Normalized-(pointwise)-mutual-information-in-Bouma\/15218d9c029cbb903ae7c729b2c644c24994c201\" target=\"_blank\" rel=\"noopener\">apply the same statistical tools<\/a> to analyse them. The approaches we\u2019re developing today could be useful tools in the future study of alien languages, known as xenolinguistics.<\/p>\n\n<p>But we don\u2019t need to find extraterrestrials to benefit from this research. There are <a href=\"https:\/\/openreview.net\/forum?id=jesKcQxQ7j\" target=\"_blank\" rel=\"noopener\">numerous applications<\/a>, from <a href=\"https:\/\/openreview.net\/forum?id=SUqrM7WR7W5\" target=\"_blank\" rel=\"noopener\">improving language models<\/a> like ChatGPT or Claude to improving communication between autonomous vehicles or <a href=\"https:\/\/ieeexplore.ieee.org\/document\/10266608\" target=\"_blank\" rel=\"noopener\">drones<\/a>. <\/p>\n\n<p>By decoding emergent languages, we can make future technology easier to understand. Whether it\u2019s knowing how self-driving cars coordinate their movements or how AI systems make decisions, we\u2019re not just creating intelligent systems \u2013 we\u2019re learning to understand them.<!-- Below is The Conversation's page counter tag. Please DO NOT REMOVE. --><img  loading=\"lazy\"  decoding=\"async\"  src=\"data:image\/png;base64,iVBORw0KGgoAAAANSUhEUgAAAAEAAAABAQMAAAAl21bKAAAAA1BMVEUAAP+KeNJXAAAAAXRSTlMAQObYZgAAAAlwSFlzAAAOxAAADsQBlSsOGwAAAApJREFUCNdjYAAAAAIAAeIhvDMAAAAASUVORK5CYII=\"  alt=\"The Conversation\"  width=\"1\"  height=\"1\"  style=\"border: none !important; box-shadow: none !important; margin: 0 !important; max-height: 1px !important; max-width: 1px !important; min-height: 1px !important; min-width: 1px !important; opacity: 0 !important; outline: none !important; padding: 0 !important\"  referrerpolicy=\"no-referrer-when-downgrade\"  class=\" pk-lazyload\"  data-pk-sizes=\"auto\"  data-pk-src=\"https:\/\/counter.theconversation.com\/content\/242618\/count.gif?distributor=republish-lightbox-basic\" ><!-- End of code. If you don't see any code above, please get new code from the Advanced tab after you click the republish button. The page counter does not collect any personal data. More info: https:\/\/theconversation.com\/republishing-guidelines --><\/p>\n\n  <p><span><a href=\"https:\/\/theconversation.com\/profiles\/olaf-lipinski-2225352\" target=\"_blank\" rel=\"noopener\">Olaf Lipinski<\/a>, PhD Student in Artificial Intelligence, <em><a href=\"https:\/\/theconversation.com\/institutions\/university-of-southampton-1093\" target=\"_blank\" rel=\"noopener\">University of Southampton<\/a><\/em><\/span><\/p>\n\n  <p>This article is republished from <a href=\"https:\/\/theconversation.com\" target=\"_blank\" rel=\"noopener\">The Conversation<\/a> under a Creative Commons license. Read the <a href=\"https:\/\/theconversation.com\/could-we-ever-decipher-an-alien-language-uncovering-how-ai-communicates-may-be-the-key-242618\" target=\"_blank\" rel=\"noopener\">original article<\/a>.<\/p>\n<\/div>\n\n","protected":false},"excerpt":{"rendered":"AlexDreamliner\/Shutterstock Olaf Lipinski, University of Southampton In the 2016 science fiction movie Arrival, a linguist is faced with&hellip;\n","protected":false},"author":1003,"featured_media":13085,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"nf_dc_page":"","fifu_image_url":"https:\/\/upload.wikimedia.org\/wikipedia\/commons\/c\/c1\/Icon_of_AlienVibes.png","fifu_image_alt":"","footnotes":""},"categories":[16],"tags":[1959,334,1097,1960,1961,474],"class_list":{"0":"post-13080","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-tech","8":"tag-aliens","9":"tag-artificial-intelligence","10":"tag-language","11":"tag-language-processing","12":"tag-symbols","13":"tag-the-conversation","14":"cs-entry","15":"cs-video-wrap"},"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/modernsciences.org\/staging\/4414\/wp-json\/wp\/v2\/posts\/13080","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/modernsciences.org\/staging\/4414\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/modernsciences.org\/staging\/4414\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/modernsciences.org\/staging\/4414\/wp-json\/wp\/v2\/users\/1003"}],"replies":[{"embeddable":true,"href":"https:\/\/modernsciences.org\/staging\/4414\/wp-json\/wp\/v2\/comments?post=13080"}],"version-history":[{"count":1,"href":"https:\/\/modernsciences.org\/staging\/4414\/wp-json\/wp\/v2\/posts\/13080\/revisions"}],"predecessor-version":[{"id":13081,"href":"https:\/\/modernsciences.org\/staging\/4414\/wp-json\/wp\/v2\/posts\/13080\/revisions\/13081"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/modernsciences.org\/staging\/4414\/wp-json\/wp\/v2\/media\/13085"}],"wp:attachment":[{"href":"https:\/\/modernsciences.org\/staging\/4414\/wp-json\/wp\/v2\/media?parent=13080"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/modernsciences.org\/staging\/4414\/wp-json\/wp\/v2\/categories?post=13080"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/modernsciences.org\/staging\/4414\/wp-json\/wp\/v2\/tags?post=13080"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}