{"id":13219,"date":"2024-12-12T22:00:00","date_gmt":"2024-12-12T22:00:00","guid":{"rendered":"https:\/\/modernsciences.org\/staging\/4414\/?p=13219"},"modified":"2024-11-29T07:52:13","modified_gmt":"2024-11-29T07:52:13","slug":"japanese-ai-pioneers-history-shuninchi-amari-kunihiko-fukushima-december-2024","status":"publish","type":"post","link":"https:\/\/modernsciences.org\/staging\/4414\/japanese-ai-pioneers-history-shuninchi-amari-kunihiko-fukushima-december-2024\/","title":{"rendered":"Japanese scientists were pioneers of AI, yet they\u2019re being written out of its history"},"content":{"rendered":"\n<div class=\"theconversation-article-body\">\n\n  <span><a href=\"https:\/\/theconversation.com\/profiles\/hansun-hsiung-1274687\" target=\"_blank\" rel=\"noopener\">Hansun Hsiung<\/a>, <em><a href=\"https:\/\/theconversation.com\/institutions\/durham-university-867\" target=\"_blank\" rel=\"noopener\">Durham University<\/a><\/em><\/span>\n\n  <p>The announcement of the artificial intelligence researchers <a href=\"https:\/\/www.nobelprize.org\/prizes\/physics\/2024\/press-release\/\" target=\"_blank\" rel=\"noopener\">John Hopfield and Geoffrey Hinton<\/a> as this year\u2019s Nobel laureates in physics spurred celebration and <a href=\"https:\/\/www.nature.com\/articles\/d41586-024-03310-8\" target=\"_blank\" rel=\"noopener\">consternation<\/a> over the status of AI in science and society. In Japan, however, another feeling dominates: <a href=\"https:\/\/www.nikkei.com\/article\/DGXZQOSG08BMX0Y4A001C2000000\/\" target=\"_blank\" rel=\"noopener\">frustration<\/a>. <\/p>\n\n<p>\u201cJapanese researchers should also have won,\u201d an editorial in the <a href=\"https:\/\/www.asahi.com\/articles\/DA3S16079769.html\" target=\"_blank\" rel=\"noopener\">Asahi Shimbun newspaper<\/a> proclaimed. <a href=\"https:\/\/jnns.org\/2024\/10\/22\/%E4%BC%9A%E9%95%B7%E3%83%A1%E3%83%83%E3%82%BB%E3%83%BC%E3%82%B8%E3%80%8C%E3%83%8E%E3%83%BC%E3%83%99%E3%83%AB%E8%B3%9E%E3%81%AB%E7%B9%8B%E3%81%8C%E3%82%8B%E7%A5%9E%E7%B5%8C%E5%9B%9E%E8%B7%AF%E7%A0%94\/\" target=\"_blank\" rel=\"noopener\">Congratulating Hopfield and Hinton<\/a>, the Japanese Neural Network Society added pointedly: \u201cWe must not forget the role played by pioneer Japanese researchers in erecting the foundations of neural network research.\u201d <\/p>\n\n<p>Neural networks are at the centre of contemporary AI. They are models for machines to learn independently through structures that, if often only loosely, are inspired by the human brain. <\/p>\n\n<p>So who are these pioneering Japanese AI researchers?<\/p>\n\n<p>In 1967, Shun\u2019ichi Amari proposed a method of <a href=\"https:\/\/ieeexplore.ieee.org\/document\/4039068\" target=\"_blank\" rel=\"noopener\">adaptive pattern classification<\/a>, which enables neural networks to self-adjust the way they categorise patterns, through exposure to repeated training examples. Amari\u2019s research anticipated a similar method known as \u201cbackpropagation,\u201d one of <a href=\"https:\/\/www.nature.com\/articles\/323533a0\" target=\"_blank\" rel=\"noopener\">Hinton\u2019s key contributions<\/a> to the field.<\/p>\n\n<p>In 1972, Amari outlined a <a href=\"https:\/\/ieeexplore.ieee.org\/document\/1672070\" target=\"_blank\" rel=\"noopener\">learning algorithm<\/a> (a set of rules for carrying out a particular task) that was mathematically equivalent to Hopfield\u2019s <a href=\"https:\/\/www.pnas.org\/doi\/10.1073\/pnas.79.8.2554\" target=\"_blank\" rel=\"noopener\">1982 paper<\/a> cited <a href=\"https:\/\/www.nobelprize.org\/uploads\/2024\/11\/popular-physicsprize2024-3.pdf\" target=\"_blank\" rel=\"noopener\">by the Nobel<\/a> on associative memory, which allowed neural networks to recognise patterns despite partial or corrupted inputs. <\/p>\n\n<p>The North American researchers were working separately to groups in Japan, coming to their conclusions independently.<\/p>\n\n<p>Later, in 1979, Kunihiko Fukushima created the world\u2019s first <a href=\"https:\/\/link.springer.com\/article\/10.1007\/BF00344251\" target=\"_blank\" rel=\"noopener\">multilayer convolutional neural network<\/a>. This technology has been the backbone of the recent boom in deep learning, an AI approach which has given rise to neural networks that learn without supervision, through more complex architectures. If this year\u2019s Nobel was for \u201cfoundational discoveries and inventions that enable machine learning with artificial neural networks,\u201d why not award Amari and Fukushima?<\/p>\n\n<h2 id=\"one-sided-perspectives\">One-sided perspectives<\/h2>\n\n<p>The AI community itself has been debating this question. There are cogent arguments as to why Hopfield and Hinton better fit the Nobel \u201cphysics\u201d category, and why national balance mattered, given the peace prize went to Japan\u2019s Nihon Hidanky\u014d. <\/p>\n\n<p>Why, then, should we still be worried?<\/p>\n\n<p>The answer lies in the risks of historical one-sidededness. Our standard account of artificial neural networks is a North Atlantic-based \u2013 and, overwhelmingly, North American \u2013 history. AI experienced a period of rapid development in the 1950s and 1960s. <\/p>\n\n<figure>\n            <iframe loading=\"lazy\" width=\"440\" height=\"260\" src=\"https:\/\/www.youtube.com\/embed\/KAazjZoiCd0?wmode=transparent&amp;start=4\" frameborder=\"0\" allowfullscreen=\"\"><\/iframe>\n            <figcaption><span class=\"caption\">A NHK-produced short film from 1986 on the Neocognitron. Courtesy of Fukushima Kunihiko.<\/span><\/figcaption>\n          <\/figure>\n\n<p>By 1970, it entered an \u201cAI Winter\u201d, during which research stagnated. Winter finally changed to spring in the 1980s, through the likes of Hopfield and Hinton. The latter researcher\u2019s links to Google and OpenAI are said to have fed into the current boom in AI based on neural networks. <\/p>\n\n<p>And yet, it was precisely during this alleged \u201cwinter\u201d that Finnish, Japanese, and Ukrainian researchers \u2013 among others \u2013 established the foundations of deep learning. Integrating these developments into our histories of AI is essential as society confronts this transformative technology. We must <a href=\"https:\/\/brill.com\/view\/journals\/dias\/11\/1-2\/article-p3_2.xml\" target=\"_blank\" rel=\"noopener\">expand what we mean when we talk about AI<\/a> in ways different from the current vision offered by Silicon Valley.<\/p>\n\n<p>For the past year, Yasuhiro Okazawa, from Kyoto University, Masahiro Maejima, from the National Museum of Nature and Science, Tokyo, and I have led an oral history project centered on Kunihiko Fukushima and the lab <a href=\"https:\/\/www.nhk.or.jp\/strl\/english\/\" target=\"_blank\" rel=\"noopener\">at NHK<\/a> where he developed the Neocognitron, a visual pattern recognition system that became the basis for convolutional neural networks.<\/p>\n\n\n\n<p>NHK is Japan\u2019s public broadcaster, equivalent to the BBC. Much to our surprise, we discovered that the context from which Fukushima\u2019s research emerged had roots in psychological and physiological studies of television audiences. This led NHK to create, in 1965, a laboratory for the \u201c<a href=\"https:\/\/brill.com\/view\/journals\/dias\/11\/1-2\/article-p3_2.xml\" target=\"_blank\" rel=\"noopener\">bionics of vision<\/a>\u201d. Here, television engineers could contribute towards advancing knowledge of human psychology and physiology (how living organisms function).<\/p>\n\n<p>Indeed, Fukushima saw his own work as dedicated to <a href=\"https:\/\/fi.edu\/en\/awards\/laureates\/kunihiko-fukushima\" target=\"_blank\" rel=\"noopener\">understanding biological organisms<\/a> rather than AI in the strict sense. Neural networks were conceived as \u201csimulations\u201d of how visual information processing might work in the brain, and thought to help advance <a href=\"https:\/\/ndlsearch.ndl.go.jp\/books\/R100000002-I000001127793\" target=\"_blank\" rel=\"noopener\">physiological research<\/a>. The Neocognitron specifically aimed to help settle debates about whether complex sensory stimuli corresponded to the activation of one particular neuron (nerve cell) in the brain, or to a pattern of activation distributed across a population of neurons. <\/p>\n\n<h2 id=\"human-approaches\">Human approaches<\/h2>\n\n<p>The engineer Takayuki It\u014d, who worked under Fukushima, characterised his mentor\u2019s approach as a \u201chuman science\u201d. But during the 1960s, <a href=\"https:\/\/theconversation.com\/to-understand-ais-problems-look-at-the-shortcuts-taken-to-create-it-204882\" target=\"_blank\" rel=\"noopener\">American researchers abandoned<\/a> artificial neural networks based on human models. They cared more about <a href=\"https:\/\/www.jstor.org\/stable\/26616647\" target=\"_blank\" rel=\"noopener\">applying statistical methods to large data sets<\/a>, rather than patient study of the brain\u2019s complexities. In this way, emulating human cognition became merely a casual metaphor. <\/p>\n\n<p>When Fukushima visited the US in 1968, he found few researchers who were sympathetic to his human brain-centred approach to AI, and <a href=\"https:\/\/cir.nii.ac.jp\/crid\/1520291855506214528\" target=\"_blank\" rel=\"noopener\">many mistook his work for \u201cmedical engineering.\u201d<\/a> His lack of interest in upscaling the Neocognitron with bigger data sets eventually placed him at odds with NHK\u2019s increasing demand for applied AI-based technologies, leading to his resignation in 1988. <\/p>\n\n\n\n<p>For Fukushima, developing neural networks was never about their practical use in society, for instance, in replacing human labour and for decision making. Rather, they represented an attempt to grasp what made advanced vertebrates like humans unique, and in this way make engineering more human. <\/p>\n\n<p>Indeed, as Takayuki It\u014d noted in one of our interviews, this \u201chuman science\u201d approach may lend itself to a closer embrace of diversity. Although Fukushima himself did not pursue this path, It\u014d\u2019s work since the late 1990s has focused on \u201caccessibility\u201d in relation to the cognitive traits of the elderly and <a href=\"https:\/\/cir.nii.ac.jp\/crid\/1390001205096998400?lang=en\" target=\"_blank\" rel=\"noopener\">disabled<\/a>. This work also recognises types of intelligence different from mainstream AI research.<\/p>\n\n<p>Fukushima today keeps a <a href=\"https:\/\/www.nikkei.com\/article\/DGXZQOSG08BMX0Y4A001C2000000\/\" target=\"_blank\" rel=\"noopener\">measured distance from machine learning<\/a>. \u201cMy position,\u201d he says, \u201cwas always to learn from the brain.\u201d Compared to Fukushima, AI researchers outside Japan took short cuts. The more that mainstream AI research leaves the human brain behind, the more it yields technologies that are difficult to understand and control. Shorn of its roots in biological processes, we can no longer explain why AI works and how it makes decisions. This is known as the <a href=\"https:\/\/umdearborn.edu\/news\/ais-mysterious-black-box-problem-explained\" target=\"_blank\" rel=\"noopener\">\u201cblack box\u201d problem<\/a>. <\/p>\n\n<p>Would a return to a \u201chuman science\u201d approach solve some of these problems? Probably not by itself, because the genie is out of the bottle. But amid global concerns about superintelligent AI resulting in the end of humanity, we should consider a global history replete with alternative understandings of AI. The latter is a history sadly left uncelebrated by this year\u2019s Nobel prize in physics.<!-- Below is The Conversation's page counter tag. Please DO NOT REMOVE. --><img  loading=\"lazy\"  decoding=\"async\"  src=\"data:image\/png;base64,iVBORw0KGgoAAAANSUhEUgAAAAEAAAABAQMAAAAl21bKAAAAA1BMVEUAAP+KeNJXAAAAAXRSTlMAQObYZgAAAAlwSFlzAAAOxAAADsQBlSsOGwAAAApJREFUCNdjYAAAAAIAAeIhvDMAAAAASUVORK5CYII=\"  alt=\"The Conversation\"  width=\"1\"  height=\"1\"  style=\"border: none !important; box-shadow: none !important; margin: 0 !important; max-height: 1px !important; max-width: 1px !important; min-height: 1px !important; min-width: 1px !important; opacity: 0 !important; outline: none !important; padding: 0 !important\"  referrerpolicy=\"no-referrer-when-downgrade\"  class=\" pk-lazyload\"  data-pk-sizes=\"auto\"  data-pk-src=\"https:\/\/counter.theconversation.com\/content\/243762\/count.gif?distributor=republish-lightbox-basic\" ><!-- End of code. If you don't see any code above, please get new code from the Advanced tab after you click the republish button. The page counter does not collect any personal data. More info: https:\/\/theconversation.com\/republishing-guidelines --><\/p>\n\n  <p><span><a href=\"https:\/\/theconversation.com\/profiles\/hansun-hsiung-1274687\" target=\"_blank\" rel=\"noopener\">Hansun Hsiung<\/a>, Assistant Professor, School of Modern Languages and Cultures, <em><a href=\"https:\/\/theconversation.com\/institutions\/durham-university-867\" target=\"_blank\" rel=\"noopener\">Durham University<\/a><\/em><\/span><\/p>\n\n  <p>This article is republished from <a href=\"https:\/\/theconversation.com\" target=\"_blank\" rel=\"noopener\">The Conversation<\/a> under a Creative Commons license. Read the <a href=\"https:\/\/theconversation.com\/japanese-scientists-were-pioneers-of-ai-yet-theyre-being-written-out-of-its-history-243762\" target=\"_blank\" rel=\"noopener\">original article<\/a>.<\/p>\n<\/div>\n\n","protected":false},"excerpt":{"rendered":"Hansun Hsiung, Durham University The announcement of the artificial intelligence researchers John Hopfield and Geoffrey Hinton as this&hellip;\n","protected":false},"author":1025,"featured_media":13221,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"nf_dc_page":"","fifu_image_url":"https:\/\/upload.wikimedia.org\/wikipedia\/commons\/b\/b4\/Some_old_computer_-_2_%28439313684%29.jpg","fifu_image_alt":"","footnotes":""},"categories":[18,16],"tags":[2636,2638,2637,2647,2639,2646,2643,2634,2642,2631,2645,2641,2633,2640,2632,2644,2635,2630,2648,2629,474],"class_list":{"0":"post-13219","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-history","8":"category-tech","9":"tag-ai-contributions-from-japan","10":"tag-ai-history-inclusivity","11":"tag-ai-nobel-prize-debates","12":"tag-ai-winter-contributions","13":"tag-alternative-ai-approaches","14":"tag-black-box-ai-problem","15":"tag-brain-inspired-neural-networks","16":"tag-convolutional-neural-networks-origin","17":"tag-early-ai-innovations-in-japan","18":"tag-fukushima-neural-networks","19":"tag-fukushimas-human-centered-ai","20":"tag-global-ai-history","21":"tag-history-of-artificial-intelligence","22":"tag-human-science-ai","23":"tag-japanese-ai-pioneers","24":"tag-japanese-impact-on-deep-learning","25":"tag-kunihiko-fukushima","26":"tag-neocognitron","27":"tag-rethinking-ai-origins","28":"tag-shunichi-amari","29":"tag-the-conversation","30":"cs-entry","31":"cs-video-wrap"},"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/modernsciences.org\/staging\/4414\/wp-json\/wp\/v2\/posts\/13219","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/modernsciences.org\/staging\/4414\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/modernsciences.org\/staging\/4414\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/modernsciences.org\/staging\/4414\/wp-json\/wp\/v2\/users\/1025"}],"replies":[{"embeddable":true,"href":"https:\/\/modernsciences.org\/staging\/4414\/wp-json\/wp\/v2\/comments?post=13219"}],"version-history":[{"count":1,"href":"https:\/\/modernsciences.org\/staging\/4414\/wp-json\/wp\/v2\/posts\/13219\/revisions"}],"predecessor-version":[{"id":13220,"href":"https:\/\/modernsciences.org\/staging\/4414\/wp-json\/wp\/v2\/posts\/13219\/revisions\/13220"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/modernsciences.org\/staging\/4414\/wp-json\/wp\/v2\/media\/13221"}],"wp:attachment":[{"href":"https:\/\/modernsciences.org\/staging\/4414\/wp-json\/wp\/v2\/media?parent=13219"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/modernsciences.org\/staging\/4414\/wp-json\/wp\/v2\/categories?post=13219"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/modernsciences.org\/staging\/4414\/wp-json\/wp\/v2\/tags?post=13219"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}