{"id":4324,"date":"2022-06-15T22:00:00","date_gmt":"2022-06-15T22:00:00","guid":{"rendered":"https:\/\/modernsciences.org\/staging\/4414\/?p=4324"},"modified":"2022-06-01T08:31:28","modified_gmt":"2022-06-01T08:31:28","slug":"ai-and-machine-learning-are-improving-weather-forecasts-but-they-wont-replace-human-experts","status":"publish","type":"post","link":"https:\/\/modernsciences.org\/staging\/4414\/ai-and-machine-learning-are-improving-weather-forecasts-but-they-wont-replace-human-experts\/","title":{"rendered":"AI and machine learning are improving weather forecasts, but they won\u2019t replace human experts"},"content":{"rendered":"\n  <figure>\n    <img  decoding=\"async\"  src=\"data:image\/png;base64,iVBORw0KGgoAAAANSUhEUgAAAAEAAAABAQMAAAAl21bKAAAAA1BMVEUAAP+KeNJXAAAAAXRSTlMAQObYZgAAAAlwSFlzAAAOxAAADsQBlSsOGwAAAApJREFUCNdjYAAAAAIAAeIhvDMAAAAASUVORK5CYII=\"  class=\" pk-lazyload\"  data-pk-sizes=\"auto\"  data-pk-src=\"https:\/\/images.theconversation.com\/files\/465128\/original\/file-20220524-20-scw9mi.jpg?ixlib=rb-1.1.0&#038;rect=0%2C11%2C7458%2C4953&#038;q=45&#038;auto=format&#038;w=754&#038;fit=clip\" >\n      <figcaption>\n        Meteorologist Todd Dankers monitors weather patterns in Boulder, Colorado,  Oct. 24, 2018.\n        <span class=\"attribution\"><a class=\"source\" href=\"https:\/\/www.gettyimages.com\/detail\/news-photo\/meteorologist-todd-dankers-is-monitoring-weather-patterns-news-photo\/1052979764\" target=\"_blank\" rel=\"noopener\">Hyoung Chang\/The Denver Post via Getty Images<\/a><\/span>\n      <\/figcaption>\n  <\/figure>\n\n<span><a href=\"https:\/\/theconversation.com\/profiles\/russ-schumacher-403970\" target=\"_blank\" rel=\"noopener\">Russ Schumacher<\/a>, <em><a href=\"https:\/\/theconversation.com\/institutions\/colorado-state-university-1267\" target=\"_blank\" rel=\"noopener\">Colorado State University<\/a><\/em> and <a href=\"https:\/\/theconversation.com\/profiles\/aaron-hill-1346758\" target=\"_blank\" rel=\"noopener\">Aaron Hill<\/a>, <em><a href=\"https:\/\/theconversation.com\/institutions\/colorado-state-university-1267\" target=\"_blank\" rel=\"noopener\">Colorado State University<\/a><\/em><\/span>\n\n<p>A century ago, English mathematician <a href=\"https:\/\/mathshistory.st-andrews.ac.uk\/Biographies\/Richardson\/\" target=\"_blank\" rel=\"noopener\">Lewis Fry Richardson<\/a> proposed a startling idea for that time: constructing a systematic process based on math for predicting the weather. In his 1922 book, \u201c<a href=\"https:\/\/www.emetsoc.org\/resources\/rff\/\" target=\"_blank\" rel=\"noopener\">Weather Prediction By Numerical Process<\/a>,\u201d Richardson tried to write an equation that he could use to solve the dynamics of the atmosphere based on hand calculations.<\/p>\n\n<p>It didn\u2019t work because not enough was known about the science of the atmosphere at that time. \u201cPerhaps some day in the dim future it will be possible to advance the computations faster than the weather advances and at a cost less than the saving to mankind due to the information gained. But that is a dream,\u201d Richardson concluded. <\/p>\n\n<p>A century later, modern weather forecasts are based on the kind of complex <a href=\"https:\/\/www.irishtimes.com\/news\/science\/lewis-fry-richardson-s-remarkable-weather-forecast-factory-1.2473954\" target=\"_blank\" rel=\"noopener\">computations that Richardson imagined<\/a> \u2013 and they\u2019ve become more accurate than anything he envisioned. Especially in recent decades, steady progress in research, data and computing has enabled a \u201c<a href=\"https:\/\/doi.org\/10.1038\/nature14956\" target=\"_blank\" rel=\"noopener\">quiet revolution of numerical weather prediction<\/a>.\u201d<\/p>\n\n<p>For example, a forecast of heavy rainfall two days in advance is <a href=\"https:\/\/www.wpc.ncep.noaa.gov\/html\/hpcverif.shtml#qpf\" target=\"_blank\" rel=\"noopener\">now as good<\/a> as a same-day forecast was in the mid-1990s. Errors in the predicted tracks of hurricanes have been <a href=\"https:\/\/www.nhc.noaa.gov\/verification\/verify5.shtml\" target=\"_blank\" rel=\"noopener\">cut in half<\/a> in the last 30 years. <\/p>\n\n<p>There still are major challenges. Thunderstorms that produce tornadoes, large hail or heavy rain remain difficult to predict. And then there\u2019s chaos, often described as the \u201cbutterfly effect\u201d \u2013 the fact that small changes in complex processes make weather <a href=\"https:\/\/www.discovery.com\/science\/Butterfly-Effect-Predict-the-Weather\" target=\"_blank\" rel=\"noopener\">less predictable<\/a>. Chaos limits our ability to make precise forecasts <a href=\"https:\/\/doi.org\/10.1175\/JAS-D-18-0269.1\" target=\"_blank\" rel=\"noopener\">beyond about 10 days<\/a>. <\/p>\n\n<p>As in many other scientific fields, the proliferation of tools like artificial intelligence and machine learning holds great promise for weather prediction. We have seen some of what\u2019s possible in <a href=\"https:\/\/scholar.google.com\/citations?user=vfbhQHkAAAAJ&amp;hl=en\" target=\"_blank\" rel=\"noopener\">our research<\/a> on <a href=\"https:\/\/scholar.google.com\/citations?user=xMygrTgAAAAJ&amp;hl=en\" target=\"_blank\" rel=\"noopener\">applying machine learning<\/a> to forecasts of high-impact weather. But we also believe that while these tools open up new possibilities for better forecasts, many parts of the job are handled more skillfully by experienced people. <\/p>\n\n<figure>\n            <iframe loading=\"lazy\" width=\"440\" height=\"260\" src=\"https:\/\/www.youtube.com\/embed\/9Qb2tHOz4fw?wmode=transparent&amp;start=0\" frameborder=\"0\" allowfullscreen=\"\"><\/iframe>\n            <figcaption><span class=\"caption\">Australian meteorologist Dean Narramore explains why it\u2019s hard to forecast large thunderstorms.<\/span><\/figcaption>\n          <\/figure>\n\n<h2 id=\"predictions-based-on-storm-history\">Predictions based on storm history<\/h2>\n\n<p>Today, weather forecasters\u2019 primary tools are <a href=\"https:\/\/www.ncei.noaa.gov\/products\/weather-climate-models\/numerical-weather-prediction\" target=\"_blank\" rel=\"noopener\">numerical weather prediction models<\/a>. These models use observations of the current state of the atmosphere  from sources such as weather stations, weather balloons and satellites, and solve equations that govern the motion of air. <\/p>\n\n<p>These models are outstanding at predicting most weather systems, but the smaller a weather event is, the more difficult it is to predict. As an example, think of a thunderstorm that dumps heavy rain on one side of town and nothing on the other side. Furthermore, experienced forecasters are remarkably good at synthesizing the huge amounts of weather information they have to consider each day, but their memories and bandwidth are not infinite.<\/p>\n\n<p>Artificial intelligence and machine learning can help with some of these challenges. Forecasters are using these tools in several ways now, including making predictions of high-impact weather that the models can\u2019t provide. <\/p>\n\n<p><\/p>\n\n<p>In a project that started in 2017 and was reported in a <a href=\"https:\/\/doi.org\/10.1175\/BAMS-D-20-0186.1\" target=\"_blank\" rel=\"noopener\">2021 paper<\/a>, we focused on heavy rainfall. Of course, part of the problem is defining \u201cheavy\u201d: Two inches of rain in New Orleans may mean something very different than in Phoenix. We accounted for this by using observations of unusually large rain accumulations for each location across the country, along with a history of forecasts from a numerical weather prediction model. <\/p>\n\n<p>We plugged that information into a machine learning method known as \u201c<a href=\"https:\/\/www.ibm.com\/cloud\/learn\/random-forest\" target=\"_blank\" rel=\"noopener\">random forests<\/a>,\u201d which uses many decision trees to split a mass of data and predict the likelihood of different outcomes. The result is a tool that forecasts the probability that rains heavy enough to generate flash flooding will occur. <\/p>\n\n<p>We have since applied similar methods to forecasting of tornadoes, large hail and severe thunderstorm winds. <a href=\"https:\/\/doi.org\/10.1175\/MWR-D-20-0194.1\" target=\"_blank\" rel=\"noopener\">Other<\/a> <a href=\"https:\/\/www2.mmm.ucar.edu\/projects\/ncar_ensemble\/camviewer\/\" target=\"_blank\" rel=\"noopener\">research<\/a> <a href=\"https:\/\/doi.org\/10.1175\/WAF-D-19-0258.1\" target=\"_blank\" rel=\"noopener\">groups<\/a> are developing similar tools. National Weather Service forecasters are using some of these tools to better assess the likelihood of hazardous weather on a given day.<\/p>\n\n<figure class=\"align-center zoomable\">\n            <a href=\"https:\/\/images.theconversation.com\/files\/463870\/original\/file-20220518-26-iwawkp.png?ixlib=rb-1.1.0&amp;q=45&amp;auto=format&amp;w=1000&amp;fit=clip\" target=\"_blank\" rel=\"noopener\"><img  decoding=\"async\"  alt=\"Two maps showing a machine learning forecast and actual flooding in the mid-Atlantic states after Hurricane Ida in 2021.\"  src=\"data:image\/png;base64,iVBORw0KGgoAAAANSUhEUgAAAAEAAAABAQMAAAAl21bKAAAAA1BMVEUAAP+KeNJXAAAAAXRSTlMAQObYZgAAAAlwSFlzAAAOxAAADsQBlSsOGwAAAApJREFUCNdjYAAAAAIAAeIhvDMAAAAASUVORK5CYII=\"  class=\" pk-lazyload\"  data-pk-sizes=\"auto\"  data-ls-sizes=\"(min-width: 1466px) 754px, (max-width: 599px) 100vw, (min-width: 600px) 600px, 237px\"  data-pk-src=\"https:\/\/images.theconversation.com\/files\/463870\/original\/file-20220518-26-iwawkp.png?ixlib=rb-1.1.0&amp;q=45&amp;auto=format&amp;w=754&amp;fit=clip\"  data-pk-srcset=\"https:\/\/images.theconversation.com\/files\/463870\/original\/file-20220518-26-iwawkp.png?ixlib=rb-1.1.0&amp;q=45&amp;auto=format&amp;w=600&amp;h=400&amp;fit=crop&amp;dpr=1 600w, https:\/\/images.theconversation.com\/files\/463870\/original\/file-20220518-26-iwawkp.png?ixlib=rb-1.1.0&amp;q=30&amp;auto=format&amp;w=600&amp;h=400&amp;fit=crop&amp;dpr=2 1200w, https:\/\/images.theconversation.com\/files\/463870\/original\/file-20220518-26-iwawkp.png?ixlib=rb-1.1.0&amp;q=15&amp;auto=format&amp;w=600&amp;h=400&amp;fit=crop&amp;dpr=3 1800w, https:\/\/images.theconversation.com\/files\/463870\/original\/file-20220518-26-iwawkp.png?ixlib=rb-1.1.0&amp;q=45&amp;auto=format&amp;w=754&amp;h=503&amp;fit=crop&amp;dpr=1 754w, https:\/\/images.theconversation.com\/files\/463870\/original\/file-20220518-26-iwawkp.png?ixlib=rb-1.1.0&amp;q=30&amp;auto=format&amp;w=754&amp;h=503&amp;fit=crop&amp;dpr=2 1508w, https:\/\/images.theconversation.com\/files\/463870\/original\/file-20220518-26-iwawkp.png?ixlib=rb-1.1.0&amp;q=15&amp;auto=format&amp;w=754&amp;h=503&amp;fit=crop&amp;dpr=3 2262w\" ><\/a>\n            <figcaption>\n              <span class=\"caption\">An excessive rainfall forecast from the Colorado State University-Machine Learning Probabilities system for the extreme rainfall associated with the remnants of Hurricane Ida in the mid-Atlantic states in September 2021. The left panel shows the forecast probability of excessive rainfall, available on the morning of Aug. 31, more than 24 hours ahead of the event. The right panel shows the resulting observations of excessive rainfall. The machine learning program correctly highlighted the corridor where widespread heavy rain and flooding would occur.<\/span>\n              <span class=\"attribution\"><span class=\"source\">Russ Schumacher and Aaron Hill<\/span>, <a class=\"license\" href=\"http:\/\/creativecommons.org\/licenses\/by-nd\/4.0\/\" target=\"_blank\" rel=\"noopener\">CC BY-ND<\/a><\/span>\n            <\/figcaption>\n          <\/figure>\n\n<p>Researchers also are embedding machine learning within numerical weather prediction models to speed up tasks that can be intensive to compute, such as predicting how water vapor gets converted to rain, snow or hail. <\/p>\n\n<p>It\u2019s possible that machine learning models could eventually replace traditional numerical weather prediction models altogether. Instead of solving a set of complex physical equations as the models do, these systems instead would process thousands of past weather maps to learn how weather systems tend to behave. Then, using current weather data, they would make weather predictions based on what they\u2019ve learned from the past. <\/p>\n\n<p>Some studies have shown that machine learning-based forecast systems <a href=\"https:\/\/doi.org\/10.1029\/2020MS002109\" target=\"_blank\" rel=\"noopener\">can predict general weather patterns<\/a> as well as <a href=\"https:\/\/ai.googleblog.com\/2021\/11\/metnet-2-deep-learning-for-12-hour.html\" target=\"_blank\" rel=\"noopener\">numerical weather prediction models<\/a> while using only a fraction of the computing power the models require. These new tools don\u2019t yet forecast the details of local weather that people care about, but with many researchers carefully testing them and inventing new methods, there is promise for the future. <\/p>\n\n<figure class=\"align-center zoomable\">\n            <a href=\"https:\/\/images.theconversation.com\/files\/463872\/original\/file-20220518-25-j50eqa.png?ixlib=rb-1.1.0&amp;q=45&amp;auto=format&amp;w=1000&amp;fit=clip\" target=\"_blank\" rel=\"noopener\"><img  decoding=\"async\"  alt=\"Maps of an evolving machine learning forecast for an outbreak of severe weather in the US Midwest in December 2021.\"  src=\"data:image\/png;base64,iVBORw0KGgoAAAANSUhEUgAAAAEAAAABAQMAAAAl21bKAAAAA1BMVEUAAP+KeNJXAAAAAXRSTlMAQObYZgAAAAlwSFlzAAAOxAAADsQBlSsOGwAAAApJREFUCNdjYAAAAAIAAeIhvDMAAAAASUVORK5CYII=\"  class=\" pk-lazyload\"  data-pk-sizes=\"auto\"  data-ls-sizes=\"(min-width: 1466px) 754px, (max-width: 599px) 100vw, (min-width: 600px) 600px, 237px\"  data-pk-src=\"https:\/\/images.theconversation.com\/files\/463872\/original\/file-20220518-25-j50eqa.png?ixlib=rb-1.1.0&amp;q=45&amp;auto=format&amp;w=754&amp;fit=clip\"  data-pk-srcset=\"https:\/\/images.theconversation.com\/files\/463872\/original\/file-20220518-25-j50eqa.png?ixlib=rb-1.1.0&amp;q=45&amp;auto=format&amp;w=600&amp;h=397&amp;fit=crop&amp;dpr=1 600w, https:\/\/images.theconversation.com\/files\/463872\/original\/file-20220518-25-j50eqa.png?ixlib=rb-1.1.0&amp;q=30&amp;auto=format&amp;w=600&amp;h=397&amp;fit=crop&amp;dpr=2 1200w, https:\/\/images.theconversation.com\/files\/463872\/original\/file-20220518-25-j50eqa.png?ixlib=rb-1.1.0&amp;q=15&amp;auto=format&amp;w=600&amp;h=397&amp;fit=crop&amp;dpr=3 1800w, https:\/\/images.theconversation.com\/files\/463872\/original\/file-20220518-25-j50eqa.png?ixlib=rb-1.1.0&amp;q=45&amp;auto=format&amp;w=754&amp;h=499&amp;fit=crop&amp;dpr=1 754w, https:\/\/images.theconversation.com\/files\/463872\/original\/file-20220518-25-j50eqa.png?ixlib=rb-1.1.0&amp;q=30&amp;auto=format&amp;w=754&amp;h=499&amp;fit=crop&amp;dpr=2 1508w, https:\/\/images.theconversation.com\/files\/463872\/original\/file-20220518-25-j50eqa.png?ixlib=rb-1.1.0&amp;q=15&amp;auto=format&amp;w=754&amp;h=499&amp;fit=crop&amp;dpr=3 2262w\" ><\/a>\n            <figcaption>\n              <span class=\"caption\">A forecast from the Colorado State University-Machine Learning Probabilities system for the severe weather outbreak on Dec. 15, 2021, in the U.S. Midwest. The panels illustrate the progression of the forecast from eight days in advance (lower right) to three days in advance (upper left), along with reports of severe weather (tornadoes in red, hail in green, damaging wind in blue).<\/span>\n              <span class=\"attribution\"><span class=\"source\">Russ Schumacher and Aaron Hill<\/span>, <a class=\"license\" href=\"http:\/\/creativecommons.org\/licenses\/by-nd\/4.0\/\" target=\"_blank\" rel=\"noopener\">CC BY-ND<\/a><\/span>\n            <\/figcaption>\n          <\/figure>\n\n<h2 id=\"the-role-of-human-expertise\">The role of human expertise<\/h2>\n\n<p>There are also reasons for caution. Unlike numerical weather prediction models, forecast systems that use machine learning are not constrained by the physical laws that govern the atmosphere. So it\u2019s possible that they could produce unrealistic results \u2013 for example, forecasting temperature extremes beyond the bounds of nature. And it is unclear how they will perform during highly unusual or unprecedented weather phenomena. <\/p>\n\n<p>And relying on AI tools can raise <a href=\"https:\/\/doi.org\/10.1017\/eds.2022.5\" target=\"_blank\" rel=\"noopener\">ethical concerns<\/a>. For instance, locations with relatively few weather observations with which to train a machine learning system may not benefit from forecast improvements that are seen in other areas.<\/p>\n\n<p>Another central question is how best to incorporate these new advances into forecasting. Finding the right balance between automated tools and the knowledge of expert human forecasters has long been a challenge in meteorology. Rapid technological advances will only make it more complicated.<\/p>\n\n<p>Ideally, AI and machine learning will allow human forecasters to do their jobs more efficiently, spending less time on generating routine forecasts and more on communicating forecasts\u2019 implications and impacts to the public \u2013 or, for private forecasters, to their clients. We believe that <a href=\"https:\/\/www.ai2es.org\/\" target=\"_blank\" rel=\"noopener\">careful<\/a> <a href=\"https:\/\/www.tacc.utexas.edu\/-\/next-generation-weather-models-cross-the-divide-to-real-world-impact\" target=\"_blank\" rel=\"noopener\">collaboration<\/a> between scientists, forecasters and forecast users is the best way to achieve these goals and build trust in machine-generated weather forecasts.<!-- Below is The Conversation's page counter tag. Please DO NOT REMOVE. --><img  loading=\"lazy\"  decoding=\"async\"  src=\"data:image\/png;base64,iVBORw0KGgoAAAANSUhEUgAAAAEAAAABAQMAAAAl21bKAAAAA1BMVEUAAP+KeNJXAAAAAXRSTlMAQObYZgAAAAlwSFlzAAAOxAAADsQBlSsOGwAAAApJREFUCNdjYAAAAAIAAeIhvDMAAAAASUVORK5CYII=\"  alt=\"The Conversation\"  width=\"1\"  height=\"1\"  style=\"border: none !important; box-shadow: none !important; margin: 0 !important; max-height: 1px !important; max-width: 1px !important; min-height: 1px !important; min-width: 1px !important; opacity: 0 !important; outline: none !important; padding: 0 !important\"  class=\" pk-lazyload\"  data-pk-sizes=\"auto\"  data-pk-src=\"https:\/\/counter.theconversation.com\/content\/182498\/count.gif?distributor=republish-lightbox-basic\" ><!-- End of code. If you don't see any code above, please get new code from the Advanced tab after you click the republish button. The page counter does not collect any personal data. More info: https:\/\/theconversation.com\/republishing-guidelines --><\/p>\n\n<p><span><a href=\"https:\/\/theconversation.com\/profiles\/russ-schumacher-403970\" target=\"_blank\" rel=\"noopener\">Russ Schumacher<\/a>, Associate Professor of Atmospheric Science and Colorado State Climatologist, <em><a href=\"https:\/\/theconversation.com\/institutions\/colorado-state-university-1267\" target=\"_blank\" rel=\"noopener\">Colorado State University<\/a><\/em> and <a href=\"https:\/\/theconversation.com\/profiles\/aaron-hill-1346758\" target=\"_blank\" rel=\"noopener\">Aaron Hill<\/a>, Research Scientist, <em><a href=\"https:\/\/theconversation.com\/institutions\/colorado-state-university-1267\" target=\"_blank\" rel=\"noopener\">Colorado State University<\/a><\/em><\/span><\/p>\n\n<p>This article is republished from <a href=\"https:\/\/theconversation.com\" target=\"_blank\" rel=\"noopener\">The Conversation<\/a> under a Creative Commons license. Read the <a href=\"https:\/\/theconversation.com\/ai-and-machine-learning-are-improving-weather-forecasts-but-they-wont-replace-human-experts-182498\" target=\"_blank\" rel=\"noopener\">original article<\/a>.<\/p>\n\n","protected":false},"excerpt":{"rendered":"Meteorologist Todd Dankers monitors weather patterns in Boulder, Colorado, Oct. 24, 2018. Hyoung Chang\/The Denver Post via Getty&hellip;\n","protected":false},"author":93,"featured_media":4325,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"nf_dc_page":"","fifu_image_url":"","fifu_image_alt":"","footnotes":""},"categories":[13,16],"tags":[474,166],"class_list":{"0":"post-4324","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-earth","8":"category-tech","9":"tag-the-conversation","10":"tag-weather","11":"cs-entry","12":"cs-video-wrap"},"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/modernsciences.org\/staging\/4414\/wp-json\/wp\/v2\/posts\/4324","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/modernsciences.org\/staging\/4414\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/modernsciences.org\/staging\/4414\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/modernsciences.org\/staging\/4414\/wp-json\/wp\/v2\/users\/93"}],"replies":[{"embeddable":true,"href":"https:\/\/modernsciences.org\/staging\/4414\/wp-json\/wp\/v2\/comments?post=4324"}],"version-history":[{"count":1,"href":"https:\/\/modernsciences.org\/staging\/4414\/wp-json\/wp\/v2\/posts\/4324\/revisions"}],"predecessor-version":[{"id":4326,"href":"https:\/\/modernsciences.org\/staging\/4414\/wp-json\/wp\/v2\/posts\/4324\/revisions\/4326"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/modernsciences.org\/staging\/4414\/wp-json\/wp\/v2\/media\/4325"}],"wp:attachment":[{"href":"https:\/\/modernsciences.org\/staging\/4414\/wp-json\/wp\/v2\/media?parent=4324"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/modernsciences.org\/staging\/4414\/wp-json\/wp\/v2\/categories?post=4324"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/modernsciences.org\/staging\/4414\/wp-json\/wp\/v2\/tags?post=4324"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}