{"id":2818,"date":"2023-03-02T08:14:55","date_gmt":"2023-03-02T08:14:55","guid":{"rendered":"https:\/\/arts.sun.ac.za\/?p=2818"},"modified":"2023-03-13T06:32:43","modified_gmt":"2023-03-13T06:32:43","slug":"risks-and-limitations-of-chatgpt-and-bing-chat","status":"publish","type":"post","link":"https:\/\/arts.sun.ac.za\/af\/2023\/03\/02\/risks-and-limitations-of-chatgpt-and-bing-chat","title":{"rendered":"Op-Ed: Risks and limitations of ChatGPT and Bing Chat"},"content":{"rendered":"<p>[et_pb_section fb_built=&#8221;1&#8243; admin_label=&#8221;section&#8221; _builder_version=&#8221;3.22&#8243;][et_pb_row admin_label=&#8221;row&#8221; _builder_version=&#8221;3.25&#8243; background_size=&#8221;initial&#8221; background_position=&#8221;top_left&#8221; background_repeat=&#8221;repeat&#8221;][et_pb_column type=&#8221;4_4&#8243; _builder_version=&#8221;3.25&#8243; custom_padding=&#8221;|||&#8221; custom_padding__hover=&#8221;|||&#8221;][et_pb_text admin_label=&#8221;Text&#8221; _builder_version=&#8221;3.27.4&#8243; background_size=&#8221;initial&#8221; background_position=&#8221;top_left&#8221; background_repeat=&#8221;repeat&#8221;]\u200bChatbots like OpenAI&#8217;s ChatGPT, Microsoft&#8217;s Bing Chat, and Google&#8217;s Bard are grabbing the world&#8217;s attention. In an opinion piece for\u00a0<em>News24<\/em>, Dr Tanya de Villiers-Botha (Centre for Applied Ethics) emphasises the need for greater awareness about the ethical risks arising from this technology.<\/p>\n<ul>\n<li>Read the article below or click\u00a0<a href=\"https:\/\/www.news24.com\/news24\/opinions\/columnists\/guestcolumn\/opinion-tanya-de-villiers-botha-risks-and-limitations-of-chatgpt-and-bing-chat-20230228\"><strong class=\"ms-rteThemeForeColor-5-0\">hier meer.<\/strong><\/a><strong class=\"ms-rteThemeForeColor-5-0\">\u00a0<\/strong>for the piece as published.<\/li>\n<\/ul>\n<p><strong>Tanya de Villiers-Botha*<\/strong><\/p>\n<p>A little over two years ago, the co-leader of Google\u2019s Ethical AI team Dr Timnit Gebru was forced out of the company on the back of a peer-reviewed\u00a0<a href=\"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3442188.3445922\"><strong class=\"ms-rteThemeForeColor-5-0\">paper<\/strong><\/a><strong class=\"ms-rteThemeForeColor-5-0\">\u00a0<\/strong>she and members of her team wrote on some of the ethical risks relating to Large Language Models (LLMs), the AI model that underlies chatbots like OpenAI\u2019s ChatGPT, Microsoft\u2019s Bing Chat, and Google\u2019s Bard. The paper flags potential dangers arising from this technology and makes some recommendations on how these might be mitigated.<\/p>\n<p>\u200b\u200b\u200bSome within Google\u00a0<a href=\"https:\/\/www.wired.com\/story\/google-timnit-gebru-ai-what-really-happened\/\"><strong class=\"ms-rteThemeForeColor-5-0\">reportedly<\/strong><\/a><strong class=\"ms-rteThemeForeColor-5-0\">\u00a0<\/strong>found the paper \u201ctoo bleak\u201d and countered that the technology had been engineered to avoid at least some of the problems flagged. Two-odd years and the much-hyped introduction of two chatbots based on this technology later, and Gebru and her team seem largely vindicated.<\/p>\n<p>In their paper, the researchers note that using\u00a0<a href=\"https:\/\/www.techopedia.com\/definition\/30325\/deep-learning\"><strong class=\"ms-rteThemeForeColor-5-0\">deep learning<\/strong><\/a>\u00a0to create general models that can process natural language and perform language-based tasks comes with unique risks, three of which are particularly salient in the context of the ChatGPT- \u00a0and Bing-related stories currently in the news. (Microsoft\u2019s limited-release Bing Chat\u00a0<a href=\"https:\/\/garymarcus.substack.com\/p\/why-is-bing-so-reckless\"><strong class=\"ms-rteThemeForeColor-5-0\">purportedly<\/strong><\/a><strong class=\"ms-rteThemeForeColor-5-0\">\u00a0<\/strong>makes use of a next-generation version of ChatGPT.) These are bias, lack of actual understanding, and the potential to mislead. To understand how these risks arise, we need to look at how these systems are trained.<\/p>\n<p>Large Language Models are trained on massive amounts of data relating to human language use so that they can appropriately and convincingly simulate such language use in response to prompts. In many ways, this technology is very successful. ChatGPT\u2019s facility with language is astounding. The technology can be useful in specific, contained contexts that require natural language-use abilities, such as transcription, translation, and answering FAQs.\u00a0 Nevertheless, as is vividly demonstrated by Bing\u2019s more\u00a0<a href=\"https:\/\/www.nytimes.com\/2023\/02\/16\/technology\/bing-chatbot-microsoft-chatgpt.html\"><strong class=\"ms-rteThemeForeColor-5-0\">unhinged recent outputs<\/strong><\/a>\u00a0and by the enthusiastic attempts to\u00a0<a href=\"https:\/\/www.vice.com\/en\/article\/n7zanw\/people-are-jailbreaking-chatgpt-to-make-it-endorse-racism-conspiracies\"><strong class=\"ms-rteThemeForeColor-5-0\">jailbreak ChatGPT<\/strong><\/a>, the technology does not come without significant risks and limitations.<\/p>\n<p><strong>Biases<\/strong><\/p>\n<p>LLMs require enormous amounts of data to learn, which means that most of their training data is scraped off the internet, the largest and most readily accessible source of examples of \u201cnatural&#8221; human language use available. An almost inevitable result is that any biases inherent in that data are \u201cbaked into&#8221; the system. For example, part of the data used to train GPT-2, forerunner to ChatGPT, came from scraping outbound links from Reddit, which has a relatively homogenous user-base in the United States of 67% men, 64% aged between 18 and 29. ChatGPT has almost certainly ingested this source as well as Wikipedia, which has its own documented problems with\u00a0<a href=\"https:\/\/en.wikipedia.org\/wiki\/Criticism_of_Wikipedia\"><strong class=\"ms-rteThemeForeColor-5-0\">bias<\/strong><\/a>.<\/p>\n<p>As Gebru et al. note, data derived from the web often skews towards English content created by young men from developed countries. Any source of data that consists in text or other information generated by a relatively homogenous group is likely to result in data that reflects the worldview and biases of that group. This is how racists, sexist, homophobic, etc. language enters the training sets of LLMs. Any such biases will be replicated, and sometimes amplified, by the model: it outputs what it learns.<\/p>\n<p>OpenAI, the creators of ChatGPT, seem to have tried to mitigate this risk, both through reinforcement learning from human feedback (a process fraught with\u00a0<a href=\"https:\/\/time.com\/6247678\/openai-chatgpt-kenya-workers\/\"><strong class=\"ms-rteThemeForeColor-5-0\">ethical issues<\/strong><\/a>), which attempts to have the system \u201cunlearn&#8221; such biases, and through adding\u00a0<a href=\"https:\/\/openai.com\/blog\/how-should-ai-systems-behave\/\"><strong class=\"ms-rteThemeForeColor-5-0\">guardrails<\/strong><\/a><strong class=\"ms-rteThemeForeColor-5-0\">\u00a0<\/strong>that prohibits it from outputting some more overtly offensive responses. Those who bemoan the purportedly \u201cwoke&#8221;-values they see exemplified in the current guardrails seem to lose sight of the fact (or perhaps they don&#8217;t) that without these in place, ChatGPT is not\u00a0<em>unbiased<\/em>, but will reflect the biases encoded in its training data.<\/p>\n<p>The apparent left-leaning bias of Chat-GPT&#8217;s guardrails are a somewhat clumsy attempt to compensate for the existing underlying biases in the opposite direction. As Gebru et al. point out, a better fix for such biases partly lies in better, more carefully-curated training data; however, this option is costly and time-consuming, as there simply isn&#8217;t enough free, quality data available.<\/p>\n<p><strong>Lack of understanding<\/strong><\/p>\n<p>A further and very significant problem is that LLMs do not actually\u00a0<em>understand<\/em>\u00a0language. Ultimately, they merely mimic the language use they have been trained on, which is why Gebru et al. call them \u201cstochastic parrots&#8221;. Advances in building and training these models have allowed for truly uncanny mimicry, but the illusion at understanding remains just that, an illusion.<\/p>\n<p>Ultimately, these systems remain mimics\u2014they generate text based on statistical analyses that indicates what kind of text tends to follow a given bit of inputted text, based on their training data. Basically, they&#8217;re autocomplete on steroids.<\/p>\n<p>This lack of understanding underlies these systems&#8217; uneasy relationship with the truth and explains why the internet is currently awash with examples of\u00a0<a href=\"https:\/\/garymarcus.substack.com\/p\/two-frightening-things-before-breakfast?publication_id=888615&amp;post_id=103281593&amp;isFreemail=true\"><strong class=\"ms-rteThemeForeColor-5-0\">outright nonsense<\/strong><\/a>\u00a0from both ChatGPT and Bing Chat. None of this comes as much of a surprise to those familiar with the technology.<\/p>\n<p>What does come as a surprise is the apparent lack of awareness of (or concern about) these limitations on the part of those rushing to roll it out. Given that LLM&#8217;s do not understand language and cannot distinguish between truth and falsehood, using them to power general-purpose web search does not seem wise or feasible. We have no reason to think that we are even close to a technical solution for LLM&#8217;s falsehood problem; both\u00a0<a href=\"https:\/\/medium.com\/%40chiayewken\/mistakes-of-microsofts-new-bing-can-chatgpt-like-generative-models-guarantee-factual-accuracy-5ec82a7453f4\"><strong class=\"ms-rteThemeForeColor-5-0\">Bing Chat<\/strong><\/a>\u00a0en\u00a0<a href=\"https:\/\/www.bbc.com\/news\/business-64576225\"><strong class=\"ms-rteThemeForeColor-5-0\">Google&#8217;s Bard<\/strong><\/a>\u00a0made factual errors\u00a0<em>in their product unveiling demonstrations<\/em>.<\/p>\n<p><strong>Misleading<\/strong><\/p>\n<p>Gebru et al. point out the further risk that LLM-based chatbots&#8217; facility in mimicking human-like language use, along with our tendency to anthropomorphise entities that act in human-like ways, can lead us to place too much faith in these bots, crediting them insight, authority, and agency where there is none. Even some of the more technically-informed testers of the limited-release Bing Chat report catching themselves thinking of the bot as intelligent and sentient, while it, in turn, declares that it is in\u00a0<a href=\"https:\/\/www.nytimes.com\/2023\/02\/16\/technology\/bing-chatbot-microsoft-chatgpt.html\"><strong class=\"ms-rteThemeForeColor-5-0\">love<\/strong><\/a><strong class=\"ms-rteThemeForeColor-5-0\">\u00a0<\/strong>with its users or becomes\u00a0<a href=\"https:\/\/twitter.com\/MovingToTheSun\/status\/1625156575202537474\/photo\/4\"><strong class=\"ms-rteThemeForeColor-5-0\">belligerent<\/strong><\/a><strong class=\"ms-rteThemeForeColor-5-0\">\u00a0<\/strong>and in exchanges. This makes it much more likely that people will be taken in by any falsehoods they generate and be emotionally impacted by them.<\/p>\n<p>A related risk mentioned in the Gebru paper and elaborated on by Dr\u00a0<a href=\"https:\/\/garymarcus.substack.com\/p\/two-frightening-things-before-breakfast?publication_id=888615&amp;post_id=103281593&amp;isFreemail=true\"><span class=\"ms-rteThemeForeColor-5-0\"><strong>Gary Marcu<\/strong><strong>s<\/strong><\/span><\/a>\u00a0is the fact that while these systems are not very good at reliably generating\u00a0<em>factual<\/em>\u00a0information, they are very good at generating massive amounts of convincing-sounding\u00a0<em>misinformation<\/em>. This makes them ideally suited to mass-propaganda, mass-spamming, mass producing fake, mutually-reinforcing websites, and any use that requires language fluency but not veracity. Moreover, if the web becomes flooded with masses of well-written misinformation, web-linked LLMs will take that output as input, further exacerbating their misinformation problem.<\/p>\n<p>\u200bThe current crop of LLM-based chatbots is extremely impressive in some ways and truly terrible in others. Overall, they have the feel of being technical marvels in search of useful applications, and their limited roll-outs have the feel of mass product-testing on the back of overconfidence in their abilities from industry.<\/p>\n<p>What does seem clear, especially as far as web search or other applications that require high accuracy and low bias are concerned, they are not ready to be released, and it is still an\u00a0<a href=\"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3498366.3505816\"><strong class=\"ms-rteThemeForeColor-5-0\">open<\/strong><\/a><strong class=\"ms-rteThemeForeColor-5-0\">\u00a0<\/strong>question whether they ever will be. It remains to be seen whether Microsoft will be hurt by seemingly prematurely setting off the \u201cAI arms race&#8221; to roll out LLM-based web search.<\/p>\n<p>In the meantime, society will be confronted with more ethical risks arising from this technology. It also remains to be seen whether the advantages to be had from LLMs outweigh the risks. It is worth reiterating that none of the limitations or risks mentioned here were\u00a0<a href=\"https:\/\/www.msn.com\/en-us\/news\/technology\/microsoft-knew-about-bing-chat-s-unhinged-responses-months-before-launch\/ar-AA17LTY3\"><strong class=\"ms-rteThemeForeColor-5-0\">unknown<\/strong><\/a><strong class=\"ms-rteThemeForeColor-5-0\">\u00a0<\/strong>or inevitable, which further underscores the need for greater ethical awareness throughout the tech industry.<\/p>\n<p><strong><em>*<\/em><\/strong><strong><em>Dr Tanya de Villiers-Botha is a senior lecturer in the Department of Philosophy and head of the Unit for the Ethics of Technology in the Centre for Applied Ethics at Stellenbosch.<\/em><\/strong>[\/et_pb_text][\/et_pb_column][\/et_pb_row][\/et_pb_section]<\/p>","protected":false},"excerpt":{"rendered":"<p>\u200bChatbots like OpenAI&#8217;s ChatGPT, Microsoft&#8217;s Bing Chat, and Google&#8217;s Bard are grabbing the world&#8217;s attention. In an opinion piece for\u00a0News24, Dr Tanya de Villiers-Botha (Centre for Applied Ethics) emphasises the need for greater awareness about the ethical risks arising from this technology. Read the article below or click\u00a0here\u00a0for the piece as published. Tanya de Villiers-Botha* [&hellip;]<\/p>","protected":false},"author":11681,"featured_media":2845,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_et_pb_use_builder":"on","_et_pb_old_content":"\u200bChatbots like OpenAI's ChatGPT, Microsoft's Bing Chat, and Google's Bard are grabbing the world's attention. In an opinion piece for\u00a0<em>News24<\/em>, Dr Tanya de Villiers-Botha (Centre for Applied Ethics) emphasises the need for greater awareness about the ethical risks arising from this technology.\r\n<ul>\r\n \t<li>Read the article below or click\u00a0<a href=\"https:\/\/www.news24.com\/news24\/opinions\/columnists\/guestcolumn\/opinion-tanya-de-villiers-botha-risks-and-limitations-of-chatgpt-and-bing-chat-20230228\"><strong class=\"ms-rteThemeForeColor-5-0\">here<\/strong><\/a><strong class=\"ms-rteThemeForeColor-5-0\">\u00a0<\/strong>for the piece as published.<\/li>\r\n<\/ul>\r\n<strong>Tanya de Villiers-Botha*<\/strong>\r\n\r\nA little over two years ago, the co-leader of Google's Ethical AI team Dr Timnit Gebru was forced out of the company on the back of a peer-reviewed\u00a0<a href=\"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3442188.3445922\"><strong class=\"ms-rteThemeForeColor-5-0\">paper<\/strong><\/a><strong class=\"ms-rteThemeForeColor-5-0\">\u00a0<\/strong>she and members of her team wrote on some of the ethical risks relating to Large Language Models (LLMs), the AI model that underlies chatbots like OpenAI's ChatGPT, Microsoft's Bing Chat, and Google's Bard. The paper flags potential dangers arising from this technology and makes some recommendations on how these might be mitigated.\r\n\r\n\u200b\u200b\u200bSome within Google\u00a0<a href=\"https:\/\/www.wired.com\/story\/google-timnit-gebru-ai-what-really-happened\/\"><strong class=\"ms-rteThemeForeColor-5-0\">reportedly<\/strong><\/a><strong class=\"ms-rteThemeForeColor-5-0\">\u00a0<\/strong>found the paper \u201ctoo bleak\" and countered that the technology had been engineered to avoid at least some of the problems flagged. Two-odd years and the much-hyped introduction of two chatbots based on this technology later, and Gebru and her team seem largely vindicated.\r\n\r\nIn their paper, the researchers note that using\u00a0<a href=\"https:\/\/www.techopedia.com\/definition\/30325\/deep-learning\"><strong class=\"ms-rteThemeForeColor-5-0\">deep learning<\/strong><\/a>\u00a0to create general models that can process natural language and perform language-based tasks comes with unique risks, three of which are particularly salient in the context of the ChatGPT- \u00a0and Bing-related stories currently in the news. (Microsoft's limited-release Bing Chat\u00a0<a href=\"https:\/\/garymarcus.substack.com\/p\/why-is-bing-so-reckless\"><strong class=\"ms-rteThemeForeColor-5-0\">purportedly<\/strong><\/a><strong class=\"ms-rteThemeForeColor-5-0\">\u00a0<\/strong>makes use of a next-generation version of ChatGPT.) These are bias, lack of actual understanding, and the potential to mislead. To understand how these risks arise, we need to look at how these systems are trained.\r\n\r\nLarge Language Models are trained on massive amounts of data relating to human language use so that they can appropriately and convincingly simulate such language use in response to prompts. In many ways, this technology is very successful. ChatGPT's facility with language is astounding. The technology can be useful in specific, contained contexts that require natural language-use abilities, such as transcription, translation, and answering FAQs.\u00a0 Nevertheless, as is vividly demonstrated by Bing's more\u00a0<a href=\"https:\/\/www.nytimes.com\/2023\/02\/16\/technology\/bing-chatbot-microsoft-chatgpt.html\"><strong class=\"ms-rteThemeForeColor-5-0\">unhinged recent outputs<\/strong><\/a>\u00a0and by the enthusiastic attempts to\u00a0<a href=\"https:\/\/www.vice.com\/en\/article\/n7zanw\/people-are-jailbreaking-chatgpt-to-make-it-endorse-racism-conspiracies\"><strong class=\"ms-rteThemeForeColor-5-0\">jailbreak ChatGPT<\/strong><\/a>, the technology does not come without significant risks and limitations.\r\n\r\n<strong>Biases<\/strong>\r\n\r\nLLMs require enormous amounts of data to learn, which means that most of their training data is scraped off the internet, the largest and most readily accessible source of examples of \u201cnatural\" human language use available. An almost inevitable result is that any biases inherent in that data are \u201cbaked into\" the system. For example, part of the data used to train GPT-2, forerunner to ChatGPT, came from scraping outbound links from Reddit, which has a relatively homogenous user-base in the United States of 67% men, 64% aged between 18 and 29. ChatGPT has almost certainly ingested this source as well as Wikipedia, which has its own documented problems with\u00a0<a href=\"https:\/\/en.wikipedia.org\/wiki\/Criticism_of_Wikipedia\"><strong class=\"ms-rteThemeForeColor-5-0\">bias<\/strong><\/a>.\r\n\r\nAs Gebru et al. note, data derived from the web often skews towards English content created by young men from developed countries. Any source of data that consists in text or other information generated by a relatively homogenous group is likely to result in data that reflects the worldview and biases of that group. This is how racists, sexist, homophobic, etc. language enters the training sets of LLMs. Any such biases will be replicated, and sometimes amplified, by the model: it outputs what it learns.\r\n\r\nOpenAI, the creators of ChatGPT, seem to have tried to mitigate this risk, both through reinforcement learning from human feedback (a process fraught with\u00a0<a href=\"https:\/\/time.com\/6247678\/openai-chatgpt-kenya-workers\/\"><strong class=\"ms-rteThemeForeColor-5-0\">ethical issues<\/strong><\/a>), which attempts to have the system \u201cunlearn\" such biases, and through adding\u00a0<a href=\"https:\/\/openai.com\/blog\/how-should-ai-systems-behave\/\"><strong class=\"ms-rteThemeForeColor-5-0\">guardrails<\/strong><\/a><strong class=\"ms-rteThemeForeColor-5-0\">\u00a0<\/strong>that prohibits it from outputting some more overtly offensive responses. Those who bemoan the purportedly \u201cwoke\"-values they see exemplified in the current guardrails seem to lose sight of the fact (or perhaps they don't) that without these in place, ChatGPT is not\u00a0<em>unbiased<\/em>, but will reflect the biases encoded in its training data.\r\n\r\nThe apparent left-leaning bias of Chat-GPT's guardrails are a somewhat clumsy attempt to compensate for the existing underlying biases in the opposite direction. As Gebru et al. point out, a better fix for such biases partly lies in better, more carefully-curated training data; however, this option is costly and time-consuming, as there simply isn't enough free, quality data available.\r\n\r\n<strong>Lack of understanding<\/strong>\r\n\r\nA further and very significant problem is that LLMs do not actually\u00a0<em>understand<\/em>\u00a0language. Ultimately, they merely mimic the language use they have been trained on, which is why Gebru et al. call them \u201cstochastic parrots\". Advances in building and training these models have allowed for truly uncanny mimicry, but the illusion at understanding remains just that, an illusion.\r\n\r\nUltimately, these systems remain mimics\u2014they generate text based on statistical analyses that indicates what kind of text tends to follow a given bit of inputted text, based on their training data. Basically, they're autocomplete on steroids.\r\n\r\nThis lack of understanding underlies these systems' uneasy relationship with the truth and explains why the internet is currently awash with examples of\u00a0<a href=\"https:\/\/garymarcus.substack.com\/p\/two-frightening-things-before-breakfast?publication_id=888615&post_id=103281593&isFreemail=true\"><strong class=\"ms-rteThemeForeColor-5-0\">outright nonsense<\/strong><\/a>\u00a0from both ChatGPT and Bing Chat. None of this comes as much of a surprise to those familiar with the technology.\r\n\r\nWhat does come as a surprise is the apparent lack of awareness of (or concern about) these limitations on the part of those rushing to roll it out. Given that LLM's do not understand language and cannot distinguish between truth and falsehood, using them to power general-purpose web search does not seem wise or feasible. We have no reason to think that we are even close to a technical solution for LLM's falsehood problem; both\u00a0<a href=\"https:\/\/medium.com\/%40chiayewken\/mistakes-of-microsofts-new-bing-can-chatgpt-like-generative-models-guarantee-factual-accuracy-5ec82a7453f4\"><strong class=\"ms-rteThemeForeColor-5-0\">Bing Chat<\/strong><\/a>\u00a0and\u00a0<a href=\"https:\/\/www.bbc.com\/news\/business-64576225\"><strong class=\"ms-rteThemeForeColor-5-0\">Google's Bard<\/strong><\/a>\u00a0made factual errors\u00a0<em>in their product unveiling demonstrations<\/em>.\r\n\r\n<strong>Misleading<\/strong>\r\n\r\nGebru et al. point out the further risk that LLM-based chatbots' facility in mimicking human-like language use, along with our tendency to anthropomorphise entities that act in human-like ways, can lead us to place too much faith in these bots, crediting them insight, authority, and agency where there is none. Even some of the more technically-informed testers of the limited-release Bing Chat report catching themselves thinking of the bot as intelligent and sentient, while it, in turn, declares that it is in\u00a0<a href=\"https:\/\/www.nytimes.com\/2023\/02\/16\/technology\/bing-chatbot-microsoft-chatgpt.html\"><strong class=\"ms-rteThemeForeColor-5-0\">love<\/strong><\/a><strong class=\"ms-rteThemeForeColor-5-0\">\u00a0<\/strong>with its users or becomes\u00a0<a href=\"https:\/\/twitter.com\/MovingToTheSun\/status\/1625156575202537474\/photo\/4\"><strong class=\"ms-rteThemeForeColor-5-0\">belligerent<\/strong><\/a><strong class=\"ms-rteThemeForeColor-5-0\">\u00a0<\/strong>and in exchanges. This makes it much more likely that people will be taken in by any falsehoods they generate and be emotionally impacted by them.\r\n\r\nA related risk mentioned in the Gebru paper and elaborated on by Dr\u00a0<a href=\"https:\/\/garymarcus.substack.com\/p\/two-frightening-things-before-breakfast?publication_id=888615&post_id=103281593&isFreemail=true\"><span class=\"ms-rteThemeForeColor-5-0\"><strong>Gary Marcu<\/strong><strong>s<\/strong><\/span><\/a>\u00a0is the fact that while these systems are not very good at reliably generating\u00a0<em>factual<\/em>\u00a0information, they are very good at generating massive amounts of convincing-sounding\u00a0<em>misinformation<\/em>. This makes them ideally suited to mass-propaganda, mass-spamming, mass producing fake, mutually-reinforcing websites, and any use that requires language fluency but not veracity. Moreover, if the web becomes flooded with masses of well-written misinformation, web-linked LLMs will take that output as input, further exacerbating their misinformation problem.\r\n\r\n\u200bThe current crop of LLM-based chatbots is extremely impressive in some ways and truly terrible in others. Overall, they have the feel of being technical marvels in search of useful applications, and their limited roll-outs have the feel of mass product-testing on the back of overconfidence in their abilities from industry.\r\n\r\nWhat does seem clear, especially as far as web search or other applications that require high accuracy and low bias are concerned, they are not ready to be released, and it is still an\u00a0<a href=\"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3498366.3505816\"><strong class=\"ms-rteThemeForeColor-5-0\">open<\/strong><\/a><strong class=\"ms-rteThemeForeColor-5-0\">\u00a0<\/strong>question whether they ever will be. It remains to be seen whether Microsoft will be hurt by seemingly prematurely setting off the \u201cAI arms race\" to roll out LLM-based web search.\r\n\r\nIn the meantime, society will be confronted with more ethical risks arising from this technology. It also remains to be seen whether the advantages to be had from LLMs outweigh the risks. It is worth reiterating that none of the limitations or risks mentioned here were\u00a0<a href=\"https:\/\/www.msn.com\/en-us\/news\/technology\/microsoft-knew-about-bing-chat-s-unhinged-responses-months-before-launch\/ar-AA17LTY3\"><strong class=\"ms-rteThemeForeColor-5-0\">unknown<\/strong><\/a><strong class=\"ms-rteThemeForeColor-5-0\">\u00a0<\/strong>or inevitable, which further underscores the need for greater ethical awareness throughout the tech industry.\r\n\r\n<strong><em>*<\/em><\/strong><strong><em>Dr Tanya de Villiers-Botha is a senior lecturer in the Department of Philosophy and head of the Unit for the Ethics of Technology in the Centre for Applied Ethics at Stellenbosch.<\/em><\/strong>","_et_gb_content_width":"","_exactmetrics_skip_tracking":false,"_exactmetrics_sitenote_active":false,"_exactmetrics_sitenote_note":"","_exactmetrics_sitenote_category":0,"footnotes":""},"categories":[3256],"tags":[],"class_list":["post-2818","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-news"],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/arts.sun.ac.za\/af\/wp-json\/wp\/v2\/posts\/2818","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/arts.sun.ac.za\/af\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/arts.sun.ac.za\/af\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/arts.sun.ac.za\/af\/wp-json\/wp\/v2\/users\/11681"}],"replies":[{"embeddable":true,"href":"https:\/\/arts.sun.ac.za\/af\/wp-json\/wp\/v2\/comments?post=2818"}],"version-history":[{"count":5,"href":"https:\/\/arts.sun.ac.za\/af\/wp-json\/wp\/v2\/posts\/2818\/revisions"}],"predecessor-version":[{"id":3094,"href":"https:\/\/arts.sun.ac.za\/af\/wp-json\/wp\/v2\/posts\/2818\/revisions\/3094"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/arts.sun.ac.za\/af\/wp-json\/wp\/v2\/media\/2845"}],"wp:attachment":[{"href":"https:\/\/arts.sun.ac.za\/af\/wp-json\/wp\/v2\/media?parent=2818"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/arts.sun.ac.za\/af\/wp-json\/wp\/v2\/categories?post=2818"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/arts.sun.ac.za\/af\/wp-json\/wp\/v2\/tags?post=2818"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}