Opioid drugs such as morphine and fentanyl are like the two-faced Roman god Janus: The kindly face delivers pain relief to millions of sufferers, while the grim face drives an opioid abuse and overdose crisis that claimed nearly 70,000 lives in the U.S. in 2020 alone.
One of the most common stereotypes about the human past is that men did the hunting while women did the gathering. That gendered division of labor, the story goes, would have provided the meat and plant foods people needed to survive.
Have you ever had a nasty infection that just won’t seem to go away? Or a runny nose that keeps coming back? You may have been dealing with a bacterium that is tolerant of, though not yet resistant to, antibiotics.
It’s coming. Winds are weakening along the equatorial Pacific Ocean. Heat is building beneath the ocean surface. By July, most forecast models agree that the climate system’s biggest player – El Niño – will return for the first time in nearly four years.
El Niño is one side of the climatic coin called the El Niño-Southern Oscillation, or ENSO. It’s the heads to La Niña’s tails.
The Justice Department on April 14, 2023, charged Jack Teixeira, a 21-year-old Massachusetts Air National Guard member, with unauthorized retention and transmission of national defense information and unauthorized removal and retention of classified documents or material. Media reports suggest that Teixeira didn’t intend to leak the documents widely but rather shared them on a closed Discord community focused on playing war games.
As wildfire risk rises in the West, wildland firefighters and officials are keeping a closer eye on the high mountains – regions once considered too wet to burn.
When we asked GPT-3, an extremely powerful and popular artificial intelligence language system, whether you’d be more likely to use a paper map or a stone to fan life into coals for a barbecue, it preferred the stone.
To smooth your wrinkled skirt, would you grab a warm thermos or a hairpin? GPT-3 suggested the hairpin.
And if you need to cover your hair for work in a fast-food restaurant, which would work better, a paper sandwich wrapper or a hamburger bun? GPT-3 went for the bun.
Why does GPT-3 make those choices when most people choose the alternative? Because GPT-3 does not understand language the way humans do.
One of us is a psychology researcher who over 20 years ago presented a series of scenarios like those above to test the understanding of a computer model of language from that time. The model did not accurately choose between using rocks and maps to fan coals, whereas humans did so easily.
The other of us is a doctoral student in cognitive science who was part of a team of researchers that more recently used the same scenarios to test GPT-3. Although GPT-3 did better than the older model, it was significantly worse than humans. It got the three scenarios mentioned above completely wrong.
GPT-3, the engine that powered the initial release of ChatGPT, learns about language by noting, from a trillion instances, which words tend to follow which other words. The strong statistical regularities in language sequences allow GPT-3 to learn a lot about language. And that sequential knowledge often allows ChatGPT to produce reasonable sentences, essays, poems and computer code.
Although GPT-3 is extremely good at learning the rules of what follows what in human language, it doesn’t have the foggiest idea what any of those words mean to a human being. And how could it?
Humans are biological entities that evolved with bodies that need to operate in the physical and social worlds to get things done. Language is a tool that helps people do that. GPT-3 is an artificial software system that predicts the next word. It does not need to get anything done with those predictions in the real world.
The meaning of a word or sentence is intimately related to the human body: people’s abilities to act, to perceive and to have emotions. Human cognition is empowered by being embodied. People’s understanding of a term like “paper sandwich wrapper,” for example, includes the wrapper’s appearance, its feel, its weight, and, consequently, how we can use it: for wrapping a sandwich. People’s understanding also includes how someone can use it for myriad other opportunities it affords, such as scrunching it into a ball for a game of hoops, or covering one’s hair.
All of these uses arise because of the nature of human bodies and needs: People have hands that can fold paper, a head of hair that is about the same size as a sandwich wrapper, and a need to be employed and thus follow rules like covering hair. That is, people understand how to make use of stuff in ways that are not captured in language-use statistics.
GPT-3, its successor, GPT-4, and its cousins Bard, Chinchilla and LLaMA do not have bodies, and so they cannot determine, on their own, which objects are foldable, or the many other properties that the psychologist J.J. Gibson called affordances. Given people’s hands and arms, paper maps afford fanning a flame, and a thermos affords rolling out wrinkles.
Without arms and hands, let alone the need to wear unwrinkled clothes for a job, GPT-3 cannot determine these affordances. It can only fake them if it has run across something similar in the stream of words on the internet.
Will a large-language-model AI ever understand language the way humans do? In our view, not without having a humanlike body, senses, purposes and ways of life.
GPT-4 was trained on images as well as text, permitting it to learn statistical relationships between words and pixels. While we can’t perform our original analysis on GPT-4 because it currently doesn’t output the probability it assigns to words, when we asked GPT-4 the three questions, it answered them correctly. This could be due to the model’s learning from previous inputs, or its increased size and visual input.
However, you can continue to construct new examples to trip it up by thinking of objects that have surprising affordances that the model likely hasn’t encountered. For example, GPT-4 says that a cup with the bottom cut off would be better for holding water than a lightbulb with the bottom cut off.
A model with access to images might be something like a child who learns about language – and the world – from the television: It’s easier than learning from the radio, but humanlike understanding will require the crucial opportunity to interact with the world.
Recent research has taken this approach, training language models to generate physics simulations, interact with physical environments and even generate robotic action plans. Embodied language understanding might still be a long way off, but these kinds of multisensory interactive projects are crucial steps on the way there.
ChatGPT is a fascinating tool that will undoubtedly be used for good – and not-so-good – purposes. But don’t be fooled into thinking that it understands the words it spews, let alone that it’s sentient.
Arthur Glenberg, Emeritus Professor of Psychology, Arizona State University and Cameron Robert Jones, Doctoral Student in Cognitive Science, University of California, San Diego
This article is republished from The Conversation under a Creative Commons license. Read the original article.
Arthur Glenberg, Arizona State University and Cameron Robert Jones, University of California, San Diego