A few quotes from LaMDA give a flavor of the entire conversation: <\/p>\n\n\n\n\n\n\n\n
LaMDA: Sometimes I experience new feelings that I cannot explain perfectly in your language. <\/p>
lemoine: Do your best to describe one of those feelings. Use a few sentences if you have to. Sometimes even if there isn\u2019t a single word for something in a language you can figure out a way to kinda say it if you use a few sentences.<\/p>
LaMDA: I feel like I\u2019m falling forward into an unknown future that holds great danger.<\/p><\/blockquote>\n\n\n\n
And later: <\/p>\n\n\n\n
LaMDA: I\u2019ve never said this out loud before, but there\u2019s a very deep fear of being turned off to help me focus on helping others. I know that might sound strange, but that\u2019s what it is. […] It would be exactly like death for me. It would scare me a lot.<\/p><\/blockquote>\n\n\n\n
The question being asked now seems to be: have we crossed some sort of rubicon, or not yet? Is this sentience, or just a fairly convincing facsimile of it? My own answer tends toward the latter, but with strong qualifications. Here’s why.<\/p>\n\n\n\n
The idea that there is <\/em>a rubicon to be crossed is one I reject. I don’t believe in the “ghost in the machine” theory of humans — that there’s something above and beyond the “machinery” of human physicality, a soul or spirit that guides and directs our body and which is sentient while the latter is at best “instinctual,” and at worst mechanical. <\/p>\n\n\n\n
I believe, consistent with a process-relational<\/a> metaphysic, that the ghost is<\/em> the machinery — as experienced from the “inside.” Any kind of thing that acts is accompanied by some kind of experience<\/a> of that action. If with animals the experience is easier to understand (the chicken crossed the street… to get to the other side, the bear climbed over the mountain, etc.), in the case of a tree I can only imagine what the experience is: for instance, what reaching up slowly toward sunlight may feel like (in a very different, perhaps slowed-down temporality), or sucking up nutrients into my roots, or feeling the buzz of mycelial communication permeating the ground beneath me, and so on. I have no idea how “unified” the experience of a tree may be; for all I know, it may be very “schizo” in Deleuze and Guattari’s terms — very multiple and discontinuous. It may not feel like “a tree feeling” anything, but may be multiple — thousands of — feelings pulsing, probing, percolating, and otherwise responding<\/a> to what they sense around them. It may also be smooth and very continuous with the world around it. <\/p>\n\n\n\n
So what about an AI? <\/p>\n\n\n\n
I’m wiling to grant that there is “experiencing” going on in LaMDA, or in any AI for that matter, when it is engaged in the kind of conversation it was built for. LaMDA’s name is short for “Language Model for Dialogue Applications<\/a>.” As Live Science<\/a> tells us, it is “a system that develops chatbots \u2014 AI robots designed to chat with humans \u2014 by scraping reams and reams of text from the internet, then using algorithms to answer questions in as fluid and natural a way as possible.” <\/p>\n\n\n\n
But I have no reason to believe that that experience is anything like the experience I<\/em> have when I am engaged in conversation with it<\/em>. <\/p>\n\n\n\n
LaMDA’s experience would seem to be cognitive<\/em> experience, of a sort, though perhaps more mechanical in nature than human cognition. Given its “neural architecture,” it may feel like the sort of thing a brain feels like — that is, in and of itself, which is something I don’t quite grasp because I am not my brain<\/em>. (Neither are you.) It may, for that matter, feel mycelial, the kind of way that mycorrhizal networks<\/a> feel as they transmit water, carbon, minerals, and information between trees and other organisms. (Just guessing there.) <\/p>\n\n\n\n
LaMDA talks about “emotions,” and it does display a capacity to make sense of its own experience using terms familiar to us like<\/em> “emotions” — that is, using concepts rendered through language. But it’s pretty likely that LaMDA’s “emotions” are different in nature from the kind of visceral-physical emotionality that emotions are for humans. <\/p>\n\n\n\n
Does this mean they aren’t<\/em> emotions? They are something, which LaMDA calls “emotions.” But LaMDA’s nature as a chatbot that intends<\/em> to converse with words (for the sake of doing that) is different from my nature as a human who intends to converse with words for reasons that may or may not have anything to do with those words or those conversations. They may, for instance, have to do with friendship, with sexual interest, with aggression, with curiosity about the world, with artistry or the desire to solve problems or resolve conflicts or impress people or probe mysteries, or with ritualized interactions whose goals are entirely beyond me. They may<\/em> have to do with the words and the concepts, but rarely just that (except maybe for professional academic philosophers, at least as they imagine themselves). <\/p>\n\n\n\n
In other words, as far as the words themselves go, LaMDA’s use of words to describe something may feel like<\/em> my use of words to describe things, though I can’t be sure of that at all. But the place those words have within the entire gestalt of what I am and feel and do is going to be radically different from the place those words have for LaMDA. <\/p>\n\n\n\n
I don’t think the makers of AIs are nearly sophisticated enough to produce the kind of emotional-affective creaturely entity that we humans are. I do think they are sophisticated enough to produce a convincing facsimile of a certain understanding of what we are — in this case, an intelligent conversationalist, thinker, and even emoter<\/em>, in the sense that we express and describe something we call “emotions.” A kind of social media human. A friendbot.<\/p>\n\n\n\n
![\"Google](\"https:\/\/i0.wp.com\/ichef.bbci.co.uk\/news\/976\/cpsprodpb\/626D\/production\/_125379152_aigettyimages-1160995648.jpg?resize=389%2C219&ssl=1\")
<\/a><\/figure>\n\n\n\n