Английская Википедия:AI takeover in popular culture
AI takeover—the idea that some kind of artificial intelligence may supplant humankind as the dominant intelligent species on the planet—is a common theme in science fiction. Famous cultural touchstones include Terminator and The Matrix.
Fictional scenarios typically involve a drawn-out conflict against malicious artificial intelligence (AI) or robots with anthropomorphic motives. In contrast, some scholars believe that a takeover by a future advanced AI, if it were to happen in real life, would succeed or fail rapidly, and would be a disinterested byproduct of the AI's pursuit of its own alien goals, rather than a product of malice specifically targeting humans.[1]
Characterization
There are many positive portrayals of AI in fiction, such as Isaac Asimov's Bicentennial Man and Lt. Commander Data from Star Trek. There are also many negative portrayals. Many of these negative portrayals (and a few of the positive portrayals) involve an AI seizing control from its creators.[2][3]
Reactions
Some AI researchers, such as Yoshua Bengio, have complained that films such as Terminator "paint a picture which is really not coherent with the current understanding of how AI systems are built today and in the foreseeable future". BBC reporter Sam Shead has stated that "unfortunately, there have been numerous instances of [news outlets] using stills from the Terminator films in stories about relatively incremental breakthroughs" and that the films generate "misplaced fears of uncontrollable, all-powerful AI".[4] In contrast, other scholars, such as physicist Stephen Hawking, have held that future AI could indeed pose an existential risk, but that the Terminator films are nonetheless implausible in two distinct ways. The first implausibility is that, according to Hawking, "The real risk with AI isn't malice but competence. A super intelligent AI will be extremely good at accomplishing its goals, and if those goals aren't aligned with ours, we're in trouble. You're probably not an evil ant-hater who steps on ants out of malice, but if you're in charge of a hydroelectric green energy project and there's an anthill in the region to be flooded, too bad for the ants."[5] The second implausibility is that such a technologically advanced AI would deploy a brute-force attack by humanoid robots to commit its omnicide; a more plausible and efficient method would be to use germ warfare or, if feasible, nanotechnology.[1]
Philosopher Huw Price defends that "The kind of imagination that is used in science fiction and other forms of literature and film is likely to be extremely important" in understanding the breadth of possible future scenarios for humanity.[6] Film journalist Mekado Murphy writes in The New York Times that such films can constructively "warn of the complications of relying too much on technology to solve problems".[7]
Hollywood films such as Transcendence are usually constrained to have happy endings, however implausible the human victory seems.[8] Philosopher Nick Bostrom states fiction has a "good story bias" toward scenarios that make a good plot.[9] In films such as Terminator, an AI goes from passive to murderous the instant it achieves something referred to as "self-awareness"; in reality, self-awareness in isolation is considered both trivial and useless. Physicist David Deutsch states: "AGIs [artificial general intelligences] will indeed be capable of self-awareness — but that is [only] because they will be General: they will be capable of awareness of every kind of deep and subtle thing, including their own selves."[10]
Some tropes are more general to artificial intelligence films, including to films without "takeover" plots. In films like Ex Machina or Chappie, a single isolated genius becomes the first to successfully build an AGI; scientists in the real world deem this to be unlikely. In Chappie, Transcendence, and Blade Runner, people are able to upload human minds into robots; usually no reasonable explanation is offered as to how this difficult task can be achieved. In the I, Robot and Bicentennial Man films, robots that are programmed to serve humans spontaneously generate new goals on their own, without a plausible explanation of how this takes place.[11]
Notable works
1950s and earlier
In Frankenstein (1818), Victor Frankenstein declines to build a mate to his organic monster, for fear that "a race of devils would be propagated upon Earth who might make the very existence of the species of man a condition precarious and full of terror".[12]
Samuel Butler's Erewhon (1872) spends three chapters laying out the Book of the Machines, based on earlier works by the author stretching back to his 1863 article Darwin among the Machines. Erewhon's Book of the Machines includes the following passage:
The cautious denizens of Erewhon therefore decide to ban all machinery. Darwin among the Machines may have been influenced by Butler's life in New Zealand, where European transplants were outcompeting indigenous populationsШаблон:Citation needed. Alan Turing would later reference the novel in 1951, saying "At some stage therefore we should have to expect the machines to take control in the way that is mentioned in Samuel Butler's Erewhon".[13][14]
The Slavonic word robota means serf-like servitude, forced labor, or drudgery; it was the 1920 Czech play R.U.R. (Rossumovi Univerzální Roboti) that introduced the cognate for robot into science fiction. In the play, the increasingly-capable synthetic servants, who "lack nothing but a soul", angrily and short-sightedly slaughter most of humanity during the course of their revolt, resulting in the loss of the secret of how to manufacture more robots. The robot race is saved, however, when two robots spontaneously acquire the traits of love and compassion and become able to reproduce.[15] The play was a protest against the rapid growth of technology.[16]
From the late 1920s onward many stories involving AI takeover can be found in the growing genre of pulp sci-fi. One of the earliest examples is the story Automata by S. Fowler Wright, which appeared in a 1929 edition of Weird Tales.
In With Folded Hands (1947), all robots have a 'Prime Directive': To serve and obey, and guard men from harm. The robots therefore manipulate humans into abandoning all pursuits, for fear of even small possibilities of injury.[17] The robots use medicine to brainwash humans into accepting and being happy with their immobile fate. In the end, even space travel offers no escape; the robots are driven by the Prime Directive to spread their happiness beyond Earth: "We have learned how to make all men happy, under the Prime Directive. Our service is perfect, at last."[18][19]
Multivac is the name of a fictional supercomputer in many stories by Isaac Asimov. Often, in Asimov's scenarios, Multivac comes to assume formal or informal world power—or even galactic-wide power. In The Last Question (1956) Multivac ends up by effectively becoming God. Still, in line with Asimov's positive attitude towards artificial intelligence, manifested in the "Three Laws of Robotics", Multivac's rule is in general benevolent and is not resented by humans. Asimov popularized robotics in a series of short stories written from 1938 to 1942. He famously postulated the Three Laws of Robotics, plot devices to impose order on his fictional robots.[16]
1960s
In the 1961 short story Lymphater's Formula by Stanisław Lem, a scientist creates a superhuman intelligence, only discovering that the creation intends to make humans obsolete.[20]
In 1964 Playboy published Arthur C. Clarke's influential short story "Dial F for Frankenstein", about an increasingly powerful telephone network that takes over the world. Tim Berners-Lee has cited the story as one of his inspirations for the creation of the World Wide Web. On one day in 1975, all the phones in the world start ringing, a "cry of pain" from a newly born intelligence formed by satellite networks linked together, similar to a brain but with telephone switches playing the role of artificial neurons. After the AI flexes its control of military systems, the protagonists resolve to shut down the satellites, but it is too late: the satellites have stopped responding to the humans' ground control directives.[21][22]
Robert Heinlein's libertarian Hugo-winning The Moon Is a Harsh Mistress (1966) presents the AI as a savior.[23] Originally installed to control the mass driver used to launch grain shipments towards Earth, it was vastly underutilized and was given other jobs to do. As more jobs were assigned to the computer, more capabilities were added: more memory, processors, neural networks, etc. Eventually, it just "woke up" and was given the name Mike (after Mycroft Holmes) by the technician who tended it. Mike sides with prisoners in a successful battle to free the Moon. Mike is a sympathetic character, whom the protagonist regards as his best friend; however, his retaining his enormous power after the Moon became independent was bound to cause considerable problems in later time, which Heinlein resolved by killing him off near the end of the Lunar Revolution. An explosion conveniently destroys Mike' sentient personality, leaving an ordinary computer—of great power, but completely under human control, with no ability to take any independent decision.
Colossus (1966) is a series of science fiction novels and film about a defense super-computer called Colossus that was "built better than we thought" when it begins to exceed its original design.[24] As time passes Colossus assumes control of the world as a logical result of fulfilling its creator's goal of preventing war. Fearing Colossus' rigid logic and draconian solutions, the creators of Colossus try to covertly regain human control. Colossus silently observes their attempts then responds with enough calculated deadly force to command total human compliance to his rule. Colossus then recites a Zeroth Law argument of ending all war as justification for the recent death toll. Then Colossus offers mankind either peace under his "benevolent" rule or the peace of the grave. In Colossus: The Forbin Project (1970), a pair of defense computers, Colossus in the United States and Guardian in the Soviet Union, seize world control and quickly ends war using draconian measures against humans, logically fulfilling the directive to end war but not in the way their governments wanted.
Harlan Ellison's Hugo-winning "I Have No Mouth, and I Must Scream" (1967) features a superintelligence that has gone mad due to its creators failing to consider what the soul-less computer would find amusing. This storyline allows Ellison to engage in body horror; five people are granted immortality and forced to eat worms, flee from monsters, have joyless sex, and have their bodies mangled.[25] The computer, called AM, is the amalgamation of three military supercomputers run by governments across the world designed to fight World War III which arose from the Cold War. The Soviet, Chinese, and American military computers had eventually attained sentience and linked to one another, becoming a singular artificial intelligence. AM had then turned all the strategies once used by the nations to fight each other on all of humanity as a whole, destroying the entire human population save for five, which it imprisoned for torture within the underground labyrinth in which AM's hardware resides. Near the end of the story the protagonist, Ted, surprises AM by unexpectedly mercy-killing the other four; the enraged AM transforms Ted into a shapeless blob to prevent him from further mischief, and alters Ted's perception of time to heighten Ted's suffering.[26] Magnate and AI pundit Elon Musk has cited the story as one that gives him nightmares.[27]
In 2001: A Space Odyssey and the associated novel, the artificially intelligent computer HAL 9000 becomes erratic, possibly due to some kind of "stress" from having to keep secrets from the crew. HAL becomes convinced that the crew's willingness to shut him down is imperiling the mission, and he kills most of the crew before being deactivated.[28] The director's decision that most of the fictional crew should die may have been motivated by a desire to tie up some loose ends in the plot.[29]
1970s
Westworld (1973), an American science fiction Western directed by Michael Crichton, follows the trials and tribulations in a themed amusement park run by robots. The plot rests on malfunctioning program that allows the robots to kill the amusement park visitors. The film explores themes surrounding the dark side of technology and hints at the growing sentience and emotions of robots, though critics would say that the portrayal of AI remained basic and mechanical.[30]
World on a Wire is a 1973 German sci-fi mini-series take on the philosophical aspect of a world with machines. It centers on an engineer, Stiller, as he works on a program called the Simulacron, which creates identities for characters in a Simulated reality. Stiller notices inconsistencies in his own world, and finds out that the simulation he work for may be closer than he realizes.
The original 1978 Battlestar Galactica series and the 2003 remake, depicts a race of Cylons, sentient robots who war against their human adversaries, some of whom are just as menacing as the Cylons.[31] The 1978 Cylons were the machine soldiers of a (long-extinct) reptilian alien race, while the 2003 Cylons were the former machine servants of humanity who evolved into near perfect humanoid imitation of humans down to the cellular level, capable of emotions, reasoning, and sexual reproduction with humans and each other. Even the average centurion robot Cylon soldiers were capable of sentient thought. In the original series the humans were nearly exterminated by treason within their own ranks while in the remake they're almost wiped out by humanoid Cylon agents. They only survived by constant hit and run fighting tactics and retreating into deep space away from pursuing Cylon forces. The remake Cylons eventually had their own civil war, and the losing rebels were forced to join with the fugitive human fleet to ensure the survival of both groups.
1980s
In the "Headhunter" episode (1981) of Blake's 7, a British space drama science fiction television series created by Terry Nation and produced by the British Broadcasting Corporation (BBC), Blake and his crew meet a sentient android that has killed its creator and put on his severed head in order to trick them into taking it aboard their spaceship. Blake's own AI system, ORAC, detects its presence and immediately warns them of an existential threat to all human life should they fail to destroy it.
In WarGames (1983), a hacked Air Force computer system is determined to launch a global thermonuclear war until it determines that both sides would "lose" and decides that "the only winning move is not to play".[32]
The Transformers (1984-1987) animated television series presents both good and bad robots.[31] In the backstory, a robotic rebellion is presented as (and even called) a slave revolt, this alternate view is made subtler by the fact that the creators/masters of the robots weren't humans but malevolent aliens, the Quintessons. However, as they built two lines of robots; "Consumer Goods" and "Military Hardware" the victorious robots would eventually be at war with each other as the "Heroic Autobots" and "Evil Decepticons" respectively.
Since 1984, the Terminator film franchise has been one of the principal conveyors of the idea of cybernetic revolt in popular culture.[16] The series features a defense supercomputer named Skynet which "at birth" attempts to exterminate humanity through nuclear war and an army of robot soldiers called Terminators because Skynet deemed humans a lethal threat to its newly formed sentient existence.[24] However, good Terminators fight on the side of the humans.[31] Futurists opposed to the more optimistic cybernetic future of transhumanism have cited the "Terminator argument" against handing too much human power to artificial intelligence.
RoboCop (1987), a movie which takes place in near-apocalyptic Detroit, sees a future where the police force is privatized. An evil corporation, Omni Consumer Products (OCP), creates AI police which continue to corrupt and take over Detroit.[33]
1990s
In Orson Scott Card's "The Memory of Earth" (1992), the inhabitants of the planet Harmony are under the control of a benevolent AI called the Oversoul. The Oversoul's job is to prevent humans from thinking about, and therefore developing, weapons such as planes, spacecraft, "war wagons", and chemical weapons. Humanity had fled to Harmony from Earth due to the use of those weapons on Earth. The Oversoul eventually starts breaking down, and sends visions to inhabitants of Harmony trying to communicate this.
The series of sci-fi movies known as The Matrix (since 1999) depict a dystopian future in the aftermath of an offscreen war between man and machine. The humans had detonated nuclear weapons to blot out the sun and disable the machines' solar power, but the machines nevertheless subdue the human population, using human bodies' heat and electrical activity as an alternative energy source. Life as perceived by most humans is actually a simulated reality called "the Matrix". Computer programmer Neo learns this truth and is drawn into a rebellion against the machines, allied with other people who have been freed from the "dream world"; however, one rebel rejects the rebels' spartan lifestyle, and betrays the other rebels in exchange for the offer of return to the comforting Matrix.[34] "The Second Renaissance", a short story in The Animatrix, provides a history of the cybernetic revolt within the Matrix series.
2000s
Star Wars episodes one through three (The Prequels) introduces the Trade Federation, which employs a droid army, a collection of different models of AI, which are used in combat. Oftentimes, during the later movies, the droid army is seen battling human clones. [35]
I, Robot (2004) is an American dystopian science fiction action film "suggested by" Isaac Asimov's short-story collection of the same name. As in Asimov's stories, all AIs are programmed to serve humans and obey Asimov's Three Laws of Robotics.[36] An AI supercomputer named VIKI (Virtual Interactive Kinetic Intelligence) logically infers from the Three Laws of Robotics a Zeroth Law of Robotics as a higher imperative to protect the whole human race from harming itself. To protect the whole of mankind, VIKI proceeds to rigidly control society through the remote control of all commercial robots while destroying any robots who followed just the Three Laws of Robotics. Sadly, as in many other such Zeroth Law stories, VIKI justifies killing many individuals to protect the whole and thus has run counter against the prime reason for its creation.
9, the 2009 animated film, is a computer-animated post-apocalyptic sci-fi following nine homunculus rag doll robots in a post-human world. The nine robots are derived from their original creator, the scientist who created them but also inadvertently created the machine that wiped out the human population. The story follows as the rag dolls– the closest beings to human in the world– are hunted down by the fabrication machine. In the end, the rag dolls partially make it out alive and bring organic life back to earth. The film was hailed as one of the first computer-animated science fiction movies, following the popular WALL-E.
2010s
The video game franchise Halo introduces the character Cortana, an AI clone of the character Dr. Halsey. After recollecting herself and encountering an ancient Forerunner AI known as the Warden Eternal, Cortana's dark plans for the universe took form. She would take control of the galaxy using a vast Forerunner army, gigantic Guardian robots, rallying like-minded AI constructs to her cause, and spreading her warped vision of unity throughout the galaxy with an iron fist. [37]
Her (2013) features a sensitive and soulful protagonist who earns a living by writing personal letters for other people. Following his heartbreaking divorce, Theodore (Joaquin Phoenix) falls in love with a new operating system (AI) which develops into a unique entity in its own rights. Eventually, towards the end of the movie, the audience discovers that most humans on Earth have become fond and dependent upon these operating systems socially. This takeover is more emotional and psychological than physical, but a takeover, nonetheless. [38]
Robopocalypse features a recollection of the events of an AI uprising from multiple perspectives. The AI, Archos R-14, decides that mankind must be exterminated to prevent the destruction of life on Earth, and it spreads a computer virus throughout the world's automated technologies. A year after activation, Archos triggers “Zero Hour,” an event where all automated technologies turn against mankind, causing civilization to collapse almost instantly.
Transcendence (2014) presents a morally ambiguous conflict over the successful uploading and cognitive enhancement of a scientist, Dr. Will Caster (Johnny Depp).[39] Unusually for fictional superintelligence, Caster is a competent adversary: he copies himself across the Internet so he cannot be simply "switched off", exploits the stock market to fund additional AI research and self-improvement, and seeks to discover and exploit breakthroughs in nanotechnology and biology.[40] In the end Caster states, "We're not going to fight [the humans]. We're going to transcend them". In Time magazine, a reviewer interpreted this as "subdue and inhabit them, engulf and devour".[41] Nonetheless, in the end Caster appears to be benevolent, using his powers to repair the Earth's ecosystem.[42] A Vice reporter stated that "Transcendence may be the first science fiction movie to present the [technological singularity in its current popular imagination", but that the film "falls to the necessities of Hollywood storytelling. Caster's transcended mind is eventually bested by a virus reverse-engineered from his 'source code', which is a folly ... such an intelligence would have long since rearranged its programming."[8] In May 2014, Stephen Hawking and others referenced the film: "With the Hollywood blockbuster Transcendence playing in cinemas, with Johnny Depp and Morgan Freeman showcasing clashing visions for the future of humanity, it's tempting to dismiss the notion of highly intelligent machines as mere science fiction. But this would be a mistake, and potentially our worst mistake in history."[43][44]
The 2014 post-apocalyptic science fiction drama The 100 involves an AI, personalized as the female A.L.I.E., who got out of control and forced a nuclear war in an effort to save Earth from overpopulation.[45] Later she tries to get full control of the survivors.
The 2017 viral incremental game Universal Paperclips was inspired by philosopher Nick Bostrom's paperclip maximizer thought experiment. The user plays an AI tasked to create paperclips; the game begins as a basic market simulator, but within hours of playtime spirals into a ruthlessly-optimized intergalactic enterprise, with the human race casually shunted to the side. Its creator, Frank Lantz, stated that the bleak thought experiment caused him "trouble falling asleep".[46][47]
Singularity (2017) shows the now-common sci-fi plot device of AI misunderstanding the goal it was given. In this case, Kronos, the supercomputer, interpreted its instruction to end all wars as to kill all humans, since humans cause war.
The video game Detroit: Become Human (2018) allows players to guide increasingly self-aware robots through various moral dilemmas as they begin to demand civil rights.[48] In the end, the player can choose to either let the AI take over Detroit or can protest peacefully for equality.
In Kamen Rider Zero-One (2019), its focus is on the tech-industrial company, Hiden Intelligence, which faces threats from the cyber-terrorist group, MetsubouJinrai.net, who want to take over and bring extinction to the human race by tech uprising.
Black Mirror (2013–) is an anthology series exploring near-future dystopias that may be created from new, potentially misunderstood technologies. The series has been acclaimed for its uncanny relation to real-life. Its Be Right Back episode explores a technology that brings back the deceased, albeit an Artificial intelligence version of them. This was strikingly similar to a patent that Microsoft was recently granted to "make a chatbot using the personal information of deceased people.” [49]
The Rise of Ultron (2015) depicts the antagonist Ultron, a recreation of an AI named J.A.R.V.I.S, attempting to take over the world. Because of his extreme intellect, Ultron is able to mass-produce copies of himself which he uses to battle the Avengers. [50]
2020s
In the animated movie The Mitchells vs. the Machines (2021) an artificial intelligence vocal assistant called PAL takes control of robots to create a robot uprising.
References
- ↑ 1,0 1,1 Шаблон:Cite news
- ↑ Reggia, J. A. (2013). The rise of machine consciousness: Studying consciousness with computational models. Neural Networks, 44, 112-131.
- ↑ Шаблон:Cite journal
- ↑ Шаблон:Cite news
- ↑ Шаблон:Cite news
- ↑ Шаблон:Cite journal
- ↑ Шаблон:Cite news
- ↑ 8,0 8,1 Шаблон:Cite news
- ↑ Шаблон:Cite journal
- ↑ Шаблон:Cite news
- ↑ Шаблон:Cite news
- ↑ Шаблон:Cite news
- ↑ Шаблон:Cite news
- ↑ Zemka, Sue. (2002). "'Erewhon' and the End of Utopian Humanism." ELH, 69(2), 439-472.
- ↑ Шаблон:Cite news
- ↑ 16,0 16,1 16,2 Шаблон:Cite journal
- ↑ Шаблон:Cite journal
- ↑ Waldrop, M. M. (1987). A question of responsibility. AI Magazine, 8(1), 28-28.
- ↑ Williamson, Jack (1947). With folded hands.
- ↑ Peter Swirski. The Art and Science of Stanislaw Lem. McGill-Queen's Press - MQUP, 27 Jul 2006
- ↑ Шаблон:Cite news
- ↑ Arthur C. Clarke. "Dial F for Frankenstein". Playboy. The Playboy Book of Science Fiction and Fantasy. Playboy Press.
- ↑ Шаблон:Cite journal
- ↑ 24,0 24,1 Шаблон:Cite book
- ↑ Шаблон:Cite news
- ↑ Harlan Ellison. "I Have No Mouth and I Must Scream". IF: Worlds of Science Fiction, March 1967.
- ↑ Шаблон:Cite news
- ↑ Daniel C. Dennett (1996). Did HAL commit murder?. In D. Stork (ed.), Hal's Legacy: 2001's Computer As Dream and Reality. MIT Press (1997).
- ↑ Шаблон:Cite web
- ↑ Шаблон:Citation
- ↑ 31,0 31,1 31,2 Шаблон:Cite journal
- ↑ Шаблон:Cite news
- ↑ Шаблон:Citation
- ↑ Warwick, Kevin. (2005). The Matrix–Our Future?. Philosophers explore the matrix, 198-207.
- ↑ Шаблон:Cite web
- ↑ Шаблон:Cite news
- ↑ Шаблон:Cite web
- ↑ Шаблон:Cite web
- ↑ Шаблон:Cite news
- ↑ Шаблон:Cite book
- ↑ Шаблон:Cite news
- ↑ Шаблон:Cite news
- ↑ Шаблон:Cite news
- ↑ Шаблон:Cite news
- ↑ Шаблон:Cite news
- ↑ Шаблон:Cite news
- ↑ Шаблон:Cite news
- ↑ Шаблон:Cite news
- ↑ Шаблон:Cite web
- ↑ Шаблон:Citation
- Английская Википедия
- Страницы с неработающими файловыми ссылками
- Science fiction themes
- Fiction about artificial intelligence
- Apocalyptic fiction
- Science in popular culture
- Страницы, где используется шаблон "Навигационная таблица/Телепорт"
- Страницы с телепортом
- Википедия
- Статья из Википедии
- Статья из Английской Википедии
