|Artificial intelligence: is the ability to recognize artificial systems, patterns and redundancies, to complete incomplete sequences, to re-formulate and solve problems, and to estimate probabilities. This is not an automation of human behavior, since such an automation could be a mechanical imitation. Rather, artificial systems are only used by humans to make decisions, when these systems have already made autonomous decisions._____________Annotation: The above characterizations of concepts are neither definitions nor exhausting presentations of problems related to them. Instead, they are intended to give a short introduction to the contributions below. – Lexicon of Arguments. |
Stephen Omohundro on Artificial Intelligence - Dictionary of Arguments
Brockman I 24
Artificial Intelligence/robots/Omohundro: Problem: intelligent entities must act to preserve their own existence. This tendency has nothing to do with a self-preservation instinct or any other biological notion; it’s just that an entity cannot achieve its objectives if it’s dead. According to Omohundro’s argument, a superintelligent machine that has an off switch - which some, including Alan Turing himself, in a 1951 talk on BBC Radio 3, have seen as our potential salvation - will take steps to disable the switch in some way.(1)
Thus we may face the prospect of superintelligent machines - their actions by definition unpredictable by us and their imperfectly specified objectives conflicting with our own - whose motivations to preserve their existence in order to achieve those objectives may be insuperable.
Vs: cf. >AI/Hawkins; >AI/Stuart Russell.
1. Omohundro, ‘The Basic AI Drives,” in Proceedings of the First AGI Conference, 171; and in R Wang, B. Goertzel, and S. Franklin, ed.,Artificial General Intelligence (Amsterdam, The Netherlands: lOS Press, 2008).
Russell, Stuart J. „The Purpose put into the Machine”, in: Brockman, John (ed.) 2019. Twenty-Five Ways of Looking at AI. New York: Penguin Press._____________Explanation of symbols: Roman numerals indicate the source, arabic numerals indicate the page number. The corresponding books are indicated on the right hand side. ((s)…): Comment by the sender of the contribution. The note [Author1]Vs[Author2] or [Author]Vs[term] is an addition from the Dictionary of Arguments. If a German edition is specified, the page numbers refer to this edition.
Possible Minds: Twenty-Five Ways of Looking at AI New York 2019