|Ethics, philosophy: ethics is concerned with the evaluation and justification of actions and ultimately a justification of morality. See also good, values, norms, actions, deontology, deontological logic, consequentialism, morals, motives, reasons, action theory._____________Annotation: The above characterizations of concepts are neither definitions nor exhausting presentations of problems related to them. Instead, they are intended to give a short introduction to the contributions below. – Lexicon of Arguments. |
Eliezer Yudkowsky on Ethics - Dictionary of Arguments
Bostrom I 259
Ethics/morality/superintelligence/Yudkowsky: Yudkowsky has proposed that a seed AI be given the final goal of carrying out humanity’s “coherent extrapolated volition” (CEV), which he defines as follows:
Def CEV/Yudkowsky: Our Coherent Extrapolated Volition is our wish if we knew more, thought faster, were more the people we wished we were, had grown up farther together; where the extrapolation converges rather than diverges, where our wishes cohere rather than interfere; extrapolated as we wish that extrapolated, interpreted as we wish that interpreted.
((s)VsYudkowsky: (1) Here the tacit assumption is made that moral decisions are subject to progress.
(2) Moral decisions should not be made dependent on majorities.
(3) The demand for convergence of communities ignores the right to individual autonomy.
>Ethics/superintelligence/Bostrom._____________Explanation of symbols: Roman numerals indicate the source, arabic numerals indicate the page number. The corresponding books are indicated on the right hand side. ((s)…): Comment by the sender of the contribution. Translations: Dictionary of Arguments The note [Concept/Author], [Author1]Vs[Author2] or [Author]Vs[term] resp. "problem:"/"solution:", "old:"/"new:" and "thesis:" is an addition from the Dictionary of Arguments. If a German edition is specified, the page numbers refer to this edition.
Superintelligence. Paths, Dangers, Strategies Oxford: Oxford University Press 2017