Intuitive explanation of Roko’s basilisk

2013-09-17 in AI/Rationality | 17 comments

WARNING: Learning about the following idea is strongly discouraged. Known adverse effects are serious psychological distress, infinite torture, and convulsive laughter.

(Note: Interpret this as a completely made up invention of my own which does not necessarily has anything to do with other versions or concepts named ‘Roko’s basilisk’ or anyone named Roko.)

 

Roko’s basilisk

Tags: artificial general intelligence, Roko's Basilisk

1. 

   Vanzetti on 2013-09-17 at 19:56

   I find it very ironic that the allegedly rational community of lesswrong chose to pascal-wager themselves so hard…

2. Pingback from Alexander Kruel · Roko’s Basilisk: Everything you need to know on 2013-09-18 at 11:54

3. 

   Dave Kinard on 2013-11-30 at 13:05

   Haha. BUT WHICH SINGULARITY GOD IS THE CORRECT ONE? SHOULD I SPEND MY LIFE MAKING PAPERCLIPS? AHHHHHH! (Brain explodes- just like the AI planned- duh duh duh)

4. 

   Xagor et Xavier on 2014-02-11 at 21:43

   They’re rational in the sense of following utilitarianism to its endpoint. (This is why Pascal’s wager poses such a problem.)

   It would be even more ironic if they’re committing the same error they fear AIs would: namely, to take a simple defined goal function or system and be led astray by taking it to its ultimate conclusion.

5. Pingback from Alexander Kruel · New Rationalism: An Introduction on 2014-06-08 at 10:56

6. Pingback from New Rationalism: An Introduction | TiaMart Blog on 2014-06-08 at 18:59

7. Pingback from New Rationalism: An Introduction | JanNews Blog on 2014-06-09 at 15:00

8. Pingback from Alexander Kruel · Making Roko’s basilisk more persuasive on 2014-06-23 at 12:57

9. Pingback from Alexander Kruel · Eliezer Yudkowsky: Friendly AI torturing people has probability ~0 on 2014-06-26 at 17:20

10. Pingback from Eliezer Yudkowsky: Pleasant AI torturing individuals has chance ~zero | JanNews Blog on 2014-06-30 at 01:10

11. Pingback from Eliezer Yudkowsky: Friendly AI torturing people has probability ~0 | Xcuz Me on 2014-07-18 at 08:58

12. Pingback from Making Roko’s basilisk more persuasive | Xcuz Me on 2014-08-26 at 22:57

13. Pingback from New Rationalism: An Introduction | Xcuz Me on 2014-09-08 at 20:58

14. 

    dirkbruere on 2015-01-23 at 19:07

    Well, I am doing all I can to create the Basilisk, so I’m OK. Can you all say the same?

15. 

    istvan on 2015-01-27 at 01:28

    What if someone else is faster and they build a different Basilisk that will have different values and will torture those who participate in creating any Basilisk that uses acausal blackmail?
    The people who create this Basilisk may do so because the prospect of this Basilisk being realized can be used as a way to prevent people from being afraid of the original Basilisk.
    You see, you can imagine all sorts of Basilisks. Even irrational ones that don’t respond to reasoning. Ones that torture everyone, for example.

16. 

    dirkbruere on 2015-01-27 at 10:35

    If we live in a multiverse, then somewhere everything happens. Only the probabilities are different.

17. 

    Shesell on 2015-05-28 at 22:05

    Yeah..I think ya’ll have too much time on your hands.

Comments are now closed.