Intuitive explanation of Roko’s basilisk

2013-09-17 in AI/Rationality | 14 comments

WARNING: Learning about the following idea is strongly discouraged. Known adverse effects are serious psychological distress, infinite torture, and convulsive laughter.

Roko’s basilisk

Tags: artificial general intelligence, Roko's Basilisk

Vanzetti

I find it very ironic that the allegedly rational community of lesswrong chose to pascal-wager themselves so hard…
Pingback: Alexander Kruel · Roko’s Basilisk: Everything you need to know()
Dave Kinard

Haha. BUT WHICH SINGULARITY GOD IS THE CORRECT ONE? SHOULD I SPEND MY LIFE MAKING PAPERCLIPS? AHHHHHH! (Brain explodes- just like the AI planned- duh duh duh)
Xagor et Xavier

They’re rational in the sense of following utilitarianism to its endpoint. (This is why Pascal’s wager poses such a problem.)

It would be even more ironic if they’re committing the same error they fear AIs would: namely, to take a simple defined goal function or system and be led astray by taking it to its ultimate conclusion.
Pingback: Alexander Kruel · New Rationalism: An Introduction()
Pingback: New Rationalism: An Introduction | TiaMart Blog()
Pingback: New Rationalism: An Introduction | JanNews Blog()
Pingback: Alexander Kruel · Making Roko’s basilisk more persuasive()
Pingback: Alexander Kruel · Eliezer Yudkowsky: Friendly AI torturing people has probability ~0()
Pingback: Eliezer Yudkowsky: Pleasant AI torturing individuals has chance ~zero | JanNews Blog()
Pingback: Eliezer Yudkowsky: Friendly AI torturing people has probability ~0 | Xcuz Me()
Pingback: Making Roko’s basilisk more persuasive | Xcuz Me()
Pingback: New Rationalism: An Introduction | Xcuz Me()
dirkbruere

Well, I am doing all I can to create the Basilisk, so I’m OK. Can you all say the same?

Alexander Kruel

Intuitive explanation of Roko’s basilisk

About me

Disclaimer