Intuitive explanation of Roko’s basilisk

2013-09-17 in MIRI/LW | 11 comments

WARNING: Learning about the following idea is strongly discouraged. Known adverse effects are serious psychological distress, infinite torture, and convulsive laughter.

Roko’s basilisk

Further reading:

Tags: artificial general intelligence, Eliezer Yudkowsky, lesswrong, Machine Intelligence Research Institute, Roko's Basilisk

Vanzetti

I find it very ironic that the allegedly rational community of lesswrong chose to pascal-wager themselves so hard…
Pingback: Alexander Kruel · Roko’s Basilisk: Everything you need to know
Dave Kinard

Haha. BUT WHICH SINGULARITY GOD IS THE CORRECT ONE? SHOULD I SPEND MY LIFE MAKING PAPERCLIPS? AHHHHHH! (Brain explodes- just like the AI planned- duh duh duh)
Xagor et Xavier

They’re rational in the sense of following utilitarianism to its endpoint. (This is why Pascal’s wager poses such a problem.)

It would be even more ironic if they’re committing the same error they fear AIs would: namely, to take a simple defined goal function or system and be led astray by taking it to its ultimate conclusion.
Pingback: Alexander Kruel · New Rationalism: An Introduction
Pingback: New Rationalism: An Introduction | TiaMart Blog
Pingback: New Rationalism: An Introduction | JanNews Blog
Pingback: Alexander Kruel · Making Roko’s basilisk more persuasive
Pingback: Alexander Kruel · Eliezer Yudkowsky: Friendly AI torturing people has probability ~0
Pingback: Eliezer Yudkowsky: Pleasant AI torturing individuals has chance ~zero | JanNews Blog
Pingback: Eliezer Yudkowsky: Friendly AI torturing people has probability ~0 | Xcuz Me

Alexander Kruel

Intuitive explanation of Roko’s basilisk

About me