Galileo's Basilisk [OC]

submitted by
edited

https://hexmhell.writeas.com/galileos-basilisk

This is less related to actually existing “AI” and more about one of the myths (or, ultimately, the constellation of myths) that drives people to work on “AI.” I posted this on Mastodon, but it probably belongs here as well.

10
70

Log in to comment

Hot Top New Old

Hah, nice read.

It’s always been wild to me how the idea of “a future AI threatens incredible suffering if you don’t help it come into existence” sparks “oh, then I better help create the torture-AI” in people, rather than “what the fuck, that’s evil and cruel, let’s make sure this doesn’t come to pass”.

But of course, the Rolo folks start from the notion that this AI is 100% inevitable, at which point… There’s no need to sadistically torture people.

In the same vein as “God can’t be all-powerful and all-good":

The AGI either doesn’t exist, or has no need to torture people.

 reply
14

From your username I assume this is yours?

Good writeup, though some typos (especially in pascal’s wager part, you missed a “not” somewhere that ruins the idea) (and heliocentric, not hellocentric, though probably fine for most people)

I’ll be sharing this with people, thanks!

 reply
9
OP edited

Thank you. Yeah, feedback is always welcome. Between the ADHD and sleep deprivation from having kids, my editing is not the best.

 reply
5

Adding on a constructive criticism:

Even the occasional ability to predict the future, combined with the inability to actually stop it from happening, is a classical unpleasantness attested to by the story of Pandora.

I believe OP meant the story of Cassandra, not Pandora.

Other than that and some typos, though, well argued! Added this to my bookmark hoard.

 reply
5

The author clearly believes our solar system, possibly our universe, circles around the most recent greeting. Thus likely returning us to a geocentric model until alien life is found speaking English? Or will any form of greeting do?

 reply
3
edited

Or the solar system orbits Hell, which maybe implies the Sun is Hell?

 reply
2

This brings us to the price of RAM.

That gave me a good chuckle 😄

Thanks for wading through the Roko nonsense, and even constructing a counter thesis. Time well spent(?)

 reply
7
edited

Oh, also: you should cross-post this to !sneerclub@awful.systems, they will absolutely love this.

 reply
5
OP

Awesome! Done! Thanks for the recommendation. :)

 reply
5

Sure, why not? Any sufficiently advanced technology is indistinguishable from magic, right? So we can just use the logic of magic any time we imagine a sufficiently advanced technology.

Brilliant.

 reply
4
Insert image