Recent comments in /f/singularity

tatleoat t1_jdv4bjz wrote

I think that's probably going to be the first thing that blows up the world order, and I think GPT-4 can pretty much already do it. If you can get an AI to optimize a business to prioritize the workers and the constitution/code is all open sourced so that you know you're not getting boned then we might be able to take these fat cats out sooner rather than later

9

tupper t1_jdv17j1 wrote

Interesting to consider First Contact a slightly cautionary tale of evil AI. Aside from Data (who is ostensibly good, and is only tempted by "evil" for 0.68 seconds!) and the Enterprise E's computer, there are no AI in First Contact!

The Borg aren't strictly AI. While they use cybernetic implants, they operate as a hive mind, with each individual Borg drone connected to and controlled by the central collective consciousness. This central consciousness is characterized multiple times in Trek as an AI-antithetical "Borg Queen" individual, like a beehive. She, again, isn't an AI, but a cybernetically-enhanced biological life form.

They're the archetypical "cybernetic gestalt consciousness" to use some Stellaris-flavored terminology, with the Queen acting as a single-character narrative device to be able to "talk to" the Borg as an individual.

The Borg have some aspects of artificial intelligence, but overall they are more accurately described as gestalt cybernetic organisms— a fusion of biological and technological components living as a single superconciousness— rather than AI.

Heck, Voyager runs into way more straight-up-evil AI than the Enterprise does in First Contact!

1

vernes1978 t1_jduyhfq wrote

So, according to CHATGPT, the AI PINN becomes malevolent, and as a result of this, merges with the mind of Dr. Will Caster.

Like TFenrir, I remember the choice of merging wasn't one made by PINN, but by his Wife.
So, do we tell people like TFenrir they're wrong?
Or fact check the stuff ChatGPT spits out?

I'd put Transcendence under Cautionary Good.
It's where we're unable to accept anything uploaded as the person itself.
Which isn't a problem if it's literately a person controlling a single speaker.
But it becomes a disaster when it's a mindupload with the capacity of growth of an AI.
Unable to accept it's the person but instead an uncaring AI, any growth is seen as a threat.

The Evil AI was always a projection of the observers.

0

QuartzPuffyStar t1_jduy7s3 wrote

They have the potential to learn crosschecking and use wiki audit tools to verify the probability of a wiki article being wrong, and not taking it at face value.

Even when they have trained with wiki as a "very high value source".

At least GPT shows signs of that. Bing just closes the conversations when you ask it to explore beyond the 1st page wiki article that you could have read yourself.

0

Artanthos t1_jduxu1n wrote

I’m not going to fight them, I’m going to transcend them.

Even when attacked, he took the mora high ground instead of killing his attackers.

Everything he did, he did for love. Playing the stock market was a perfectly legitimate means to an end.

He needed money to finance his research, with the end goals of saving the planet from climate change (his wife’s passion) and returning to a biological body.

4