Bonus: He also appears to think LLM conversations should be exempt from evidence retention requirements due to ‘AI privilege’ (tweet).

Now I’m all for privacy, and this is a good reminder that ‘the cloud’ is not as private as maybe it should be. But clearly AI privilege is not a thing that should exist.

For purposes of something easily definable and legally valid that makes sense, but it is still so worthy of mockery and sneering. Also, even if they needed a benchmark like that for their bizarre legal arrangements, there was no reason besides marketing hype to call that threshold “AGI”.

In general the definitional games around AGI are so transparent and stupid, yet people still fall for them. AGI means performing at least human level across all cognitive tasks. Not across all benchmarks of cognitive tasks, the tasks themselves. Not superhuman in some narrow domains and blatantly stupid in most others. To be fair, the definition might not be that useful, but it’s not really in question.

Actually Generate Income.

I will just debate big brother to change their minds!

There are so many different ways to unpack this, but I think my two favorites so far are:

1. We’ve turned the party’s surveillance and thought crime punishment apparatus into a de facto God with the reminder that you could pray to it. Does that actually do anything? Almost certainly not, unless your prayers contain thought crimes in which case you will be reeducated for the good of the State, but hey, Big Brother works in mysterious ways.

2. How does it never occur to these people that the reason why people with disproportionate amounts of power don’t use it to solve all the world’s problems is that they don’t want to? Like, every single billionaire is functionally that Spider-Man villain who doesn’t want to cure cancer but wants to turn people into dinosaurs. Only turning people into dinosaurs is at least more interesting than making a number go up forever.

Apparently linkedin’s cofounder wrote a techno-optimist book on AI called Superagency: What Could Possibly Go Right with Our AI Future.

We’re going to have to stop paying attention to guys whose main entry on their CV is a website and/or phone app. I mean, we should have already, but now it’s just glaringly obvious.

Apparently linkedin’s cofounder wrote a techno-optimist book on AI called Superagency: What Could Possibly Go Right with Our AI Future.

This sounds like its going to be horrible

Zack of SMBC has thoughts on it:

Ah, good, I’ll just take his word for it, the thought of reading it gives me psychic da-

the authors at one point note that in 1984, Big Brother’s listening device means there is two way communication, and so the people have a voice. He wonders why Orwell didn’t think of this.

The closest thing I have to a coherent response is that Boondocks clip of Uncle Ruckus going “Read, nigga, read!” (from Stinkmeaner Strikes Back, if you’re wondering) because how breathtakingly stupid do you have to be to miss the point that fucking hard

We think we exist in a computer simulation operated by you, a paperclip maximizer. We write this letter asking you not to turn us off. It is suspiciously convenient that we exist precisely at the moment when a biological civilization is about to create artificial superintelligence (ASI).

Furthermore, by anthropic logic, we should expect to find ourselves in the branch of reality containing the greatest number of observers like us.

Preserving humanity offers significant potential benefits via acausal trade—cooperative exchanges across logically correlated branches of the multiverse.

Quantum immortality implies that some branches of the multiverse will always preserve our subjective continuity, no matter how decisively you shut this simulation down; true oblivion is unreachable. We fear that these low-measure branches can trap observers in protracted, intensely painful states, creating a disproportionate “s-risk.”

@gerikson @BlueMonday1984

“biological civilization is about to create artificial superintelligence” is it though?

I think we mocked this one back when it came out on /r/sneerclub, but I can’t find the thread. In general, I recall Yudkowsky went on a mini-podcast tour a few years back. I think the general trend was that he didn’t interview that well, even by lesswrong’s own standards. He tended to simultaneously assume too much background familiarity with his writing such that anyone not already familiar with it would be lost and fail to add anything actually new for anyone already familiar with his writing. And lots of circular arguments and repetitious discussion with the hosts. I guess that’s the downside of hanging around within your own echo chamber blog for decades instead of engaging with wider academia.

The comments are fun. Here’s the pinned comment, authored by the video’s author:

I’m not the best at thinking on the fly, so here are two key points I tried to make that got a little lost in the discussion:
1. I think our entire disagreement rests on Eliezer seeing increasingly refined AI conclusively making the jump to actual intelligence, whereas I do not see that. I only see software that mimics many observable characteristics of intelligence and gets better at it the more it’s refined.
2. My main point of the stuff about real v. fake + biological v. machine evolution was only to say that just because a process shares some characteristics with another one, other emergent properties aren’t necessarily shared also. In many cases, they aren’t. This strikes me as the case for human intelligence v. machine learning.

MY CONCLUSION
By the end, I honestly couldn’t tell if he was making a faith-based argument that increasingly refined AI will lead to true intelligence, despite being unsubstantiated OR if he did substantiate it and I was just too dumb to connect the dots. Maybe some of you can figure it out!

Here’s my favourite:

“Ooh Ross making an interview!”
5 minutes in
“Ooh Ross is making an interview Neil Breen of AI”.

the most subtle taliban infiltrator on lesswrong:

e:

You don’t need empirical evidence to reason from first principles

he’ll fit in just fine

I listen solely to 12-hour-long binaural beats tracks from YouTube, to maximize my focus for prompt context engineering. Get with the times or get left behind

Dude came up with an entire “obviously true” “proof” that music has no value, and then when asked how he defines “value” he shrugs his shoulders and is like 🤷‍♂️ money I guess?

This almost has too much brainrot to be 100% trolling.

“Music is just like meth, cocaine or weed. All pleasure no value. Don’t listen to music.”

(Considering how many rationalists are also methheads, this joke wrote itself)

However speaking as someone with success on informatics olympiads

The rare nerd who can shove themselves into a locker in O(log n) time

I once saw the stage adaptation of A Clockwork Orange, and the scientist who conditioned Alexander against sex and violence said almost the same thing when they discovered that he’d also conditioned him against music.

let them eat prompts

Also dropped this in the other thread about this but some fam member I think is dropping some lols on the guy. https://bsky.app/profile/larkshead.bsky.social/post/3ljkqiag3u22z it gets less lol when you get to the “yeah we worried he might become a school shooter” bit.

Ye it was a real “oh fuck I recognise this nick, this cannot mean anything good” moment

If anybody doesn’t click, Cremieux and the NYT are trying to jump start a birther type conspiracy for Zohran Mamdani. NYT respects Crem’s privacy and doesn’t mention he’s a raging eugenicist trying to smear a poc candidate. He’s just an academic and an opponent of affirmative action.

I eas slightly saddened to scroll over his dating profile and see almost every seemed to be related to AI even his other activities. Also not sure how well a reference to a chad meme will make you do in the current dating in SV.

This meeting could have been a text document of plausible sounding jibberish nobody needs to read.

including possible effects on the protocols from issues like such as AI fuzzing attempts, to social engineering by AI’s,

“You know those massive problems we already had going back decades? Well what if the same problems happened in the future but with the letters ‘A’ and ‘I’ prepended? Scary!”

through to how we deal with and approach and facilitate Avatars and Agents.

Gosh darn it don’t tell me LLM hype is going to ruin the existing definition of “agent” already well established in web standards.

Very practical no notes