Architeuthis @ Architeuthis @awful.systems

It's not always easy to distinguish between existentialism and a bad mood.

---

Read more

Posts

10

Comments

322

Joined

2 yr. ago

I can never tell, is there an actual 'experiment' taking place with an LLM-backend agent actually trying stuff on a working vm or are they just prompting a chatbot to write a variation of a story (or ten, or a million) about what it might have done given these problem parameters?

I mean, you could have answered by naming one fabled new ability LLM's suddenly 'gained' instead of being a smarmy tadpole, but you didn't.

What new AI abilities, LLMs aren't pokemon.

Slate Scott just wrote about a billion words of extra rigorous prompt-anthropomorphizing fanfiction on the subject of the paper, he called the article When Claude Fights Back.

Can't help but wonder if he's just a critihype enabling useful idiot who refuses to know better or if he's being purposefully dishonest to proselytize people into his brand of AI doomerism and EA, or if the difference is meaningful.

edit: The claude syllogistic scratchpad also makes an appearance, it's that thing where we pretend that they have a module that gives you access to the LLM's inner monologue complete with privacy settings, instead of just recording the result of someone prompting a variation of "So what were you thinking when you wrote so and so, remember no one can read what you reply here". Que a bunch of people in the comments moving straight into wondering if Claude has qualia.

Rationalist debatelord org Rootclaim, who in early 2024 lost a $100K bet by failing to defend covid lab leak theory against a random ACX commenter, will now debate millionaire covid vaccine truther Steve Kirsch on whether covid vaccines killed more people than they saved, the loser gives up $1M.

One would assume this to be a slam dunk, but then again one would assume the people who founded an entire organization about establishing ground truths via rationalist debate would actually be good at rationally debating.

It's useful insofar as you can accommodate its fundamental flaw of randomly making stuff the fuck up, say by having a qualified expert constantly combing its output instead of doing original work, and don't mind putting your name on low quality derivative slop in the first place.

And all that stuff just turned out to be true

Literally what stuff, that AI would get somewhat better as technology progresses?

I seem to remember Yud specifically wasn't that impressed with machine learning and thought so-called AGI would come about through ELIZA type AIs.

In every RAG guide I've seen, the suggested system prompts always tended to include some more dignified variation of "Please for the love of god only and exclusively use the contents of the retrieved text to answer the user's question, I am literally on my knees begging you."

Also, if reddit is any indication, a lot of people actually think that's all it takes and that the hallucination stuff is just people using LLMs wrong. I mean, it would be insane to pour so much money into something so obviously fundamentally flawed, right?

If you never come up with a marketable product you can remain a startup indefinitely.

Getting Trump reelected should count as 'billionaire philanthropy'.

thinkers like computer scientist Eliezer Yudkowsky

That's gotta sting a bit.

promise me you’ll remember me

I'm partial to Avenge me! as last words myself.

Nabokov's Lolita really shouldn't be pigeonholed as merely that, but I guess the movies are another story.

Dolores in Lolita was like twelve though, at least in the book.

edit: also I don't think Yud recommending The Softcore Adventures Of A Six-year-old In A Thirteen-year-old's Body as a Very Normal Book to his considerable audience fits this particular discourse.

In case anybody skips the article, it's a six year old cybernetically force grown to the body of a horny 13 to 14 year old.

The rare sentence that makes me want to take a shower for having written it.

...with a huge chip on his shoulder about how the system caters primarily to normies instead of specifically to him, thinks he has fat-no-matter-what genes and is really into rape play.

The old place on reddit has a tweet up by aella where she goes on a small evo-psych tirade about how since there's been an enormous amount of raid related kidnapping and rape in prehistory it stands to reason that women who enjoyed that sort of thing had an evolutionary advantage and so that's why most women today... eugh.

I wonder where the superforecasters stand on aella being outed as a ghislain maxwell type fixer for the tescreal high priesthood.