Thinking loudly about networked beings. Commonist. Projektionsfläche. License: CC-BY
2653 stories
·
144 followers

Jussi Pakkanen: Stanisław Lem foretold the current LLM mania in 1964

1 Comment

Some time ago I visited a used book fair and came across this awesome piece of 80s scifi-asthetic.

This book is a collection of short stories by the Polish author Stanisław Lem originally published in 1964. Its English title is The Cyberiad. One story, about Trurl's electronic troubadour, turned out to be surprisingly topical.

Spoilers for the whole story follow

The inventor Trurl (revealed in other stories to be a robot) wants to create a machine that can generate poetry. He begins by obtaining several hundred tonnes of books to use as training data.

Trurl gets to work constructing the electric poetry machine. In the process they have to create massive data storage containers that stretch further out than one can see using binoculars. This is considered a necessary evil to get this great invention going.

The machine will not work as expected. As a last resort Trurl rips out all logic circuits and replaces them with "narsistors". Then things start working.

Trurl invites his friend Klapaucius over to test the new machine. They give it all sorts of weird and wacky instructions like "create a pastoral love poem that also contains mathematics and cybernetics". Basically they do a whole bunch of prompt engineering. They talk and behave exactly like people of 2021-2023 did when LLMs first appeared.

Eventually the machine causes uproar among poets and there are protests demanding it to shut down. These go nowhere in part because the media secretly love the machine. They are using it to create their own content for pennies and thus don't want to see it come to harm. As all of this is going on various people develop symptoms quite similar to modern day AI psychosis.

Things eventually crash when Trurl gets the machine's electrical bill, which turns out to be astronomical. He needs to get rid of the machine and manage to dump it on a visiting dignitary who takes it to his home planet where causes a supernova explosion. Trurl deems that to be sufficiently far away to not be his problem any more.

The difference between fact and fiction

In the story all the problems are caused by the fact that the machine's output is vastly higher quality than anything humans can create. Even the great Stanisław Lem could not predict that in reality the output would turn out to be mediocre garbage and still lead to all the same problems.

Even though the story specifies that the machine is given some "basic instructions" first, nobody tries to do a prompt injection attack on it. That would only appear almost 30 years later in 1993's Paranoia novel Title Deleted for Security Reasons. An earlier example may well exist somewhere, it almost always does.

Read the whole story
tante
9 hours ago
reply
Stanislaw Lem having almost perfect foresight again
Berlin/Germany
Share this story
Delete

Your AGENTS.md file doesn’t actually do anything

2 Comments

AI coding bot vendors tell you to use a context file with instructions for the chatbot on how to edit your project. Claude Code wants a CLAUDE.md, or there’s AGENTS.md in general. [Anthropic]

But does your AGENTS.md do anything? A team at ETH Zurich tested AGENTS files. They ran the bots over some test projects with and without AGENTS.md: [arXiv, PDF; presentation, video]

Surprisingly, we find that providing context files does not generally improve task success rates, while increasing inference cost by over 20% on average. This observation holds across different LLMs, coding agents, and for both LLM-generated and developer-committed context files.

A chatbot-generated AGENTS file makes the coding agent succeed at coding tasks about as well as having no AGENTS file — or slightly worse. A human-written AGENTS file gives slightly better success rates, but not much better.

Having an AGENTS.md increases the token cost quite a lot — whether the file is chatbot-generated or human-written. (Anthropic probably considers this a feature.) The bot churns through more stuff, but it’s no more likely to finish your task successfully.

Overviews of the file structure of the code repository are not useful to the agent. They don’t help the bot get on with editing the listed files any faster.

Does the AGENTS file do anything? If you mention particular tools in the AGENTS file, the coding agent will use them more often. That’s about it.

So when Anthropic recommended CLAUDE.md, they clearly didn’t measure if the instruction file actually does anything. They just chucked it in as a magical incantation you can invoke so you can hope the robot gets it right. This time. At least you might feel like you’re doing something.

This is very like how Anthropic writes Claude Code, which is mostly a pile of magical incantations telling the robot not to screw up yet again. Anthropic doesn’t know any other way to steer the bot.

The researchers’ recommendation: keep the instructions short. Be minimal. Or, of course, you could write a nice long file and chug through those tokens!

The closest anyone can come to a use for the AGENTS.md file is so you clarify your own thinking on how the project works, One developer on Reddit said: [Reddit, archive]

The actual token-level context it provides matters less than the fact that writing it forces you to articulate things about your codebase that were previously just in your head.

Yeah, that’s what we used to call writing. Be right back, just starting the project wiki. I call it HUMANS.md.

Read the whole story
tante
3 days ago
reply
Researchers at ETH Zurich show that "Agents.md" files don't do much. "AI" is cosplay all the way down.
Berlin/Germany
Share this story
Delete
1 public comment
jepler
2 days ago
reply
BRB writing the word "DEVELOPERS" repeated 112 times in AGENT.md
Earth, Sol system, Western spiral arm

AI agents meant to replace Meta workers made “large-scale, disruptive actions”

1 Comment

Earlier this year, Meta created a “plan” to reduce some of its teams by as much as 60 percent to make the company “AI native,” Reuters reported today, citing two people familiar with Meta’s internal affairs.

Reuters’ report highlights the challenges organizations face when analyzing the best uses for AI and determining when the technology is a better fit for certain tasks than employees.

Meta confirmed to Reuters that the plan, reportedly codenamed Project OT (short for organization transformation), explored scenarios in which Meta reduced some team headcounts by 60 percent and that the plan called for two rounds of layoffs. Meta wouldn’t confirm which teams Project OT affected.

Read full article

Comments



Read the whole story
tante
4 days ago
reply
"Internal posts also reportedly pointed to AI agents making “large-scale, disruptive actions that humans are unlikely to execute” and leading to a 40 percent increase in major technical and security incidents compared to the prior year. Employee time spent resolving those problems increased by as much as 70 percent."

Meta doing the whole FAFO thing.
Berlin/Germany
Share this story
Delete

Doku “Crypto-Hype – Milliardenfalle Memecoins”

1 Comment

So ganz ist der Crypto Betrug ja nie weggegangen, er hat sich nur verschoben. Heute vor allem hin zur Bestechungsmethode für die US Regierung und illegales Glücksspiel (“Prediction Markets”). Aber vor einigen Monaten wurde ich doch nochmal zu einem Crypto Thema interviewed. Es geht dieses mal vor allem um die Memecoins.

Man kann sich den ganzen Film in der ZDF Mediathek anschauen:

https://www.zdf.de/video/dokus/zdfinfo-world-wide-cybercrime-100/zdfinfo-world-wide-cybercrime-crypto-hype-milliardenfalle-memecoins-100

Read the whole story
tante
5 days ago
reply
Ich wurde für einen Dokumentarfilm über Memecoins interviewed.
Berlin/Germany
Share this story
Delete

Von Kindern lernen: Hört den Jungen zu!

1 Comment
Wer heute mit Kindern und Jugendlichen spricht, dürfte erstaunt und erschrocken sein. Denn sie fühlen sich von Erwachsenen nicht wahrgenommen. mehr...
Read the whole story
tante
5 days ago
reply
"Wer möchte, dass junge Menschen zuhören, muss zuerst ihnen zuhören."
Berlin/Germany
Share this story
Delete

Was wäre wenn in Sachsen-Anhalt: KI-Bilder sollen Parteipläne sichtbar machen

1 Comment

Wer keine Lust auf dicke Wahlprogramme hat: KI-Bilder sollen zeigen, wie sich die Parteien das Land wünschen, und so für Gesprächsstoff sorgen.

Read the whole story
tante
6 days ago
reply
Habe mir diese "KI"-generierten Bilder zu Parteiprogrammen mal angeschaut. Okay Slop, aber auch wirklich 0 Aussagekraft. What a waste of time.
Berlin/Germany
Share this story
Delete
Next Page of Stories