The last few years have been hard as someone who is not only very much engaged with technologies, their applications, damages and affordances as well as their politics. We’ve been moving through hype cycle after hype cycle with increasing promises at increasing speeds. Which is somewhat natural of course: Being built not around something material, something real, but around a “world-changing narrative” is what defines a hype.
There is the reliance on experts, the hope that they’ll call out what’s going on, point the finger at the issues at hand. But that all only works when there is working journalism that translates and transplants those critiques into the mainstream discourse. Because how else are normal people supposed to be able to have any opinion on how the world is being influenced and reshaped?
I’m not saying that there is no great tech journalism. I am a very happy 404media subscriber for example and there are other sources of great or at least good journalism about tech (when I write “tech” I don’t just mean that as shorthand for “technology” but as a signifier for the digital-technology-industrial-political complex built around Silicon Valley ideology and companies). But the issue is that “technology” is no longer a journalistic vertical, it’s horizontal. Which is a big problem.
There has been this shift (and I am not knowledgeable enough to be able to point at the exact time frame) towards equating “progress” with “technological innovation and development”: Society is moving forward if tech produces more shit. If you’ve heard me talk you might have picked up on me mentioning that today’s vision of the future is just a thinner iPad every few months.
But if “progress” – which is a political term about values that one aims to manifest or express or expand in the world – is just replaced with following PR messages about whatever tech wants to sell next, that does not only make the space of possible futures paperthin, it also puts massive amounts of power into tech’s hands. And I don’t just mean economic and political power (which is also true and needs to change massively, rapidly and aggressively) in this context I mean narrative power.
Let’s look at the last few months. “AI” labs keep releasing basically unsourced accounts about how their stochastic language models are “hacking” or how they are “solving hard math problems”. And sure those would be – if they were true – very important developments. But are we having actual conversations about it outside of very niche circles?
You can use LLMs to run attacks on infrastructure. That’s obvious. A lot of code and howtos describing how to attack services and programs is in the training data so getting an LLM to emit something that might even manage to break into a system isn’t surprising, especially if your are a frontier “AI” lab and can burn more money than god on those experiments. We’ve had exploit frameworks for decades and this just adds to it: A well-funded security researcher can use a string generator to do a more advanced form of fuzzing attack on some service. That is 100% real and does change the threat model of everyone on the internet a bit. But it’s not “OMG AnthrOpenAI’s AI is hacking teh world, Skynet is near!!111”. But that’s where the discourse lands. Because it’s profitable: “AI” Labs can keep their narrative of their LLM having magic powers intact in order to attract more funding to fill the hole in their balance sheet. “Experts” can hit that drum to get invitations to interviews and panels and keynotes about how very scared everyone needs to be.
We end up with everybody scared and badly informed. Because those “AI” models do not plan to hack shit. They don’t do anything without someone prompting them to do something. The issue is that those systems – being stochastic in nature – might go totally off the rails and break something. Or do something interesting. Or just waste a few thousand kWh of energy on nothing really. It’s unpredictable.
But not unpredictable in the way that the discourse these days implies. These systems are not “intelligent”, are not scheming or planing or doing something alien beyond our comprehension. If hooked up to the ability to run code they will run some generated code. Some of it will be absolute garbage and not run, but if the prompt and the moon phase align they might also get to exploit some bug in some – potentially vibe-coded and unreviewed – piece of software.
And that is what’s so toxic about the discourse: We are letting those labs and the boosters of the current hype technology get off the hook without even one relevant question.
Take the recent conversations about how ‘”AI” might kill us all with a 10% possibility’. That’s what a leading person at Anthropic says. And is being reported not as “look, a crank from a weird rationalist cult showed his ass again” but as “Anthropic warns: AI might kill us all”. What the hell are we doing? How can you interview a person who says that and not go *record scratch* “so, you are telling me that your stochastic language model could kill us all with a significant chance and you are still developing it? Are you psychotic?” before going into actually questioning how a synthetic text extruder reasonably would do that.
But tech is progress, tech is the future. So we have to take tech leaders’ mental breakdowns as gospel.
Sure, one can have interviews with OpenAI or Anthropic people about whatever story they are telling us. But you do not need to be an expert to ask: “Okay, but does that even make sense?” You just need a spark of mistrust in authority. And that’s a thing we lost.
We put all our eggs into the tech basket hoping that GoogleAmazonMetaAppleAndWhoeverelse could technologize our problems away. And I am increasingly convinced that the lack of critical analysis of their statements is not just about the many economic pressures that journalists have to operate under, the brutal schedules that allow little time for reflection and thinking. I think that many are scared.
Not scared of what some random technological artifact might do. But scared about challenging tech as the dominant mode of making the future. As soon as you stop taking Dario Amodei or Sam Altman or one of those other unpleasant people serious, you have to start asking yourself where to get your future now. As soon as you stop believing that you need to take Anthropic rationalists or weird freaks working at Meta serious you have to challenge the dominant narrative of tech being the well of progress and future.
And that is scary, I understand that. It would be really easy if every 5 or so years we could just ask some random white boy who went through y-combinator or so about what the future is and just run with it. Okay. Metaverse. Really? If you say so… Oh, Metaverse was not it? Okay, now it’s chatbots. Surely this time it’s gonna be fan-fucking-tastic.
We can spend our limited time on this earth hoping that serial liars like Sam Altman or Elon Musk or whatever their names are surely will not screw us. Or we can go and rediscover the spark of challenging those narratives of the powerful. We have no time to keep idling around in their hellscapish dreams and visions. We need to challenge them. Find better, humane, convivial narratives and need to work towards manifesting them.
And one of the most important things to do is to stop letting those LLM-brainwormed men keep talking about what their magic chatbots will do without challenging their psychotic behavior. If someone really believes that their invention will probably kill humankind and they still happily take their fat paycheck and keep building it, keep demanding more and more resources for that, that person should be forced to have a few months of intense therapy before we let them out into the world again.
Think about a person who works on developing chemicals basically saying: “Yeah we’re just throwing random stuff together. There’s at least a 10% chance that – since we don’t really do any security – we might poison everyone, but please give me all the money you had planned to give to hospitals. KTHXBYE.” The world we currently live in is the one where we respond with “Sure Mr. Altman. Here’s also all the money we wanted to spend on schools.”
That is not a world we should want to be in. Should allow anyone to keep us in. And opening a portal to a better world sounds hard, but the walls between potential worlds are basically just in our heads. We just need to start by breaking the chokehold tech has on the discourse. The spark is still there in each and every one of us.





