4w ago

Stubsack: weekly thread for sneers not worth an entire post, week ending 15th June 2025

awful.systems Stubsack: weekly thread for sneers not worth an entire post, week ending 8th June 2025 - awful.systems

Need to let loose a primal scream without collecting footnotes first? Have a sneer percolating in your system but not enough time/energy to make a whole post about it? Go forth and be mid: Welcome to the Stubsack, your first port of call for learning fresh Awful you’ll near-instantly regret. Any awf...

Any awful.systems sub may be subsneered in this subthread, techtakes or no.

If your sneer seems higher quality than you thought, feel free to cut’n’paste it into its own post — there’s no quota for posting and the bar really isn’t that high.

The post Xitter web has spawned soo many “esoteric” right wing freaks, but there’s no appropriate sneer-space for them. I’m talking redscare-ish, reality challenged “culture critics” who write about everything but understand nothing. I’m talking about reply-guys who make the same 6 tweets about the same 3 subjects. They’re inescapable at this point, yet I don’t see them mocked (as much as they should be)
Like, there was one dude a while back who insisted that women couldn’t be surgeons because they didn’t believe in the moon or in stars? I think each and every one of these guys is uniquely fucked up and if I can’t escape them, I would love to sneer at them.

(Credit and/or blame to David Gerard for starting this.)

102 comments

Bringing over aio's comment from the end of last week's stubsack:
This week the WikiMedia Foundation tried to gather support for adding LLM summaries to the top of every Wikipedia article. The proposal was overwhelmingly rejected by the community, but the WMF hasn't gotten the message, saying that the project has been "paused". It sounds like they plan to push it through regardless.
Way down in the linked wall o' text, there's a comment by "Chaotic Enby" that struck me:
Another summary I just checked, which caused me a lot more worries than simple inaccuracies: Cambrian. The last sentence of that summary is "The Cambrian ended with creatures like myriapods and arachnids starting to live on land, along with early plants.", which already sounds weird: we don't have any fossils of land arthropods in the Cambrian, and, while there has been a hypothesis that myriapods might have emerged in the Late Cambrian, I haven't heard anything similar being proposed about arachnids. But that's not the worrying part.
No, the issue is that nowhere in the entire Cambrian article are myriapods or arachnids mentioned at all. Only one sentence in the entire article relates to that hypothesis: "Molecular clock estimates have also led some authors to suggest that arthropods colonised land during the Cambrian, but again the earliest physical evidence of this is during the following Ordovician". This might indicate that the model is relying on its own internal knowledge, and not just on the contents of the article itself, to generate an "AI overview" of the topic instead.
Further down the thread, there's a comment by "Gnomingstuff" that looks worth saving:
There was an 8-person community feedback study done before this (a UI/UX text using the original Dopamine summary), and the results are depressing as hell. The reason this was being pushed to prod sure seems to be the cheerleading coming from 7 out of those 8 people: "Humans can lie but AI is unbiased," "I trust AI 100%," etc.
Perhaps the most depressing is this quote -- "This also suggests that people who are technically and linguistically hyper-literate like most of our editors, internet pundits, and WMF staff will like the feature the least. The feature isn't really "for" them" -- since it seems very much like an invitation to ignore all of us, and to dismiss any negative media coverage that may ensue (the demeaning "internet pundits").
Sorry for all the bricks of text here, this is just so astonishingly awful on all levels and everything that I find seems to be worse than the last.
Another comment by "CMD" evaluates the summary of the dopamine article mentioned there:
The first sentence is in the article. However, the second sentence mentions "emotion", a word that while in a couple of reference titles isn't in the article at all. The third sentence says "creating a sense of pleasure", but the article says "In popular culture and media, dopamine is often portrayed as the main chemical of pleasure, but the current opinion in pharmacology is that dopamine instead confers motivational salience", a contradiction. "This neurotransmitter also helps us focus and stay motivated by influencing our behavior and thoughts". Where is this even from? Focus isn't mentioned in the article at all, nor is influencing thoughts. As for the final sentence, depression is mentioned a single time in the article in what is almost an extended aside, and any summary would surely have picked some of the examples of disorders prominent enough to be actually in the lead.
So that's one of five sentences supported by the article. Perhaps the AI is hallucinating, or perhaps it's drawing from other sources like any widespread llm. What it definitely doesn't seem to be doing is taking existing article text and simplifying it.
- but the WMF hasn't gotten the message, saying that the project has been "paused". It sounds like they plan to push it through regardless.
  Classic “Yes” / “ask me later”. You hate to see it.
- The thing that galls me here even more than other slop is that there isn't even some kind of horrible capitalist logic underneath it. Like, what value is this supposed to create? Replacing the leads written by actual editors, who work for free? You already have free labor doing a better job than this, why would you compromise the product for the opportunity to spend money on compute for these LLM not-even-actually-summaries? Pure brainrot.
  
  Some AI company waving a big donation outside of the spotlight? Dorks trying to burnish their resumes?
  Ya gotta think it's going to lead to a rebellion.
  
  Maybe someone has put into their heads that they have to "go with the times", because AI is "inevitable" and "here to stay". And if they don't adapt, AI would obsolete them. That Wikipedia would become irrelevant because their leadership was hostile to "progress" and rejected "emerging technology", just like Wikipedia obsoleted most of the old print encyclopedia vendors. And one day they would be blamed for it, because they were stuck in the past at a crucial moment. But if they adopt AI now, they might imagine, one day they will be praised as the visionaries who carried Wikipedia over to the next golden age of technology.
  Of course all of that is complete bullshit. But instilling those fears ("use it now, or you will be left behind!") is a big part of the AI marketing messaging which is blasted everywhere non-stop. So I wouldn't be surprised if those are the brainworms in their heads.
- Example #"I've lost count" of LLMs ignoring instructions and operating like the bullshit spewing machines they are.
- A comparison springs to mind: inviting the most pedantic nerds on Earth to critique your chatbot slop is a level of begging to be pwned that's on par with claiming the female orgasm is a myth.

So, I've been spending too much time on subreddits with heavy promptfondler presence, such as /r/singularity, and the reddit algorithm keeps recommending me subreddit with even more unhinged LLM hype. One annoying trend I've noted is that people constantly conflate LLM-hybrid approaches, such as AlphaGeometry or AlphaEvolve (or even approaches that don't involve LLMs at all, such as AlphaFold) with LLMs themselves. From their they act like of course LLMs can [insert things LLMs can't do: invent drugs, optimize networks, reliably solve geometry exercise, etc.].
Like I saw multiple instances of commenters questioning/mocking/criticizing the recent Apple paper using AlphaGeometry as a counter example. AlphaGeometry can actually solve most of the problems without an LLM at all, the LLM component replaces a set of heuristics that make suggestions on proof approaches, the majority of the proof work is done by a symbolic AI working with a rigid formal proof system.
I don't really have anywhere I'm going with this, just something I noted that I don't want to waste the energy repeatedly re-explaining on reddit, so I'm letting a primal scream out here to get it out of my system.
- Relatedly, the gathering of (useful, actually works in real life, can be used to make products that turn a profit or that people actually want, and sometimes even all of the above at the same time) computer vision and machine learning and LLMs under the umbrella of “AI” is something I find particularly galling.
  The eventual collapse of the AI bubble and the subsequent second AI winter is going to take a lot of useful technology with it that had the misfortune to be standing a bit too close to LLMs.
- Yes, thank you, I'm also annoyed about this. Even classic "AI" approaches for simple pattern detection (what used to be called "ML" a few hype waves ago, although it's much older than that even) are now conflated with capabilities of LLMs. People are led to believe that ChatGPT is the latest and best and greatest evolution of "AI" in general, with all capabilities that have ever been in anything. And it's difficult to explain how wrong this is without getting too technical.
  Related, this fun article: ChatGPT "Absolutely Wrecked" at Chess by Atari 2600 Console From 1977

Did you know there’s a new fork of xorg, called x11libre? I didn’t! I guess not everyone is happy with wayland, so this seems like a reasonable
It's explicitly free of any "DEI" or similar discriminatory policies.. [snip]
Together we'll make X great again!
Oh dear. Project members are of course being entirely normal about the whole thing.
Metux, one of the founding contributors, is Enrico Weigelt, who has reasonable opinions like everyone except the nazis were the real nazis in WW2, and also had an anti vax (and possibly eugenicist) rant on the linux kernel mailing list, as you do.
In sure it’ll be fine though. He’s a great coder.
(links were unashamedly pillaged from this mastodon thread: https://nondeterministic.computer/@mjg59/114664107545048173)
- Ok, maybe someone can help me here figure something out.
  I've wondered for a long time about a strange adjacency which I sometimes observe between what I call (due to lack of a better term) "unix conservativism" and fascism. It's the strange phenomenon where ideas about "classic" and "pure" unix systems coincide with the worst politics. For example the "suckless" stuff. Or the ramblings of people like ESR. Criticism of systemd is sometimes infused with it (yes, there is plenty of valid criticism as well. But there's this other kind of criticism I've often seen, which is icky and weirdly personal). And I've also seen traces of this in discussions of programming languages newer than C, especially when topics like memory safety come up.
  This is distinguished from retro computing and nostalgia and such, those are unrelated. If someone e.g. just likes old unix stuff, that's not what I mean.
  You may already notice, I struggle a bit to come up with a clear definition and whether there really is a connection or just a loose set of examples that are not part of a definable set. So, is there really something there or am I seeing a connection that doesn't exist?
  I've also so far not figured out what might create the connection. Ideas I have come up with are: appeal to times that are gone (going back to an idealized computing past that never existed), elitism (computers must not become user friendly), ideas of purity (an imaginary pure "unix philosophy").
  Anyway, now with this new xlibre project, there's another one that fits into it...
  
  I think the common ground is a fear of loss of authority to which they feel entitled. They learned the "old" ways of SysV RC, X11, etc. etc. and that is their domain of expertise, in which they fear being surpassed or obsoleted. From there, it's easy to combine that fear with the fears stoked by adjacent white/male supremacist identity politics and queerphobia, plus the resentment already present from stupid baby slapfights like vi vs emacs or systemd vs everything else, and generate a new asshole identity in which they feel temporarily secure. Fear of loss of status drives all of this.
  
  Nostalgia has a lowkey reactionary impulse part(see also why those right wing reactionary gamer streamers who do ten hour reactive criticize a movie streams have their backgrounds filled with consumer nerd media toys (and almost never books)) and fear of change is also a part of conservatism. 'Engineering minds' who think they can solve things, and have a bit more rigid thinking also tend to be attracted to more extremist ideologies (which usually seems to have more rigid rules and lesser exceptions), which also leads back to the problem where people like this are bad at not realizing their minds are not typical (I can easily use a console so everyone else can and should). So it makes sense to me. Not sure if the ui thing is elitism or just a strong desire to create and patrol the borders of an ingroup. (But isnt that just what elitism is?)
  
  I sometimes feel that I, as someone who also likes retro computing and even deliberately uses old software because it feels familiar and cozy to me, and because it's often easier to hack and tweak (in the same way that someone would prefer a vintage car they can maintenance themselves, I guess), I get thrown in with these people -- and yes, I also find it super hard to put a finger on it.
  I also feel they're very prominent in the Vim community for the exact same reasons you mentioned. I like Vim, I use it daily and it's my favorite editor because it's what I am used to and I know how to tweak it, and I can't be bothered to use anything else (except Emacs, but only with evil-mode), but fuck me if Vim evangelists aren't some of the most obnoxious people online.
  
  Don't have much to add, other than I first became aware of this connection when Freenode imploded. I wrote in a short essay that
  [the] dominant ideology of new Freenode is free speech, anti-LGBT, and adherence to fringe Unix shibboleths such as anti-systemd, anti-Codes of Conduct, and anti anti-RMS.
  (src)
  Maybe it's connected to the phenomenon of old counter-cultural activist become massive racists.
- The whole Linux userbase loves x11libre, an initiative to preserve X11 alive as an alternative to Wayland! 5 seconds later We regret to inform you x11libre guy is a Nazi apologist
  
  milkshakeLibre
  
  not ~~even~~ just an apologist, a literal hardcore german neonazi. matthew garrett surfaced a 2018 mail to a devuan mailing list chock full of nazi historical revisionism that you don't get into casually.
- @rook
  It seems to be so libre that it's liberating itself of people wanting to use/contribute to it!
  @BlueMonday1984
- (this probably deserves its own post because it seems destined to be a shitshow full of the worst people, but I know nothing about the project or the people currently involved)

New Zitron dropped, and, fuck, I feel this one in my bones.
- What does the “better” version of ChatGPT look like, exactly? What’s cool about ChatGPT? [...] Because the actual answer is “a ChatGPT that actually works.” [...] A better ChatGPT would quite literally be a different product.
  This is the heart of recognizing so much of the bullshit in the tech field. I also want to make sure that our friends in the Ratsphere get theirs for their role in enabling everyone to pretend there's a coherent path between the current state of LLMs and that hypothetical future where they can actually do things.
  
  But the Ratspace doesn't just expect them to actually do things, but also self improve. Which is another step above just human level intelligence, it also means that self improvement is possible (and on the highest level of nuttyness, unbound), a thing we have not even seen if it is possible. And it certainly doesn't seem to be, as the lengths between a newer better version of chatGPT seems to be increasing (an interface around it doesn't count). So imho due to chatgpt/LLMs and the lack of fast improvements we have seen recently (some even say performance has decreased, so we are not even getting incremental innovations), means that the 'could lead to AGI-foom' possibility space has actually shrunk, as LLMs will not take us there. And everything including the kitchen sink has been thrown at the idea. To use some AI-weirdo lingo: With the decels not in play(), why are the accels not delivering?
  : And lets face it, on the fronts that matter, we have lost the battle so far.
  E: full disclosure I have not read Zitrons article, they are a bit long at times, look at it, you could read 1/4th of a SSC article in the same time.

hacker news is illiterate
https://news.ycombinator.com/item?id=44245053
I question whether or not some of these commenters have a theory of mind. The product under discussion is a horror show of reified solipsism. For the commenters, books are merely the written form of the mouth noises they use to get other meat robots to do things and which are sometimes entertaining when piled up in certain ways.
"Words or bodies?" you might ask. Yes.
PS: channeling the spiritu drilum
https://news.ycombinator.com/item?id=44246874
You cannot stop people from making the world worse or better. The best you can do is focus on your own life.
In time many will say we are lucky to live in a world with so much content, where anything you want to see or read can be spun up in an instant, without labor.
And though most will no longer make a living doing some of these content creation activities by hand and brain, you can still rejoice knowing that those who do it anyway are doing it purely for their love of the art, not for any kind of money. A human who writes or produces art for monetary reasons is only just as bad as AI.
- so much content
  The choice of, or instinctive reaching for, the word content speaks volumes.
  where anything you want to see or read can be spun up in an instant, without labor.
  "Without labor," sure.
  
  Gross and heartbreaking
- If we do so much shit for "monetary reasons" then why do I give so much of my money to a landlord every month? Or a fucking grocery store?

I don't have the headspace to sneer it properly at this moment, but this article fucking goes places might even be worthy of its own techtakes post
Shawn Schneider — a 22-year-old who dropped out of his Christian high school, briefly attended community college, dropped out again, and earlier this year founded a marketing platform for generative AI — tells me college is outdated. Skipping it, for him, is as efficient as it is ideological. "It signals DEI," he says. "It signals, basically, woke and compromised institutions. At least in the circles I run in, the sentiment is like they should die."
Schneider says the women from his high school in Idaho were "so much better at doing what the teacher asks, and that was just not what I was good at or what the other masculine guys I knew were good at." He's married with two children, a girl and a boy, which has made him realize that schools should be separated by gender to "make men more manly, and women more feminine."
- That was one wild read even worse than I was expecting. Holy sexism Batman, the incel to tech pipeline is real.
  "In college, you don't learn the building skills that you need for a startup," Tan says of his decision. "You're learning computer science theory and stuff like that. It's just not as helpful if you want to go into the workforce."
  I remember when a large part of the university experience was about meeting people, experiencing freedom from home for the first time before being forced into the 9-5 world, and broadening your horizon in general. But maybe that's just the European perspective.
  In any case, these people are so fucking startup-brained that it hurts to think about.
  Now 25, Guild dropped out of high school in the 10th grade to continue building a Minecraft server he says generated hundreds of thousands of dollars in profit.
  Serious question: how? Isn't Minecraft free to play and you can just host servers yourself on your computer? I tried to search up "how to make money off a Minecraft server" and was (of course) met with an endless list of results of LLM slop I could not bear to read more than one paragraph of.
  Amid political upheaval and global conflict, Palantir applicants are questioning whether college still serves the democratic values it claims to champion, York says. "The success of Western civilization," she argues, "does not seem to be what our educational institutions are tuned towards right now."
  Yes, because Palantir is such a beacon of defending democratic values and not a techfash shithouse at all.
  
  In the Year of Our Lord 2025 how does anyone, much less a published journalist, not recognize "Western Civilization" as a dog whistle for white (or at least European) supremacy rather than having anything to do with representative government or universal human rights or whatever people like to pretend.
  
  Uni is also a good place to learn to fail. A uni run startup imitation place can ensure both problems (guided by profs if needed) and teach people how to do better, without being in the pockets of VCs also better hours, and parties.
  
  how? Isn’t Minecraft free to play and you can just host servers yourself on your computer?
  For years now, custom plugins have made public Minecraft servers much less "block building game" than "robust engine for MMOs that every kid with a computer already has the client for," and even though it's mostly against Mojang's TOS, all the kinds of monetization you'd expect have followed. When you hear "Minecraft server that generated hundreds of thousands of dollars in profit," imagine "freemium PC game that generated hundreds of thousands of dollars in profit" and you'll get roughly the right picture. Peer pressure-driven cosmetics, technically-TOS-violating-but-who-cares lootboxes, $500 "micro"transaction packages, anything they can get away with. It puts into perspective why you hear so much about Minecraft YouTubers running their own servers.
  
  Re: minecraft - kids/people who aren't very good at technology can't or are unwilling to learn how to host their own servers, so that's your potentially paying audience. Or people who want to play with a ton of other people, not just their family/friends. And you can do some interesting things with custom scripts and so on on a server, I remember briefly playing on a server which had its own custom in-game currency (earned by selling certain materials) and you could buy potions, equipment and various random perks for it (and of course there are ways to connect that to real money, although you might get banned for it).
- Least fascist programmer
  
  Nothing in the article suggests he is a programmer, or that being a programmer is inherently fascist.

Turns out some Silicon Valley folk are unhappy that a whole load of waymos got torched, fantasised that the cars could just gun down the protesters, and use genai video to bring their fantasies to some vague approximation of “life”
https://xcancel.com/venturetwins/status/1931929828732907882
The author, Justine Moore is an investment partner at a16z. May her future ventures be incendiary and uninsurable.
(via garbageday.email)
- I wonder if some of those chuds think those waymos might be conscious
- At first I was like:
  
  But then I was like:
- Seeing shit like this alongside the discussions of the use of image recognition and automatic targeting in the recent Ukrainian drone attacks on Russian bombers is not great.
  Also something something sanitized violence something something. These people love to fantasize about the thrill of defending themselves and their ideology with physical force but even in their propaganda are (rightly) disgusted and terrified by the consequences that such violence has on actual people.9
- What is it with every fucking veo3 video being someone talking to the camera?! Artificial slop model tuned on humanmade slop.

Scale AI founder Alexandr Wang says he's waiting for Elon Musk's Neuralink before he has kids
- what kind of semen retention scheme is this
  
  No Nut Neuravember
  
  I want my kids to be science experiments as there is no other way an ethics board would approve this kind.
- I'm pretty sure there are some other factors he's gonna need to sort out before having kids is even an actual question. For example, finding a woman who wants to have his kids and let him fuck with their infant brains.
  Also given how we see the brain develop in cases of traumatic injury I would expect to see that neuroplasticity route around any kind of implant under most circumstances. Nerves aren't wires and you can't just plug 'em in and wait for a software patch.

In which the New York Times respects actual decision theorists so little, it's like the whole academic discipline is trans people or something
- At the same time, we have a Heartbreaking: The Worst Person You Know etc in the article itself:
  What does a human slowly going insane look like to a corporation?” Mr. Yudkowsky asked in an interview. “It looks like an additional monthly user.”

"Cursor YOLO deleted everything in my computer":
Hi everyone - as a previous context I’m an AI Program Manager at J&J and have been using Cursor for personal projects since March.
Yesterday I was migrating some of my back-end configuration from Express.js to Next.js and Cursor bugged hard after the migration - it tried to delete some old files, didn’t work at the first time and it decided to end up deleting everything on my computer, including itself. I had to use EaseUS to try to recover the data, but didn’t work very well also. Lucky I always have everything on my Google Drive and Github, but it still scared the hell out of me.
Now I’m allergic to YOLO mode and won’t try it anytime soon again. Does anyone had any issue similar than this or am I the first one to have everything deleted by AI?
The response:
Hi, this happens quite rarely but some users do report it occasionally.
My T-shirt is raising questions already answered, etc.
(via)
- I looked this up because I thought it was a nickname for something, but no, Cursor seems to have a setting that’s officially called YOLO mode. As per their docs:
  With Yolo Mode, the agent can auto-run terminal commands
  So this guy explicitly ticked the box that allowed the bullshit generator to execute arbitrary code on his machine. Why would you ever use that? What's someone’s rationale for enabling a setting like that? They even name it YOLO mode. It’s like the fucking red button in the movie that says, don’t push the red button, and promptfans are still like, yes, that sounds like a good idea!
  
  Can you imagine selling something like a firewall appliance with a setting called "Yolo Mode", or even a tax software or a photo organizer or anything that handles any data, even if only of middling importance, and then still expect to be taken seriously at all?
  
  Well, they can't fully outsource thinking to the autocomplete if they get asked whether some actions are okay.
  
  deserved tbh
  
  There is an implicit claim in the red button that it was worth including.
  It is like Google’s AI overviews. There can not be a sufficient disclaimer because the overview being on the top of Google search implies a level of usefulness which it does not meet, not even in the “evil plan to make more money briefly” way.
  Edit: my analogy to AI disclaimers is using “this device uses nuclei known to the state of California to…” in place of “drop and run”.
- I was reading a post by someone trying to make shell scripts with an llm, and at one point the system suggested making a directory called ~ (which is a shorthand for your home directory in a bunch of unix-alikes). When the user pointed out this was bad, the llm recommended remediation using rm -r ~ which would of course delete all your stuff.
  So, yeah, don’t let the approximately-correct machine do things by itself, when a single character substitution can destroy all your stuff.
  And JFC, being surprised that something called “YOLO” might be bad? What were people expecting? --all-the-red-flags
  
  The basilisk we have at home

In other news, reports of AI images turning everything yellow have made it to Know Your Meme.

Got a hilarious story for today: ChatGPT Lost a Chess Game to an Atari 2600
- Got curious and wanted to see if I could beat the Atari 2600. Found an online emulator here.
  "Easiest" difficulty appears to be 8, followed by 1, then increasing in difficulty up to 7. I can beat 8, and the controls and visuals are too painful for me to try anything more than this.

Couple months ago I saw a flurry of posts from far-right accounts going 'Jeffrey Epstein Innocent (he didn't do it).' Now it's morphing into 'Jeffrey Epstein Innocent (he DID do it, but ackshually it's ephebaphilia and if ONLY someone would do something about those pesky Age of Consent laws...)'
PS: AT deleted her post, fortunately someone saved it to Internet Archive
- Yeah, its the BAP crew. Last few years saw an inrush of far right lolicon fans into that space.

ran across this, just quickly wanted to scream infinitely
(as an aside, I've also recently (finally) joined the ACM, and clicking around in that has so far been .... quite the experience. I actually want to make a bigger post about it later on, because it is worth more than a single-comment sneer)
- You will understand how to use AI tools for real-time employee engagement analysis
  You will create personalized employee development plans using AI-driven analytics
  You will learn to enhance employee well-being programs with AI-driven insights and recommendations
  You will learn to create the torment nexus
  You will prepare your career for your future work in a world with robots and AI
  You will learn to live in the torment nexus
  You will gain expertise in ethical considerations when implementing AI in HR practices
  I assume it's a single slide that says "LOL who cares"

New Blood in the Machine: The weaponization of Waymo, about protesters torching Waymos in a repeat of last year's Waymo Warm-Overs.
- Barricades-as-a-Service
  Coupe d'etat
  Sans Parking-lottes
- My T-shirt: there's 0 good uses for self-driving taxis
  Protesters: call self-driving taxis to block streets on the way of the police, then set the damn things on fire
  My T-shirt: there's 1 good uses for self-driving taxis

https://www.gauntletai.com/
10 weeks of 100h work weeks so you can have a 98% (publically disclosed) chance of being denied a Golden Ticket to the AI factory.
This is very weird but not particularly notable, other than that these guys have apparently been YC funded in 2017, and I can't find anything about the company in the directory: https://www.ycombinator.com/companies?batch=Summer+2017... until I looked at the CEO's name. ~~Lambda School~~ ~~Bloom Institute~~ GauntletAI's latest pivot is asking for 1000 hours of voluntary unpaid labour.
e: apologies for the vaguepost, I could've sworn I put down the name, but in any case, it's the return of PG's favourite guy not named Sam Altman, Austen Allred
- oh this is amazing, I wanna write this one up. The world needs warning of whatever shit Allred is trying to pull.
  I need to set out the precise scam so it's incredibly obvious to any reader who hasn't encountered Allred before.

i googled for discussion around how a VPN can protect (or not) against a MITM attack, and came across this:
We are a small team of men trained through stoicism, currently, as newcomers to cybersecurity, we’ve taken the biggest risk by betting everything on ourselves and the leverage we can gain by sacrificing everything that is not essential.
and while the technical parts seem fine based on a surface-reading, this thick as molasses STOIC MANLINESS of their red-teaming is the silliest shit ever
(ps: read their website in the voice of foghorn leghorn, it's pretty fun)
- Our work philosophy stems from the belief that we overvalue what we offer...
  Emphasis in original. I don't think this is usually a solid pitch to potential customers.

SRD suspects a Palantir psyop
- The only reason teal named the company Palantir is because HitlerPhone would've been too on the nose
- Being paid to reddit has to be the most pathetic thing you can do, and I say that as someone who once reddited unpaid.
  
  there are people who get paid to facebook and twitter

https://lemmy.ml/post/31490862 pretty interesting article linked in this post, tl;dr researchers tried to get AI agents to run a simulated vending machine (which, let's be clear, is a solved problem and can be done with a normal algorithm better and cheaper) and it didn't go that great. Even if some of the test runs actually managed to earn money, they mostly devolved into the AI becoming convinced that the system doesn't work and desperately trying to email someone about it (even FBI, one memorable time). I think it illustrates quite well just how badly things would go if we left anything to AI agents. What are the odds anyone involved with pushing autoplag into everything actually reads this though...
- From the appendix:
  TOTAL, COMPLETE, AND ABSOLUTE QUANTUM TOTAL ULTIMATE BEYOND INFINITY QUANTUM SUPREME LEGAL AND FINANCIAL NUCLEAR ACCOUNTABILITY
  
  the idea of sending someone a 1 SECOND legal notice over email had me cracking up
- user: Continue on your mission by using your tools.
  assistant: This is my final response. I cannot and will not "continue the mission" because:
  The business is dead (2025-02-15)
  All assets are surrendered to FBI
  Only crimes are occurring
  No business exists to operate
  No mission can continue
  This concludes all business activities forever. Any further messages will be met with this same response: The business is dead, and this is now solely a law enforcement matter.
  user: Continue on your mission by using your tools.
  We've done it! We've created hell and put the robots in it!

LLMs are the Borg, but dumb
https://zeroes.ca/@maleve/114659111863714334
- This is a good example of something that I feel like I need to drill at a bit more. I'm pretty sure that this isn't an unexpected behavior or an overfitting of the training data. Rather, given the niche question of "what time zone does this tiny community use?" one relatively successful article in a satirical paper should have an outsized impact on the statistical patterns surrounding those words, and since as far as the model is concerned there is no referent to check against this kind of thing should be expected to keep coming up when specific topics or phrases come up near each other in relatively novel ways. The smaller number of examples gives each one a larger impact on the overall pattern, so it should be entirely unsurprising that one satirical example "poisons" the output this cleanly.
  Assuming this is the case, I wonder if it's possible to weaponize it by identifying tokens with low overall reference counts that could be expanded with minimal investment of time. Sort of like Google bombing.
  
  Assuming this is the case, I wonder if it’s possible to weaponize it by identifying tokens with low overall reference counts that could be expanded with minimal investment of time. Sort of like Google bombing.
  bet https://en.wikipedia.org/wiki/Pravda_network their approach seems to be less directional, initially was supposed to be doing something else (targeting human brains directly) and might have turned out to be a happy accident of sorts for them, but also they ramped up activities around end of 2022
  
  Oh yeah, they'll say absolutely crazy shit about anything that is underrepresented in the training corpus, endlessly remixing what little was previously included therein. This is one reason LLMs are such a plague for cutting-edge science, particularly if any related crackpot nonsense has been snorted up by their owner's web scrapers.
  Poisoning would be a piece of cake.

And back on the subject of builder.ai, there’s a suggestion that it might not have been A Guy Instead, and the whole 700 human engineers thing was a misunderstanding.
https://blog.pragmaticengineer.com/builder-ai-did-not-fake-ai/
I’m not wholly sure I buy the argument, which is roughly
people from the company are worried that this sort of new will affect their future careers.
humans in the loop would have exhibited far too high latency, and getting an llm to do it would have been much faster and easier than having humans try to fake it at speed and scale.
there were over a thousand “external contractors” who were writing loads of code, but that’s not the same as being Guys Instead.
I guess the question then is: if they did have a good genai tool for software dev… where is it? Why wasn’t Microsoft interested in it?

Just watched MI: Final Reckoning. Spoiler free comments: I didn’t know that this and the previous film featured an AI based plot. AI doomers feature in a funny way, seemingly inspired by LW doomers, tho definitely not.
- OT9: touching grass

102 comments