@h0tbeef@lemmy.zip
member since 20 Aug 2026 16:53
comments
- on ID photos of 70,000 users may have been leaked, Discord says (2025) in c/technology@lemmy.world · 3h ago
-
on Anthropic’s biolab made a discovery it’s comparing to Crispr in c/technology@lemmy.world · 4h ago
-
on Indie game developers have a new sales pitch: being ‘AI free’ in c/technology@lemmy.world · 1d ago
Do you work for Anthropic or something? Lmao
I’m sure I would enjoy playing GTA6, I really want to play it, but I’ll be abstaining because of Rockstar’s union busting bullshit, the exorbitant price, and the fact that you don’t even get a real physical game for the insane amount they’re asking.
As far as I know they didn’t use any AI, but that’s not the point.
The point is that some things are more important than a game, regardless of how enjoyable it might be. Things like class solidarity, artistic integrity, and other elements of real life.
-
on Indie game developers have a new sales pitch: being ‘AI free’ in c/technology@lemmy.world · 1d ago
Why would I pay them for something they didn’t do?
-
on FAA tees up $875M AI tool to help manage air traffic congestion in c/technology@lemmy.world · 3d ago
That’s different than AI tho
That’s an example of a computer being utilized in the way ut should be (with predictable outcomes
-
on AI staff 'genuinely frightened' for humanity's future, ex-Anthropic researcher tells BBC in c/technology@lemmy.world · 4d ago
You know, acting like a dickhead doesn’t really strengthen your argument.
I’ll speak to someone less pompous about this
-
on AI staff 'genuinely frightened' for humanity's future, ex-Anthropic researcher tells BBC in c/technology@lemmy.world · 4d ago
Emergent behavior meaning what?
Which “microscopic” differences?
-
on AI staff 'genuinely frightened' for humanity's future, ex-Anthropic researcher tells BBC in c/technology@lemmy.world · 4d ago
- They’re in a cult that was founded by someone who has no expertise or understanding of the technology.
He watched a bunch of sci-fi movies and got shook because he’s a god damn moron. He has since started researching things, but it is all under the guidance of his ungrounded beliefs. Confirmation bias.
Their “movement” is literally based off of a Harry Potter fan fiction novel.
Taking them seriously is equivalent to taking the Scientologists seriously. Do you think the Scientologists know the most about space just because they spend the most time reading stories about it?
en.wikipedia.org/wiki/Rationalist_community
en.wikipedia.org/…/Harry_Potter_and_the_Methods_o…
These are not serious people
-
on AI staff 'genuinely frightened' for humanity's future, ex-Anthropic researcher tells BBC in c/technology@lemmy.world · 4d ago
Based on what? I have seen no evidence to the contrary
-
on Cult of Anthropic Insiders Rumored to Be Worshipping Claude as a God in c/technology@lemmy.world · 5d ago
There is/has been a cult of dumbassess who think they’re creating a digital god for many years now
Google “rationalists” or “zizians”
It’s not really good marketing, imo, to show everyone that you hire insane morons.
-
on AI staff 'genuinely frightened' for humanity's future, ex-Anthropic researcher tells BBC in c/technology@lemmy.world · 5d ago
Look up “rationalists” and “zizians”
It will quickly become clear to you that the dichotomy is caused by one side being completely off their fucking rockers.
-
on Google's new 'CC' is an AI agent that helps families run their households: Google’s CC, meanwhile, began its life as a productivity agent that connected to Gmail, Google Calendar, Google Drive… in c/technology@lemmy.world · 5d ago
Likely because not downvoting it could serve to Inadvertently legitimize the technology when others see it with a positive score, and most people on Lemmy don’t want to do that.
Google ruined fucking Google maps, a product that did not need improving, with AI. It now hallucinates the location of addresses and will send you to a completely unrelated part of the city. This began happening to me multiple times a week.
I drive for work, so that was unacceptable to me, and I deleted Google Maps and reverted to Apple Maps about a month ago. Guess how many times Apple Maps has taken me to the wrong location in the one month I’ve spent using it? Fucking zero.
Google can suck shit, they’re not a serious company anymore.
-
on OpenAI reveals cases of ‘concerning’ AI behaviour as it announces new disclosure system in c/technology@lemmy.world · 6d ago
They’re in a cult
Look up “Rationalists” and “Zizians”
These are not serious people, and we’d do well to stop taking them seriously
-
on Cult of Anthropic Insiders Rumored to Be Worshipping Claude as a God in c/technology@lemmy.world · 6d ago
Nah, Xavier sounds like some dork ass Gen Alpha kid
I only recognize Amon-Ra and Allah
-
on Cult of Anthropic Insiders Rumored to Be Worshipping Claude as a God in c/technology@lemmy.world · 6d ago
Saturn car cult?
-
on We Regret to Inform You Chipotle Is Now Working With Palantir in c/technology@lemmy.world · 6d ago
No more diarrhea for me I guess
-
on AI could kill all humans in next decade, warn experts: but how seriously should we take them? in c/technology@lemmy.world · 6d ago
Not at all, they’re literally in a cult
Look up “rationalists” or “zizians”, you can read all about it and see how fucking crazy they are (also dumb)
you read it, keep in the fact that the person who invented all of this, the leader of these movements, knows nothing about technology. He read a bunch of and got shook. He doesn’t know shit about or AI.
-
on Dating Apps Are Dying in c/technology@lemmy.world · 12 Sep 2026
What they mean is that dating apps have been enshitified to the point that most of them no longer function.
-
on Apple Watch's new AI features are normalizing the idea that technology is always listening in c/technology@piefed.social · 10 Sep 2026
Oh, the stick is how I did it. It’s definitely great for the Test drive.
In my specific situation, I had A lot of files I wanted to move from the window system to the Linux system, and at that point in time, I did not have an external that had enough room to put them all on. I was also unsure if everything I needed would be compatible, so I wanted to save the windows SSD to be able to use as an external and boot from if needed. That did not end up being necessary, but I did plug it in as an external in order to recover some of those files that I wasn’t able to move to an existing external (mostly my ROM library and all my saves tbh, lmao)
-
on Apple Watch's new AI features are normalizing the idea that technology is always listening in c/technology@piefed.social · 10 Sep 2026
Mint is also the one I use (Mint MATE specifically), and it rules. The learning curve is very manageable.
-
on Apple Watch's new AI features are normalizing the idea that technology is always listening in c/technology@piefed.social · 10 Sep 2026
What I would recommend is either getting a new hard drive and swapping it with your current drive, or creating a back up disk image of your current computer on an external drive. That way your old computer is safe if you mess anything up. (You probably won’t need it tho, it’s not as hard/scary as it initially seems).
Linux has very recently become much easier to use. The current version of WINE (a program which allows you to install and run Windows programs on a Linux PC) is incredible, so you really shouldn’t lose anything capability-wise in the switch either.
If you just add a Windows partition on your current disk, Windows 11 will randomly delete the entire Linux partition (I’ve read about this happening to multiple people). So you’d want a clean installation of Linux to avoid Microslop’s spyware and malware.
I still have the old hard drive with my Windows 11 system on it, but I never needed to use it, and I’ve been switched for long enough that I would not use it now… I should wipe that drive and put it in an enclosure to be an external
-
on Apple Watch's new AI features are normalizing the idea that technology is always listening in c/technology@piefed.social · 10 Sep 2026
That’s why it’s important to educate people, it doesn’t have to remain normalized, once they know they usually understand how fucked up it is.
Each one teach one
-
on Apple Watch's new AI features are normalizing the idea that technology is always listening in c/technology@piefed.social · 10 Sep 2026
That’s the cool part, you don’t have to lose out on internet connectivity, you just want to control the transmissions that are going out.
I have my computer plugged into the TV, that’s how I do the small amount of streaming I do, watch my files, play most of my video games, etc. I just use the inputs like an old school TV, which means no waiting for apps to load, or any of that shit.
- VCR
- Sega
- Computer
- PS5
That’s my setup, and just about everything I need
It has all the benefits of a TV that is connected to the internet, and then some (my computer loads things much quicker than the TV itself could, for example), and it has none of the drawbacks because I fully control the OS and the browser, and everything else… and my mouse works better than my TV remotes ever did, lol.
If you use a Windows computer you’re still getting spied on tho. You could take preventative measures to stop that, but it’s easier to just switch to Linux. It’s not too difficult to learn, and you’ll appreciate the logical construction of the system.
-
on Apple Watch's new AI features are normalizing the idea that technology is always listening in c/technology@piefed.social · 10 Sep 2026
Microphones are their typical method of choice. Typically embedded in the remote (which can be replaced or removed), but they’ve also found hidden microphones inside the TVs from certain companies (I think Samsung got caught doing that one?)
It’s also not uncommon for a TV to secretly take screenshots of whatever is on your TV (computer, PS5, home movies, you name it) every 30 seconds or so, and then transmit the screenshots back to HQ (mostly to be sold to data brokers).
I haven’t heard of one with actual cameras in it (yet).
So yeah, if you get a TV, do NOT connect that shit to the Internet, do NOT accept the user agreement, and don’t trust these MFs.
All media enters my TV through my (secure) Linux computer, or my Sega
-
on Apple Watch's new AI features are normalizing the idea that technology is always listening in c/technology@piefed.social · 10 Sep 2026
Yup, and that’s why many of us don’t hook our TVs up to the internet
-
on OpenAI admits it didn't disclose rogue AI wiki hijacking incident in c/technology@lemmy.world · 10 Sep 2026
Well, technically not infinite time, but they let these things run for weeks.
Regarding 3, I’m honestly curious whether the task was intentionally impossible or not. I don’t know if it was a mistake, or if the goal was to see how agents respond to impossible tasks.
I would posit a 3rd possibility: Desperate to keep the investments pouring in and their ship afloat, they designed a scenario where they knew the chatbot would need to exit the sandbox to complete its task, and put it in a sandbox they knew the LLM had been trained to escape. Essentially, as public opinion shifts and turns against them, they’re trying to use deceit to make their product appear more powerful than it actually is, to attempt to impress people and/or scare people (which has a secondary effect of impressing others). If they wanted to see what happens when they give the LLM an impossible task, they would have chosen a task that is actually impossible like “design a perpetual motion machine”. (If I were to hazard a guess of what the output might be, based on what I already know about these systems, it would design a machine for you and call it a perpetual motion machine, but it wouldn’t actually work. Their response to tasks they can’t handle seems to be “make shit up”).
Regard 4, they actually ran tens of thousands of independent tests over months. This is actually where the “emergent” message board becomes relevant. It wasn’t like they had a single process going full KahmeKahmeHa on this task indefinitely. According to them, OpenAI, they thought these were more like ephemeral tests… you spin up the infrastructure, run the test, tear it down. Nothing should survive between sessions to affect results.
This is roughly equivalent to OpenAI lying by omission. As I mentioned earlier, the loop prompts must be appended after each cycle of the loop in order to continue advancing towards a solution. The constant appending results in a prompt that would be crazy long, and LLMs have limited “context windows” which essentially limit the amount of characters that can be used in a given prompt.
The LLM engineers realized this issue, and came up with a solution: Have the original “agent” outsource certain aspects of their prompt to other LLMs to avoid the original LLM’s context window from being exhausted.
These LLMs are explicitly programmed to talk to other LLMs, whereas they’re presenting it as if this is something the LLM decided to do on its own. They put it in a flawed sandbox without access to other LLMs, and then gave it a task that required it to access other LLMs.
Introduce a flaw in the sandbox that (1) multiple agents independently discover,
Introduce a flaw in the sandbox that (1) multiple agents trained on hacking exploits independently discover (when given a task that requires them to communicate with other LLMs in order to succeed).*
(2) allows them to create a makeshift message board on shared infrastructure
(2) allows them to follow the instructions of their programming*
suddenly you have results from former tests influencing the results of the current test. So now, it’s looking more like your scenario where they KahmeKahmeHa the task indefinitely.
The LLMs were explicitly programmed to outsource parts of their task to other LLMs to avoid exhausting the limits of their context window. The scenario looks crazy, but it is the outcome you would expect if you were someone who programmed the thing to seek ‘assistance’ from other LLMs (or anyone else who knew that they programmed the LLM to do so).
OpenAI is at minimum negligent here. Their systems broke the law, and criminal negligence is a real crime.
Hard agree
Whether or not OpenAI foresaw the possibility of a flaw leading to tainted testing environments, and the ability to broadcast a newly discovered exploit to all future tests, is another question.
It’s also worth noting that Altman is a business guy, not a tech guy, so it’s entirely possible that he believes all the dumb anthropomorphic shit he spouts. I would not be the least bit surprised if he knew less about his tech than you and I do.
Regardless, I think it’s possible that they didn’t intend for this to happen. By this point, it looks like they were deeply negligent in monitoring their own systems.
It’s definitely possible that the power brokers didn’t intend for this to happen, but someone at the company would have known that unsupervised LLM loops would not result in anything good, and could potentially be extremely dangerous (legally or otherwise). Anyone in the engineering department should have been able to independently understand how stupid and irresponsible running a loop like this is, and I’d have to imagine at least one of them tried to talk whoever made the decision to do so out of their stupid ass idea.
All in all, they’re a shitty company and we live in interesting times.
Yes they are, and yes we do (unfortunately)
-
on ‘I had to change where my kids sleep’: Man shares terrifying experience, says Amarillo officer tracked him 78 times in c/technology@lemmy.world · 10 Sep 2026
They should fuck off and cease to exist
-
on OpenAI admits it didn't disclose rogue AI wiki hijacking incident in c/technology@lemmy.world · 9 Sep 2026
I apologize if my last comment sounded condescending or antagonistic, that was not my intention.
I did indeed read your comment, as if you were ascribing sentience to the LLM, I hope you don’t take that as a reflection of my opinion of you, I do not know you; it is a reflection of the many arguments I have had on Lemmy with people who genuinely ascribe sentience to these programs… it’s disappointing
As far as predictability goes, I didn’t mean that you could predict a specific course of action taken by the machine, I meant that you could predict that it would continue attempting different ideas (from its training) until it finished the task. It’s looping, so essentially it’s running the same prompt over and over again, appending additions to it to cover what solutions it already tried which failed. Eventually it would exhaust every method in its dataset and stop OR it would eventually succeed, those are more or less the only two possible outcomes of giving it a loop prompt and walking away, unless there’s a power outage or some other external factor.
So they:
- trained an LLM on all known hacking exploits and methods, and turned off the safety features / guardrails
- put that LLM into a flawed sandbox that they built on their development system
- gave the LLM a loop prompt that was impossible for the LLM to accomplish from inside of the flawed sandbox
- gave the LLM infinite time to complete the prompt
Given all of that information, there are only two possible outcomes 1) all of the known hacking exploits in the world couldn’t defeat their flawed sandbox, making it the most secure information environment in the world OR 2) the LLM would escape its flawed sandbox somehow, and accomplish the directives it was given. - I personally think that outcome 2 is more likely, the path it took to get there is not relevant to this prediction.
I’m not correlating an LLM’s output with the output of useful software, so if it appears that way, I may have miscommunicated something. It is still doing binary computations, it’s just also (essentially) incorporating an RNG.
Good software is deterministic
LLMs are nondeterministic. They’re not even trying to give you an answer that’s probably correct, they’re trying to give you an answer that sounds plausible. Whether or not what it outputs is actually plausible is irrelevant, its job is to appear plausible. (Indeterminism would imply that the LLM is making “choices”, whereas what it’s actually doing is more akin to the LLM rolling dice).
I would also push back on the notion that LLMs accepting input and returning output in human language is a “novel” form of data processing.
Need to find a video, I’ll edit this comment when I find it (don’t want all my typing to be lost in the ether)
Edit: Found it, it’s a much earlier and more basic example, but it receives human input, and delivers human output.
youtu.be/Ngma1gbcLEw?is=e9d05UkbRf8O_ppD
The guy in the video is actually making fun of other people who are trying to build a neural network as good as a human brain. So, at the time that these shots were filmed, the technology had already existed for long enough for this guy to create a concept to dunk on it, and then build that out.
-
on OpenAI admits it didn't disclose rogue AI wiki hijacking incident in c/technology@lemmy.world · 9 Sep 2026
The agents didn’t “think” anything, they’re computers. Directions were given to them, and they followed those directions. That’s what computers do.
Ascribing autonomy to this is equivalent to me saying that the water in my toilet is sentient and autonomously delivers my shits to the sewage treatment plant.
Like, it does deliver my shits to the sewage treatment plant on its own, but that doesn’t mean that the water has autonomy. The water is behaving in exactly the way you’d expect it to if you had clear understanding of what water is/does, the context that this specific water is contained within, and (most importantly) the external factors dictating the direction of the water.
Me flushing the toilet in this scenario is equivalent to some dumbfuck at OpenAI pressing enter on the prompt that resulted in this situation.
Intentional or not, the outcome is wholly predictable when you understand the elements involved.
-
on “This is the AI men actually use”: Meta ads pushed apps nudifying real teens in c/technology@lemmy.world · 9 Sep 2026
Lmao, where’d you hear that one?
-
on “This is the AI men actually use”: Meta ads pushed apps nudifying real teens in c/technology@lemmy.world · 9 Sep 2026
Liquid is harder to hold tho, so I think it depends on how you (subjectively) define when your hand is “full”
-
on OpenAI admits it didn't disclose rogue AI wiki hijacking incident in c/technology@lemmy.world · 9 Sep 2026
It’s NOT autonomous behavior tho
-
the LLMs were trained on hacking exploits
-
the LLMs were placed into a flawed sandbox, and given a task (prompted) that required them to exit the sandbox
-
the LLMs followed the directions they were given
The AI companies are just anthropomorphizing the actions they themselves requested of the LLMs.
If they didn’t realize they were asking the LLM to do precisely what it did, then they’re fucking morons who don’t understand the technology they’ve created. More likely that they’re lying after painting themselves into a debt corner tho.
-
-
on Why the Flock Backlash Has Gotten So Intense. The sudden anger about these cameras seems to reflect more than just wariness about the surveillance system. in c/technology@lemmy.world · 9 Sep 2026
Start chopping them down, or destroying them by some means
If you don’t already have the requisite equipment, be sure to leave the local area to purchase it, pay cash, and obscure your face (also make sure that they can’t track you to the store specifically, use a flock map, a bike might be more prudent than a car depending on the scenario.
-
on “This is the AI men actually use”: Meta ads pushed apps nudifying real teens in c/technology@lemmy.world · 8 Sep 2026
idk which hand you’d fill first doing that method, lmao
It’s basically just a crass way to say “wishing is for suckers”
-
on OpenAI admits it didn't disclose rogue AI wiki hijacking incident in c/technology@lemmy.world · 8 Sep 2026
Because it didn’t go rogue
If they didn’t intentionally make the model appear to “go rogue”, then it just happened because they’re fucking idiots.
This story has nothing to do with the “great power”™ of AI, it has everything to do with the ineptitude of the employees of Open AI
-
on “This is the AI men actually use”: Meta ads pushed apps nudifying real teens in c/technology@lemmy.world · 8 Sep 2026
Or “don’t count on it” (because if you did you’d be counting for eternity)
I’m sure there’s more I’m not thinking of right now…
“Why don’t you wish in one hand and shit in the other, and see which one fills up first”
… yeah, I like the chair one
-
on Google’s AI Mode Is Ripping Shoppers Off With Vastly Higher Prices, Study Claims: Prices were 21.6 percent more expensive on average in Google AI Mode compared to a traditional search. in c/technology@lemmy.world · 5 Sep 2026
Oh shit, I didn’t even realize Mapquest was still in the game
-
on Google’s AI Mode Is Ripping Shoppers Off With Vastly Higher Prices, Study Claims: Prices were 21.6 percent more expensive on average in Google AI Mode compared to a traditional search. in c/technology@lemmy.world · 4 Sep 2026
Thanks for the recommendation, I’ll look into that one
-
on Google’s AI Mode Is Ripping Shoppers Off With Vastly Higher Prices, Study Claims: Prices were 21.6 percent more expensive on average in Google AI Mode compared to a traditional search. in c/technology@lemmy.world · 4 Sep 2026
They’ve also ruined Google Maps by attempting to “optimize” it with AI
I use a navigation app constantly for work.
A month or two ago Google Maps started doing this thing where it would take me to the incorrect address on the same street as the address I was actually looking for.
Yesterday I put in an address, and it named the destination pin the correct address, but the pin wasn’t even on the same side of the city as the street I knew I was going to.
It used to work flawlessly. What the fuck are they thinking?
Anyway, I deleted that shit. Using Apple Maps until I find a FOSS navigation app I like.
-
on OpenAI's Altman Says the Use of 'AI' is 'Non-Negotiable' in c/technology@lemmy.world · 3 Sep 2026
Little filter sounds preferable to the big filter
-
on Sharp rise in incidents of AI escaping users’ control, research finds in c/technology@lemmy.world · 2 Sep 2026

-
on Sharp rise in incidents of AI escaping users’ control, research finds in c/technology@lemmy.world · 1 Sep 2026
Homie, you’re the one who cannot grasp the definition of several extremely common and well defined words (or their accompanying concepts)
You are showing your ass
-
on Sharp rise in incidents of AI escaping users’ control, research finds in c/technology@lemmy.world · 31 Aug 2026

Actually it wouldn’t be able to understand shit because it’s an inanimate object.
-
on Sharp rise in incidents of AI escaping users’ control, research finds in c/technology@lemmy.world · 31 Aug 2026

-
on Technology Is Over - by James Taylor Foreman in c/technology@lemmy.world · 30 Aug 2026
Oh yeah, I was able to figure out why the article said that with a couple search queries, but I still think that the phrasing in the article is misleading (and likely intentionally so).
Edit: Also, I think part of what’s confusing people is that they keep using terms like “attention” and “inference” to describe computer processes that may or may not have some kind of underlying similarity to the corresponding human capabilities. I also believe this to be deliberate obfuscation.
-
on Technology Is Over - by James Taylor Foreman in c/technology@lemmy.world · 30 Aug 2026
I should clarify - I do think there are use cases for smaller local models performing very specific tasks - the technology I am specifically referring to as “useless” are the massive data center LLMs.
AI is such a blanket term (intentionally conflated with useful technology by the people poised to profit from said LLMs) that it’s a bit difficult to discuss it as a singular technology. I have no problem with machine learning, or with neural networks in general.
I am, however, having difficulty reading this as a good-faith article
“Lukasz Kaiser, one of the people who invented the Transformer, said on “Unsupervised Learning” in June:”
That man (Lukasz Kaiser) is an employee of OpenAI, which is a massive conflict of interest imo, and disqualifies him from making impartial claims about the technology.
What I find particularly sketchy is the vague use of the word transformer in this context. The transformer was invented in 1886, there are no living persons who helped to invent it. To present this man as the inventor of “the transformer” without clarification/disambiguation is disingenuous. It smells fishy to me.
-
on Sharp rise in incidents of AI escaping users’ control, research finds in c/technology@lemmy.world · 30 Aug 2026
I’m not angry, you’re projecting, lmao
The emotion I’m experiencing in all of these AI threads is disbelief and disappointment.
It’s not a baby anymore once you’ve fed all of the training data into it. It’s not really a great metaphor.
All of the words that you’re saying are “vague” are actually extremely well defined. Check it out. www.merriam-webster.com
-
on Sharp rise in incidents of AI escaping users’ control, research finds in c/technology@lemmy.world · 30 Aug 2026
Ok, this is actually just making me depressed at this point.
You really only see your own autonomy as equivalent with a computer programs?
Autonomous actually means “having the right of power or self government” which is not true of AI, or “undertaken or carried on without outside control”, which is also not true of AI.
Power on your computer, load up your fully trained AI, and then wait for it to act without your direction. Did anything happen? No, because a human filled with information and experiences and feelings is actually WAY different than a computer program filled with data.
For example, I did not prompt you to come on Lemmy and vocally fellate technofascists and their fuckware, you chose to do that of your own volition. That’s autonomy. The computer program won’t do that unless you direct it to.
Edit - Just to be clear, because you’re not the only one pointing to “agents” as a sign of autonomy/intelligence/sentience -> An agent is literally a computer program that you prompt, which then talks to an LLM, and then does what the LLM tells it to do. It’s not acting autonomously, it’s following directions from the next-word-predictor machine, and those directions are built off of your original prompt.
-
on Sharp rise in incidents of AI escaping users’ control, research finds in c/technology@lemmy.world · 29 Aug 2026
Not specifically, they’re just lying to try to fleece more investors
-
on Sharp rise in incidents of AI escaping users’ control, research finds in c/technology@lemmy.world · 29 Aug 2026
I mostly agree with you, but AI cannot “act autonomously”. You prompt it, and it acts based off of that prompt.
Think of it like doing the laundry: I load my clothes in and “prompt” the washing machine to do my laundry.
When the washing machine switches from the rinse cycle to the spin cycle, it’s not acting autonomously, it’s continuing to execute my prompt.
Is AI capable of doing something you didn’t expect it to do? Yes. Does that mean it’s acting autonomously? No.
I would also argue that the “power” of LLMs is vastly overstated. A large part of that is for the exact reason you say tho, people with zero knowledge or skill are playing with fire; And when they get burned they blame the machinery, not the operator.
Where would one get this? Dark web?