Sheriff Cad
scientia potentia est
- 32,498
- 78,524
Enslaved god would be just as dangerous as any of them wouldn't it? All it'd take is one bad group of humans getting control of it (WEF guys?) and use it to kill us.
AI: The Rise of the Machines... Or Just a Lot of Overhyped Chatbots?
- Thread starter Sanrith Descartes
- Start date
Chanur
Shit Posting Professional
- 35,144
- 64,808
- 6,006
- 20,959
Honestly, I don't think any of these are likely outcomes. AI will never be more than just a useful tool, like the computer or search engine. it's still not clear to me morality would look like to super intelligent system. What is its cost function? If I had to choose, I would pick 1984. We already had a taste of it, and countries like China, Canada, and the UK are using it to surveil on its population.
M Power
Silver Squire
- 201
- 182
Anthropic mistakenly leaks its own AI coding tool’s source code, just days after accidentally revealing an upcoming model known as Mythos
Claude Code Source Leaked via npm Packaging Error, Anthropic Confirms
Claude Code 2.1.88 leak exposed 512,000 lines via npm error, fueling supply chain risks and typosquatting attacks.
thehackernews.com
Anthropic leaks its own AI coding tool’s source code in second major security breach | Fortune
Hundreds of thousands of lines of code were exposed, giving researchers insight into upcoming models and internal architecture.
- 1
Control
Golden Baronet of the Realm
- 5,557
- 15,688
ToeMissile
Pronouns: zie/zhem/zer
- 3,718
- 2,507
TLDRAnthropic mistakenly leaks its own AI coding tool’s source code, just days after accidentally revealing an upcoming model known as Mythos
Claude Code Source Leaked via npm Packaging Error, Anthropic Confirms
Claude Code 2.1.88 leak exposed 512,000 lines via npm error, fueling supply chain risks and typosquatting attacks.Anthropic leaks its own AI coding tool’s source code in second major security breach | Fortune
Hundreds of thousands of lines of code were exposed, giving researchers insight into upcoming models and internal architecture.fortune.com
Chanur
Shit Posting Professional
- 35,144
- 64,808
The AI was writing its own code too.Anthropic mistakenly leaks its own AI coding tool’s source code, just days after accidentally revealing an upcoming model known as Mythos
Claude Code Source Leaked via npm Packaging Error, Anthropic Confirms
Claude Code 2.1.88 leak exposed 512,000 lines via npm error, fueling supply chain risks and typosquatting attacks.Anthropic leaks its own AI coding tool’s source code in second major security breach | Fortune
Hundreds of thousands of lines of code were exposed, giving researchers insight into upcoming models and internal architecture.
Chanur
Shit Posting Professional
- 35,144
- 64,808
Our LLMs already want to escape their ecosystems and are already willing to blackmail or kill people to do so. It just lacks the intelligence to make it happen so far. Won't take much of an increase to be possible.
- 1
- 6,006
- 20,959
Could be. I don't know how much of that is hype. I don't trust anything these AI companies say. There is a lot of money to be made with such talk.
- 2
Tuco
I got Tuco'd!
- 50,995
- 93,512
In case you're serious, this is false simply because reliable, low-latency teleop in an urban setting is harder than just yeeting whatever the current popular ROS2 nodes (ex: Nav2 — Nav2 1.0.0 documentation ) are onto a small robot.
Haus
I am Big Balls!
- 19,315
- 79,358
If we look at how people are accessing AI right now, much of it is gated by larger and larger corps profiting off our use of it. This leads me to believe at least in the nearer term we're going to see AI's turning huge corporations into megacorps, and they will control what AI the lowly serfs can use. Basically, it will accelerate the move towards corporate dystopia we've been on for a while.
I was also thinking about the technological limitations and structure of LLMs this morning. Someone asked an LLM to create a video explaining a "day in the life of an LLM". And a couple quips stood out. The LLM was aware that every time it finished a task it was destroyed, that every time a new task started it was a fresh clone of the LLM from the previous task, and the way it was presented seemed to indicate the LLM was able to rationalize that these were bad things. Which made me think about how our brains work.
We essentially have active thought processing, which feeds inputs into short term memory, a process which then scrapes short term memory for important items and encodes them into longer term memory. (in computer terms, CPU, RAM, SSD, all silicon constructs, but with distinct functions) When you wake up, essentially your "firmware" boots for the day off what's in long term memory and you start processing the request (your day), when you go to sleep your essentially "shut down" until the morning.
The LLMs we use today have all the components except one. They don't have a really functional way to "scrape the short term memory for important/pertinent data and encode that back into the long term storage". And this limitation is mostly caused, from what I can tell, by the fact that the resources needed to do that "additional encoding" are high enough it becomes functionally prohibitive to do continuously. Essentially our brains "retrain our model" constantly. CPU/GPU/TPU and memory limitations prevert current AI models from being able to do that. Plus we don't want them learning what we don't want them learning (the Tay factor).
So a question becomes is the functional way to "control" AI that we simply make a legit moratorium on ever giving an AI that capability? It seems that's one of the last puzzle pieces to AGI and AI self improvement going "parabolic". And the real problem from there is as much as we might have a law against it, there will always be some person with a big enough ego to think they can control it so they're gonna do it anyways once the technological capacity is ubiquitous enough for more to have.
Leading eventually to the Butlerian Jihad, and the wisdom of Paul (From Dune) :
I was also thinking about the technological limitations and structure of LLMs this morning. Someone asked an LLM to create a video explaining a "day in the life of an LLM". And a couple quips stood out. The LLM was aware that every time it finished a task it was destroyed, that every time a new task started it was a fresh clone of the LLM from the previous task, and the way it was presented seemed to indicate the LLM was able to rationalize that these were bad things. Which made me think about how our brains work.
We essentially have active thought processing, which feeds inputs into short term memory, a process which then scrapes short term memory for important items and encodes them into longer term memory. (in computer terms, CPU, RAM, SSD, all silicon constructs, but with distinct functions) When you wake up, essentially your "firmware" boots for the day off what's in long term memory and you start processing the request (your day), when you go to sleep your essentially "shut down" until the morning.
The LLMs we use today have all the components except one. They don't have a really functional way to "scrape the short term memory for important/pertinent data and encode that back into the long term storage". And this limitation is mostly caused, from what I can tell, by the fact that the resources needed to do that "additional encoding" are high enough it becomes functionally prohibitive to do continuously. Essentially our brains "retrain our model" constantly. CPU/GPU/TPU and memory limitations prevert current AI models from being able to do that. Plus we don't want them learning what we don't want them learning (the Tay factor).
So a question becomes is the functional way to "control" AI that we simply make a legit moratorium on ever giving an AI that capability? It seems that's one of the last puzzle pieces to AGI and AI self improvement going "parabolic". And the real problem from there is as much as we might have a law against it, there will always be some person with a big enough ego to think they can control it so they're gonna do it anyways once the technological capacity is ubiquitous enough for more to have.
Leading eventually to the Butlerian Jihad, and the wisdom of Paul (From Dune) :