AI: The Rise of the Machines... Or Just a Lot of Overhyped Chatbots?

Khane said:

Some good points but nobody is ever going to use these offline because they will only ever be as good as the day you downloaded it. You personally need to train it further after that and it will only be learning from your own input. That might be fine for one or two functions that you are already proficient in and can train and tailor it yourself. It won't work very well at all for anything else.

These things will honestly need to be connected to the internet to be worth using, and when that happens they become distributed systems. That's what is way more likely. Those datacenters going tits up because these LLMs are distributed and use all the computing power of home PCs across the globe, aka the torrent or blockchain of AI. And even though the hardware in those datacenters is still highly useful and specialized there isn't enough profit in running them because you can't charge the premium (like he illustrates).

The software companies creating and providing these LLMs will not all go out of business, we'll just crown a few kings and the majority of people will use those LLMs in this way.

Click to expand...

Khane said:

I can't tell if you're being serious or not. The entire purpose of LLM's and AI is that it can be trained and "learn". What you are describing is a downloaded knowledge base, not an LLM, and those have existed for a long, long time.

Click to expand...

Control said:

So you're saying Qwen 3.5 is a knowledge base? or is it useless because it doesn't live on Anthropic's server?
edit: and why would it be more useful because it lives on someone else's server? Just because their server is better than yours?

Click to expand...

Khane said:

I said exactly what I meant to say, in the post you quoted. Did you watch the video in question because that's what I was commenting on, what the musician in the video's understanding of AI and its future is. He thinks the majority of people are going to download these LLMs and then go offline with them. That is so unlikely it may as well not even be discussed and it also invalidates their main function and ability to be trained en masse to a point where their learning capability is actually meaningful.

Click to expand...

Control said:

Ok, so I just watched it, and I don't think that changes anything I said. Of course most people aren't going to run their own models though since most people are retarded. People would rather stream something than have their own media file too. That doesn't have anything to do with whether or not local ai can be useful. And "invalidates their main function"?? Have you actually used any of these things?

No idea if the availability of local models will have much of an impact on the big ai companies though. Companies are happy to throw lots of money at all things cloud so they don't have to deal with it themselves. I'm not sure the pace of current ai dev can continue. I imagine it will be like everything else where once someone wins, they'll just cut costs, increase prices, and make it shittier. However, what open models are doing is allowing competing companies to offer similar offerings for tiny, tiny fractions of the investment. If anything other than their insane spending dooms the big companies, cheaper competitors running open models is it.

Click to expand...

These things will honestly need to be connected to the internet to be worth using, and when that happens they become distributed systems. That's what is way more likely. Those datacenters going tits up because these LLMs are distributed and use all the computing power of home PCs across the globe, aka the torrent or blockchain of AI

Click to expand...

Khane said:

Nobody said anything about not running LLMs locally. I said they won't run them offline and yes running them OFFLINE invalidates their main function. I even specifically mentioned what will likely happen in the post you quoted:

Click to expand...