AI: The Rise of the Machines... Or Just a Lot of Overhyped Chatbots?

Denamian

Night Janitor
<Nazi Janitors>
7,993
22,280
  • 1Like
Reactions: 1 user

Pasteton

Vyemm Raider
3,349
2,538
So is it worth paying money to use any of this shit yet? I’m having a shit time trying to get ChatGPT to make a spreadsheet with any level of complexity to it like formulas or tabs with drop downs etc. it did a decent job just spitting out the basic stuff.
 

Noodleface

A Mod Real Quick
39,840
18,567
So is it worth paying money to use any of this shit yet? I’m having a shit time trying to get ChatGPT to make a spreadsheet with any level of complexity to it like formulas or tabs with drop downs etc. it did a decent job just spitting out the basic stuff.
Can't speak for spreadsheets but Claude has been a generational leap in technology. I am using it to write nearly 100% of my code in production.
 

ShakyJake

<Donor>
8,760
21,525
So is it worth paying money to use any of this shit yet? I’m having a shit time trying to get ChatGPT to make a spreadsheet with any level of complexity to it like formulas or tabs with drop downs etc. it did a decent job just spitting out the basic stuff.
I have subs to OpenAI, Anthropic, and X/SuperGrok. All are amazing and incredibly useful. Can create just about anything.
 

Bubbles

2022 Asshat Award Winner
<Bronze Donator>
51,819
-99,291
seems about right


q8HCWva.jpg
 

BrutulTM

Good, bad, I'm the guy with the gun.
<Silver Donator>
16,326
947
What does the subscription get you? I've been mostly using Gemini and I find it super useful but I don't know what I would want to pay for.
 

BrutulTM

Good, bad, I'm the guy with the gun.
<Silver Donator>
16,326
947
I heard someone describe the current AI business model as "selling hundred dollar bills for a buck". I wonder how affordable it will be if this eventually shakes out into a couple of huge companies and the rest go bankrupt.
 

Noodleface

A Mod Real Quick
39,840
18,567
What does the subscription get you? I've been mostly using Gemini and I find it super useful but I don't know what I would want to pay for.
For Claude you get access to the latest models and a varying amount of tokens. Now it becomes tokenomics.

Gemini is mostly fine but it's not in the same league of anthropic models. They are revolutionary.
 
  • 1Like
Reactions: 1 user

Control

Golden Baronet of the Realm
5,984
16,732
I heard someone describe the current AI business model as "selling hundred dollar bills for a buck". I wonder how affordable it will be if this eventually shakes out into a couple of huge companies and the rest go bankrupt.
Eh, I think that's all a marketing ploy. I'm sure the training is expensive, but I think the costs of actually running the models is overblown. The top open models may not be quite as good as Claude, but they're probably in the same ballpark of cost to run, and 3rd party providers offer then at a fraction of the cost. And the models are getting MUCH more efficient. I've posted it a few times before, but anyone with a good gaming pc can run a local model today better than Claude from a year ago.
 

Control

Golden Baronet of the Realm
5,984
16,732
/airustledshowerthoughts
I get mad at the ai, and then I tell myself it's dumb to get mad at the ai since it's just a smart toaster. but I'd also get mad at the dumb toaster if it burnt my toast over and over for like 10 hours while assuring me each time that the next time will be the time that it fixes the burnt toast problem. (...obviously also mad at myself for burning 10 hours of toast, but that's clearly proper, so not much of a shower thought).
Fail Charlie Brown GIF by Peanuts
 

Deathwing

<Bronze Donator>
17,793
8,757
How do you measure if you're too reliant on AI?

My boss made an offhand remark recently that he uses Claude to do everything. I think most people interpreted it to mean within the context of coding, but I've seen him use it to write performance reviews. That aside, he's a pretty smart guy, I'm not worried about his coding skills. I am worried about mine.

I have it write commit messages, MR descriptions, review code(mine and others), and all sorts of coding tasks from the simplest(add this option to the test system) to potentially much more complex(I have this problem, here's a log, how fix? ok, implement that fix). The simple coding tasks aren't much of a time saver, but I still use it so that it's part of the AI's memory when comes time to write commit messages and review code.

My only internal counterpoints is that it sucks at commenting and it's overly verbose by default. I have to tell it be very succinct and I still end up rewriting a lot of comments. For code reviews, I usually end up rejecting a third of the findings.
 
  • 1Like
Reactions: 1 user

Haus

I am Big Balls!
<Gold Donor>
21,101
87,167
OK. so maybe some folks around here have had some experience with some of these so can give some insight.....

AI home lab :
Main box :
  • i7, 32GB RAM, Nvidia 4070 with 12G and Nvidia 3060 with 8GB. (32GB RAM upgrade inbound for this one)
  • Linux based
  • Running Open WebUI as the AI front end, with Ollama on the back end.
  • Currently running Qwen3:14b (nicely spread across GPUs)
  • External Google CORAL AI coprocessor dongle for eventual DVR use. (going to install Frigate)
New Box :
  • i7, 64GB RAM, No GPUs yet, starting off it's life as a huge ass RAID based storage blob for now. (5x 8TB drives, striped with parity)
  • Also Linux
My goal was to get the AI box to act as my "sysadmin" and configure crap for me I wanted on the second box. Mostly as a test of how well it might be able to work. Seems pretty straight forward. Install an MCP on the new box, tell the model about it, let is ping the MCP for manifest of commands, and then get to work. I've set up MCPs before and connected them to models. But this just refuses to work. I put the details of the new box into Open Webui as a new integration (openapi method, shared secret for auth). I dig down to the point of watching logs on both systems for the processes. The Open Webui system is never making a call out to get the manifest, even though when I set it up and hit "test connection" it said it connected fine. Never opening the connection at all. Obviously new box is twiddling it's thumbs waiting for something to happen.

Anybody else hit a roadblock like this? I spent half of Friday going through every troubleshooting reference I could find, including asking other "bigger brained" AIs for help. No dice...
 

Control

Golden Baronet of the Realm
5,984
16,732
OK. so maybe some folks around here have had some experience with some of these so can give some insight.....

AI home lab :
Main box :
  • i7, 32GB RAM, Nvidia 4070 with 12G and Nvidia 3060 with 8GB. (32GB RAM upgrade inbound for this one)
  • Linux based
  • Running Open WebUI as the AI front end, with Ollama on the back end.
  • Currently running Qwen3:14b (nicely spread across GPUs)
  • External Google CORAL AI coprocessor dongle for eventual DVR use. (going to install Frigate)
New Box :
  • i7, 64GB RAM, No GPUs yet, starting off it's life as a huge ass RAID based storage blob for now. (5x 8TB drives, striped with parity)
  • Also Linux
My goal was to get the AI box to act as my "sysadmin" and configure crap for me I wanted on the second box. Mostly as a test of how well it might be able to work. Seems pretty straight forward. Install an MCP on the new box, tell the model about it, let is ping the MCP for manifest of commands, and then get to work. I've set up MCPs before and connected them to models. But this just refuses to work. I put the details of the new box into Open Webui as a new integration (openapi method, shared secret for auth). I dig down to the point of watching logs on both systems for the processes. The Open Webui system is never making a call out to get the manifest, even though when I set it up and hit "test connection" it said it connected fine. Never opening the connection at all. Obviously new box is twiddling it's thumbs waiting for something to happen.

Anybody else hit a roadblock like this? I spent half of Friday going through every troubleshooting reference I could find, including asking other "bigger brained" AIs for help. No dice...
I've had odd issues with MCP control a couple of times. Both times I ended up bypassing the issue by adding a script to whatever i was working on that would listen for commands from the source box. I would have thought that would be essentially the same thing, but it worked when the MCP didn't /shrug.
 

Haus

I am Big Balls!
<Gold Donor>
21,101
87,167
I've had odd issues with MCP control a couple of times. Both times I ended up bypassing the issue by adding a script to whatever i was working on that would listen for commands from the source box. I would have thought that would be essentially the same thing, but it worked when the MCP didn't /shrug.
In my case I figured the MCP structure should have been easier. One core MCP, and subordinates running off it from the various things which will eventually be on that machine. (OS right now, NAS next on it, then it will become the new home automation server) But you're right, in this case I might just have to go the script route. It's just strange that I've connected other openAI format MCPs to it and it just won't even say hello to this one.
 
  • 1Like
Reactions: 1 user

Quevy

<Gold Donor>
7,068
23,331
OK. so maybe some folks around here have had some experience with some of these so can give some insight.....

AI home lab :
Main box :
  • i7, 32GB RAM, Nvidia 4070 with 12G and Nvidia 3060 with 8GB. (32GB RAM upgrade inbound for this one)
  • Linux based
  • Running Open WebUI as the AI front end, with Ollama on the back end.
  • Currently running Qwen3:14b (nicely spread across GPUs)
  • External Google CORAL AI coprocessor dongle for eventual DVR use. (going to install Frigate)
New Box :
  • i7, 64GB RAM, No GPUs yet, starting off it's life as a huge ass RAID based storage blob for now. (5x 8TB drives, striped with parity)
  • Also Linux
My goal was to get the AI box to act as my "sysadmin" and configure crap for me I wanted on the second box. Mostly as a test of how well it might be able to work. Seems pretty straight forward. Install an MCP on the new box, tell the model about it, let is ping the MCP for manifest of commands, and then get to work. I've set up MCPs before and connected them to models. But this just refuses to work. I put the details of the new box into Open Webui as a new integration (openapi method, shared secret for auth). I dig down to the point of watching logs on both systems for the processes. The Open Webui system is never making a call out to get the manifest, even though when I set it up and hit "test connection" it said it connected fine. Never opening the connection at all. Obviously new box is twiddling it's thumbs waiting for something to happen.

Anybody else hit a roadblock like this? I spent half of Friday going through every troubleshooting reference I could find, including asking other "bigger brained" AIs for help. No dice...
If you are running multiple cards, you might want to think of using llama cpp. I heard it drastically improves multi card performance. I think there is another one that's even better for multigpu, but I can't think of it atm.
 

ToeMissile

Pronouns: zie/zhem/zer
<Gold Donor>
3,819
2,603
If you are running multiple cards, you might want to think of using llama cpp. I heard it drastically improves multi card performance. I think there is another one that's even better for multigpu, but I can't think of it atm.
I’ve read llama runs more efficiently in general than ollama. Have been meaning to switch over but my local usage isn’t too demanding at this point