IT/Software career thread: Invert binary trees for dollars.

Phelps McManus

Phelps McManus

<Silver Donator>
265
257
Noodleface said:
Think about a place like nvidia where jensen said if your senior devs aren't using 250k tokens they shouldn't be employed. 250k tokens is more than we have allocated for our entire couple hundred developers. We get between 100-700 tokens a month.
Click to expand...

Something is off on your scale or maybe you are taking about context sizes? I burn through a million tokens ($3 of Claude sonnet) in around 1-2 hours, and I am fairly diligent about clearing my context between prompts. If Claude says it is compacting, that means you hit the 50k context limit, which is eating up over 50k tokens on that one prompt (50k in plus whatever compacted version comes out). They have 1mil context models and I cannot imagine the burn rate for people who use them.
 
Noodleface

Noodleface

A Mod Real Quick
39,556
18,137
Phelps McManus said:
Something is off on your scale or maybe you are taking about context sizes? I burn through a million tokens ($3 of Claude sonnet) in around 1-2 hours, and I am fairly diligent about clearing my context between prompts. If Claude says it is compacting, that means you hit the 50k context limit, which is eating up over 50k tokens on that one prompt (50k in plus whatever compacted version comes out). They have 1mil context models and I cannot imagine the burn rate for people who use them.
Click to expand...
Maybe there's a layer of abstraction at my site I'm not privy too. Makes a lot more sense now lol
 
Khane

Khane

Got something right about marriage
21,782
15,708
Kithani said:
I burned so many Chuk E tokens on TMNT back in the day
Click to expand...

This is not far off from what the future of AI is going to be. Once everyone is completely dependent on it, and most companies have replaced people who actually know how to do the job without it with outsourced, low-cost, low-IQ workers.
 
  • 1Mother of God
Reactions: 1 user
ShakyJake

ShakyJake

<Donor>
8,521
21,165
Khane said:
This is not far off from what the future of AI is going to be. Once everyone is completely dependent on it, and most companies have replaced people who actually know how to do the job without it with outsourced, low-cost, low-IQ workers.
Click to expand...
I'm not so sure. Unless AI becomes good at mind-reading, it takes real skill to craft effective prompts and steer the AI correctly to get the result you want. We have some Indian contractors that appear to be using AI for their code and it's a weird mess.
 
Khane

Khane

Got something right about marriage
21,782
15,708
ShakyJake said:
I'm not so sure. Unless AI becomes good at mind-reading, it takes real skill to craft effective prompts and steer the AI correctly to get the result you want. We have some Indian contractors that appear to be using AI for their code and it's a weird mess.
Click to expand...

That won't stop executives that dont understand it from outsourcing, which is already happening en masse.
 
You must log in or register to reply here.