IT/Software career thread: Invert binary trees for dollars.

Phelps McManus

Phelps McManus

<Silver Donator>
265
257
Noodleface said:
Think about a place like nvidia where jensen said if your senior devs aren't using 250k tokens they shouldn't be employed. 250k tokens is more than we have allocated for our entire couple hundred developers. We get between 100-700 tokens a month.
Click to expand...

Something is off on your scale or maybe you are taking about context sizes? I burn through a million tokens ($3 of Claude sonnet) in around 1-2 hours, and I am fairly diligent about clearing my context between prompts. If Claude says it is compacting, that means you hit the 50k context limit, which is eating up over 50k tokens on that one prompt (50k in plus whatever compacted version comes out). They have 1mil context models and I cannot imagine the burn rate for people who use them.
 
Noodleface

Noodleface

A Mod Real Quick
39,556
18,137
Phelps McManus said:
Something is off on your scale or maybe you are taking about context sizes? I burn through a million tokens ($3 of Claude sonnet) in around 1-2 hours, and I am fairly diligent about clearing my context between prompts. If Claude says it is compacting, that means you hit the 50k context limit, which is eating up over 50k tokens on that one prompt (50k in plus whatever compacted version comes out). They have 1mil context models and I cannot imagine the burn rate for people who use them.
Click to expand...
Maybe there's a layer of abstraction at my site I'm not privy too. Makes a lot more sense now lol
 
Khane

Khane

Got something right about marriage
21,780
15,707
Kithani said:
I burned so many Chuk E tokens on TMNT back in the day
Click to expand...

This is not far off from what the future of AI is going to be. Once everyone is completely dependent on it, and most companies have replaced people who actually know how to do the job without it with outsourced, low-cost, low-IQ workers.
 
  • 1Mother of God
Reactions: 1 user
You must log in or register to reply here.