LadyButterfly she/her@piefed.blahaj.zoneM to WomensStuff@piefed.blahaj.zoneEnglish · 5 days agoWhat do you think of AI?message-squaremessage-square55linkfedilinkarrow-up132arrow-down12
arrow-up130arrow-down1message-squareWhat do you think of AI?LadyButterfly she/her@piefed.blahaj.zoneM to WomensStuff@piefed.blahaj.zoneEnglish · 5 days agomessage-square55linkfedilink
minus-squaresunbrrnslapperlinkfedilinkEnglisharrow-up1·4 days agoI mean, you can put caps on token usage at the user level. Also, you can test while building so you have an estimated cost per run.
minus-squareZDL@lazysoci.allinkfedilinkEnglisharrow-up1·4 days agoWhen you look at the costs involved, putting caps on means you run out of tokens in your first morning of use per month. The sticker shock for the Copilot users was a couple orders of magnitude.
minus-squaresunbrrnslapperlinkfedilinkEnglisharrow-up1·4 days agoWe capped everyone at $50/month. You can see how many tokens you use per task my typing /cost. Then you can manage it. I’m not sure I can justify those other people’s poor/stupid behavior.
I mean, you can put caps on token usage at the user level. Also, you can test while building so you have an estimated cost per run.
When you look at the costs involved, putting caps on means you run out of tokens in your first morning of use per month.
The sticker shock for the Copilot users was a couple orders of magnitude.
We capped everyone at $50/month. You can see how many tokens you use per task my typing /cost. Then you can manage it.
I’m not sure I can justify those other people’s poor/stupid behavior.