If they really wanted to, they could charge for “GPU time” directly. Usage gets a bit complicated with batching and context caching, but its definitely a metric that could be precisely derived.
Don’t get me wrong though. That whole business model is doomed.
Eh, it’s close enough?
If they really wanted to, they could charge for “GPU time” directly. Usage gets a bit complicated with batching and context caching, but its definitely a metric that could be precisely derived.
Don’t get me wrong though. That whole business model is doomed.