SnausagesinaBlanket to Ask Lemmy · 20 days agoIs there a currently an accurate way to say how much power per prompt LLMs use?message-squaremessage-square23linkfedilinkarrow-up147arrow-down14
arrow-up143arrow-down1message-squareIs there a currently an accurate way to say how much power per prompt LLMs use?SnausagesinaBlanket to Ask Lemmy · 20 days agomessage-square23linkfedilink
minus-squareEvotechlinkfedilinkarrow-up1·19 days agoIt will vary based on the llm, tokens and tool calls
It will vary based on the llm, tokens and tool calls