Old RTX 3090 enough to serve thousands of LLM users
go.theregister.com
For 100 concurrent users, the card delivered 12.88 tokens per second—just slightly faster than average human reading speed
    • @BigDaddySlimEnglish
      2•3 months ago

      Right? Guess my 3090 K|ngP|n and FE cards are considered e-waste now and I should dispose of them appropriately. Wonder what that means for my 1050ti in my NAS