Benchmarks show even an old Nvidia RTX 3090 is enough to serve LLMs to thousands

@[email protected] · 20 days ago

Benchmarks show even an old Nvidia RTX 3090 is enough to serve LLMs to thousands

@BigDaddySlim · 20 days ago

Right? Guess my 3090 K|ngP|n and FE cards are considered e-waste now and I should dispose of them appropriately. Wonder what that means for my 1050ti in my NAS

Benchmarks show even an old Nvidia RTX 3090 is enough to serve LLMs to thousands

Benchmarks show even an old Nvidia RTX 3090 is enough to serve LLMs to thousands

Old RTX 3090 enough to serve thousands of LLM users