jaykrown to TechnologyEnglish · 10 hours agoDDR6 RAM shrinks by 44% while delivering 4X DDR5's baseline bandwidth — JEDEC previews 12.8 GT/s modules with up to 1 terabyte of capacity per slotwww.tomshardware.comexternal-linkmessage-square39linkfedilinkarrow-up1165arrow-down15cross-posted to: AIBubble
arrow-up1160arrow-down1external-linkDDR6 RAM shrinks by 44% while delivering 4X DDR5's baseline bandwidth — JEDEC previews 12.8 GT/s modules with up to 1 terabyte of capacity per slotwww.tomshardware.comjaykrown to TechnologyEnglish · 10 hours agomessage-square39linkfedilinkcross-posted to: AIBubble
minus-squareaksdblinkfedilinkEnglisharrow-up3·edit-222 minutes agoLLM workloads become faster with higher bandwidth, which directly translates to token per second. So it does matter for daily use. But you are right that more and slightly slower is still better than less but fast.
LLM workloads become faster with higher bandwidth, which directly translates to token per second. So it does matter for daily use.
But you are right that more and slightly slower is still better than less but fast.