Is this because the graphics cards are not using all available PCIe bandwidth? O... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		metadat on Sept 9, 2024 \| parent \| context \| favorite \| on: Serving AI from the Basement – 192GB of VRAM Setup Is this because the graphics cards are not using all available PCIe bandwidth? Or why?

angoragoats on Sept 9, 2024 [–]

Yes. In fact, even running a video card in a 4x slot (again, assuming PCIe 4.0) results in only a modest (5-20%, depending on what you’re doing) drop in speeds.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact