A user on r/LocalLLaMA is considering adding a second RTX 3060 to their current setup, which includes an i5-8500, 48 GB of DDR4, and one RTX 3060 with 12 GB VRAM. They are currently running Gemma 4 26B-A4B (Q4_K_M) but find it lacks insight, while the 31B model is too slow due to insufficient VRAM.

  • The user wants to know if two RTX 3060s can load a Q4 or Q5 quantization of a 31B dense model.
  • They are concerned about performance penalties from the second PCIe slot being wired as x4 instead of x16.
  • The user asks if layer splitting would help mitigate the bottleneck caused by the limited bandwidth of the x4 slot.