A user on r/LocalLLaMA is considering adding a second RTX 3060 to their current setup, which includes an i5-8500, 48 GB of DDR4, and one RTX 3060 with 12 GB VRAM. They are currently running Gemma 4 26B-A4B (Q4_K_M) but find it lacks insight, while the 31B model is too slow due to insufficient VRAM.
- The user wants to know if two RTX 3060s can load a Q4 or Q5 quantization of a 31B dense model.
- They are concerned about performance penalties from the second PCIe slot being wired as x4 instead of x16.
- The user asks if layer splitting would help mitigate the bottleneck caused by the limited bandwidth of the x4 slot.