The Nex2 mini Phase Twin, a 30B parameter model with 16GB footprint, is now available for Intel users, particularly the A770 lineup. It performs at 89 tokens per second on a single A770 card and is optimized to use the appropriate kernel based on hardware, with enhanced performance when paired with two cards.
Nex2 mini Phase Twin 16GB footprint, 30B model released
from English