The creator of AI Hardware Fit has released a free, open-source browser tool designed to help users determine if a local model fits on their GPU and compare suitable hardware options. The tool addresses the complexity of piecing together model files, quantization, context length, and runtime support from disparate sources.
- Users can start with a specific GPU to view candidate models, suggested quantizations, estimated VRAM and speed ranges, and commands for Ollama or llama.cpp.
- Alternatively, starting with a model allows users to compare suitable GPUs based on budget, power consumption, and form factor.
- The catalog currently includes 151 GPU presets and 332 AI models, featuring quick picks for Mac mini M4 (32GB) and M4 Pro (64GB).
- The interface displays VRAM-quality frontiers using published benchmark scores and price-speed frontiers for compatible GPUs.
The tool aims to provide transparent evidence by labeling exact-condition measurements, calibrated ranges, and calculated estimates separately, helping users make informed planning decisions for local AI deployment.