So a minimum of 3x RTX Pro 6000 to run 1-bit at ~76% accuracy or MacStudio 512GB... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

storus 16 days ago | parent | context | favorite | on: GLM-5.2 – How to Run Locally

So a minimum of 3x RTX Pro 6000 to run 1-bit at ~76% accuracy or MacStudio 512GB RAM to run 4-bit at ~97% accuracy.

iaw 16 days ago [–]

No. Unsloth has CPU offloading. It'll be slow but it'll work even with SSD offloading.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact