Hey everyone,
Framework, the modular laptop company, just released the best computer to run large LLMs locally, even 70B models — the Framework Desktop. The hardware is pretty cool, only 4.5L of volume are able to accomodate the 16-core, 32-thread AMD’s AI MAX 395+ and an 8060S iGPU that rivals with Nvidia’s 4070 Laptop.
It also comes with up to 128GB of RAM, 96GB of which can be used as VRAM. This means you can run the latest and best LLMs locally, without any access to the internet or having to rely on ChatGPT or DeepSeek. While it looks expensive at a first glance — the 128GB version costs more than 2000€ — a Mac Studio with only 64GB costs 2.5x times more, and both the CPU and GPU are beefier on this Framework machine.
Pre-orders start now, but it will only start shipping in Q3. That doesn’t seem to stop people as they already sold out the first 3 batches of all SKUs, and yesterday the website had a 20-minute waiting list just to enter.
What about you? Do you think this kind of product is exciting?
