Run enormous mixture-of-experts models by placing dense weights in resident memory, caching experts according to routing heat, and pre-fetching the next layer across VRAM, system memory, and NVMe.

Soon you can unlock how this was done.

Behind this: the tool used · the method · what actually resulted.