AI products & services

local-llm

Link

https://github.com/jamesob/local-llm

Mentioned in

1 video

Kind

Other tool — not classified as AI

What people use it for

• A build log and configuration project for running a large language model locally on four RTX Pro 6000 GPUs. It documents PCIe GPU interconnects, BIOS settings, kernel flags, and fixes for card-to-card bandwidth.
  Github Awesome