A community for local AI

Local models. Ordinary hardware.

Useful discussion about models, runtimes, hardware, and projects that run on machines people already own.

Boards

Models & Inference

Models & QuantizationModel releases, quantization, evaluation, and practical tradeoffs.Runtimes & ToolingLocal inference runtimes, APIs, integrations, and tooling.

Hardware & Projects

HardwareGPUs, CPUs, memory, thermals, laptops, and practical upgrades.Projects & WorkflowsShare useful local-AI projects and repeatable workflows.