Best tools to run LLMs on your own machine
These tools let you download and run open-weight models locally with full data privacy, from a simple CLI to a polished chat UI.
Recommended tools
Open sourceIntermédiaire
4.6
NOUVEAUDeploying Local LLMs with Ollama
Run large language models locally with Ollama, supporting open-source models such as Llama and Mistral.
Local DeploymentOpen SourceOllama
OllamaMis à jour 2026-06-25
OutilDébutant
4.6
NOUVEAULM Studio Local Model Client
A desktop app that downloads and runs open-source LLMs locally with one click, offering a graphical interface and an OpenAI-compatible API.
LM StudioLocal DeploymentGUI
LM StudioMis à jour 2026-07-01
Open sourceIntermédiaire
4.7
NOUVEAUOpen WebUI
A feature-rich, self-hosted AI chat interface that supports Ollama and OpenAI-compatible APIs and can run fully offline.
Open WebUIInterfaceSelf-hosted
Open WebUIMis à jour 2026-06-28
Open sourceAvancé
4.7
NOUVEAUvLLM High-Performance Inference Framework
A high-throughput inference and serving framework for large language models that significantly improves deployment efficiency via PagedAttention.
vLLMInferenceHigh-Performance
vLLMMis à jour 2026-06-26