Open-Source LLM Stack
Run and build with open-weight models: local runtimes, inference servers, and app frameworks.
NEWDeploying Local LLMs with Ollama
Run large language models locally with Ollama, supporting open-source models such as Llama and Mistral.
NEWvLLM High-Performance Inference Framework
A high-throughput inference and serving framework for large language models that significantly improves deployment efficiency via PagedAttention.
NEWOpen WebUI
A feature-rich, self-hosted AI chat interface that supports Ollama and OpenAI-compatible APIs and can run fully offline.
NEWLM Studio Local Model Client
A desktop app that downloads and runs open-source LLMs locally with one click, offering a graphical interface and an OpenAI-compatible API.
NEWDify LLM App Development Platform
An open-source LLM application development platform offering visual orchestration, a RAG engine, and Agent capabilities for building AI apps quickly.
NEWPyTorch Deep Learning Framework
A leading open-source deep learning framework known for its dynamic computation graph and ease of use, widely adopted in both research and production.
NEWHugging Face Transformers Tutorial
Learn to use the Hugging Face Transformers library for NLP and CV tasks.