llama.cpp

High-performance local LLM inference

C/C++ local inference project supporting GGUF models and multi-platform deployment.

Open Models AI APIGGUF本地部署开源

Features

Free

Meta open model family

Meta's open-weight model family, a key foundation for local deployment and open ecosystems.

开源模型本地部署

Open source

Run open models locally

Run open models such as Llama, Qwen and Gemma locally with simple commands.

本地部署开源模型

Open source

Open-source LLM app platform

Visual platform for building chatbots, workflows, RAG and agent apps.

开源AgentRAG

Freemium

High-quality open image models

Black Forest Labs image model family for high-quality visual generation and developer integration.

图片开源模型