Skip to content
Sign in
  • Browse all toolsFilter by category and pricing
  • Browse categoriesWriting, code, image, audio and more
  • Compare toolsPut up to three side by side
  • Read the blogGuides and comparisons
  • guidance

    www.github.com

    An open-source Python library for controlling language model output with grammars, regex and JSON schemas.

    Free
  • SillyTavern

    www.github.com

    A locally installed interface for LLM chat, image generation, and text-to-speech models.

    Free
  • LlamaIndex

    www.github.com

    Open-source framework for building RAG and agent applications with private data.

    Free
  • RAGFlow

    www.github.com

    Open-source RAG engine for document understanding, agentic retrieval, and structured knowledge compilation.

    Free
  • whichllm

    www.github.com

    Find and run local LLMs ranked by hardware fit, estimated speed and benchmark quality.

    Free
  • CubeSandbox

    www.github.com

    Open-source sandbox service for AI agents with MicroVM isolation, E2B SDK compatibility, and snapshot management.

    Free
  • llm-d

    www.github.com

    Open-source distributed LLM inference serving with intelligent routing and production operations on Kubernetes.

    Free
  • OpenShell

    www.github.com

    An open-source runtime that isolates AI agents and enforces policies for files, networks, processes, and credentials.

    Free
  • BitNet

    www.github.com

    Open-source inference framework for running 1-bit language models on CPUs and GPUs.

    Free
  • MemPalace

    www.github.com

    Local-first AI memory with verbatim conversation storage, semantic search, CLI access and MCP integration.

    Free
  • PaddleOCR

    www.github.com

    Open-source OCR and document parsing that converts PDFs and images into structured Markdown and JSON for AI workflows.

    Free
  • llmfit

    www.github.com

    Find local LLMs that fit your CPU, RAM, GPU, and VRAM, with hardware detection and performance estimates.

    Free
  • supermemory

    www.github.com

    An open-source memory and context engine for AI agents, apps, and coding assistants.

    Free
  • KServe

    www.github.com

    Open-source generative and predictive AI model serving on Kubernetes

    Free
  • deepclaude

    www.github.com

    Run Claude Code's autonomous coding workflow with DeepSeek, OpenRouter, Fireworks AI, or Anthropic backends.

    Free
  • llama.cpp

    www.github.com

    Open-source LLM and vision-language model inference in C/C++ for local and cloud hardware.

    Free
  • llama-swap

    www.github.com

    On-demand model switching for local AI servers with OpenAI and Anthropic API compatibility.

    Free
  • Memvid

    www.github.com

    A portable, single-file memory layer for AI agents with offline retrieval and long-term memory.

    Free
  • One API

    www.github.com

    Open-source LLM API management and key redistribution through a unified OpenAI-compatible interface.

    Free
  • Mistral Inference

    www.github.com

    An archived, open-source inference library for running Mistral models through Python and command-line tools.

    Free
  • New API

    www.github.com

    Self-hosted AI gateway for model routing, API access control, usage tracking, and cost accounting.

    Free
  • DeepSeek Janus

    www.github.com

    Open-source multimodal models for image understanding and text-to-image generation

    Free
  • Megatron-LM

    www.github.com

    Open-source transformer training examples and GPU-optimized building blocks for distributed model training.

    Free
  • Google T5

    www.github.com

    Open-source text-to-text transformer library for training, fine-tuning, and evaluating NLP models.

    Free
  • GPT Prompt Engineer

    www.github.com

    Open-source prompt generation, testing and ELO ranking in Google Colab or local Jupyter notebooks.

    Free
  • BIG-bench

    www.github.com

    Open-source benchmark for evaluating language models with JSON and programmatic tasks

    Free
  • FalkorDB

    www.github.com

    Graph database for knowledge graphs, GraphRAG, and agent memory, with OpenCypher queries and Redis client access.

    Free
  • ToolPermit

    www.github.com

    Local-first permission policies, one-time approvals, and redacted audit logs for MCP tool calls.

    Free
  • nobodywho

    www.github.com

    Open-source inference engine for local LLMs, tool calling, speech recognition and speech synthesis

    Free
  • Open-source model optimization library for quantization, pruning, distillation and faster inference.

    Free
  • CLIProxyAPI

    www.github.com

    Open-source proxy server for accessing CLI models through OpenAI, Gemini, Claude, Codex, and Grok-compatible APIs.

    Free
  • Magnitude

    www.github.com

    Open-source inference engine that tunes local models for your hardware and connects them to coding agents.

    Free
  • reef

    www.github.com

    Open-source infrastructure for improving agent model weights, prompts, rules, and skills from feedback.

    Free
  • Miles

    www.github.com

    Open-source reinforcement learning framework for large-scale LLM and VLM post-training.

    Free
  • datasets

    www.github.com

    Open-source Python library for loading, streaming, and preprocessing machine learning datasets.

    Free
  • SGLang

    www.github.com

    Open-source inference and serving framework for large language, vision-language, and diffusion models.

    Free