KServe
Open-source generative and predictive AI model serving on Kubernetes
Tools for serving, routing, evaluating and monitoring large language models
206tools listed
Pricing mix
Open-source generative and predictive AI model serving on Kubernetes
Open-source context database that organizes AI agent knowledge, memory, and skills in a virtual filesystem.
Run Claude Code's autonomous coding workflow with DeepSeek, OpenRouter, Fireworks AI, or Anthropic backends.
Open-source LLM and vision-language model inference in C/C++ for local and cloud hardware.
On-demand model switching for local AI servers with OpenAI and Anthropic API compatibility.
A portable, single-file memory layer for AI agents with offline retrieval and long-term memory.
Open-source LLM API management and key redistribution through a unified OpenAI-compatible interface.
An archived, open-source inference library for running Mistral models through Python and command-line tools.
Self-hosted AI gateway for model routing, API access control, usage tracking, and cost accounting.
Open-source multimodal models for image understanding and text-to-image generation
Open-source transformer training examples and GPU-optimized building blocks for distributed model training.
Open-source text-to-text transformer library for training, fine-tuning, and evaluating NLP models.
Open-source prompt generation, testing and ELO ranking in Google Colab or local Jupyter notebooks.
Open-source benchmark for evaluating language models with JSON and programmatic tasks
Graph database for knowledge graphs, GraphRAG, and agent memory, with OpenCypher queries and Redis client access.
Local-first permission policies, one-time approvals, and redacted audit logs for MCP tool calls.
Open-source inference engine for local LLMs, tool calling, speech recognition and speech synthesis
Open-source model optimization library for quantization, pruning, distillation and faster inference.
Open-source agent memory with retain, recall and reflect tools, self-hosted deployment and managed cloud access.
Open-source proxy server for accessing CLI models through OpenAI, Gemini, Claude, Codex, and Grok-compatible APIs.
Open-source inference engine that tunes local models for your hardware and connects them to coding agents.
Open-source infrastructure for improving agent model weights, prompts, rules, and skills from feedback.
Open-source reinforcement learning framework for large-scale LLM and VLM post-training.
Open-source Python library for loading, streaming, and preprocessing machine learning datasets.
Open-source inference and serving framework for large language, vision-language, and diffusion models.
Run Gemma 4 26B-A4B locally on Apple Silicon Macs using about 2 GB of RAM.
Open-source model routing for AI agents, with Rust embedding and gateway integrations.
Open-source web crawling and extraction for AI, with Python, Docker, CLI and hosted API access.
Memory-aware GGUF inference with CPU and GPU offloading and an OpenAI-compatible server.
Open-source C99 inference engine for running Kimi K3 on a CPU without BLAS, a framework or a GPU.
An open-source differential privacy gateway for AI agents querying sensitive data over MCP.
Open-source infrastructure for running, snapshotting and forking agent environments across machines.
Open-source Rust machine learning framework for model training, GPU inference, and browser-based models.
Open-source LLM data preparation with reusable operators, visual pipelines, and data generation and cleaning workflows.
Connect ChatGPT accounts to apps through an OpenAI-compatible proxy, TypeScript SDK and browser sign-in.
Open-source, reasoning-based document retrieval using hierarchical tree indexes instead of vector databases.