Local neuro-symbolic memory for offline AI, with verified fact retrieval and an OpenAI-compatible API.
LLM Infrastructure
Tools for serving, routing, evaluating and monitoring large language models
206tools listed
Pricing mix
- 102 Free
- 85 Freemium
- 19 Paid
- Freemium
Audit Claude Code token usage, diagnose limits, and trace context overhead from local session logs.
FreeOpen-source Kubernetes orchestration for stateful sandboxes, AI agent runtimes, and reinforcement learning workloads.
FreeOpen-source optimization of prompts, code, agent architectures, and configurations using LLM reflection.
FreeRun Qwen Mixture-of-Experts models locally on Macs and iPhones by streaming expert weights from storage.
FreeOpen-source AI red teaming with agent, skill, MCP, infrastructure and LLM security scanners.
FreeDesktop account management, API protocol conversion, and request routing for AI services.
FreeOpen-source PyTorch distributed training and fine-tuning for language and vision-language models
FreeOpen-source AI gateway for enterprise model routing, access control, usage attribution, and cost governance.
FreePack repositories into AI-friendly files with token counts, configurable exclusions, and optional code compression.
FreeOpen-source context graphs, knowledge graphs, deterministic reasoning, and decision provenance for AI systems.
FreeOpen-source orchestration for durable AI agents, stateful applications, and replayable workflows.
FreeOpen-source local LLM inference for Metal, CUDA and ROCm, with a coding agent and HTTP server.
FreePersistent memory for AI agents using a Python script, an append-only log and searchable summaries.
FreeOfficial Python library for the OpenAI API with synchronous, asynchronous, streaming, and Realtime support.
FreeSkillOpt trains reusable natural-language skills for frozen LLM agents without changing model weights.
FreeLocal-first clinical entity extraction and PII de-identification across Python, Apple, Android and browser runtimes.
FreeAn open-source Python framework for building language model systems and optimizing their prompts and weights.
FreeA shared memory hub for AI agents that turns conversations, documents, and code into reusable team assets.
FreeAn open-source Python library for controlling language model output with grammars, regex and JSON schemas.
FreeA locally installed interface for LLM chat, image generation, and text-to-speech models.
FreeMeilisearch provides full-text, semantic, and hybrid search through an API, with managed and self-hosted deployment.
FreemiumOpen-source RAG engine for document understanding, agentic retrieval, and structured knowledge compilation.
FreeOpen-source sandbox service for AI agents with MicroVM isolation, E2B SDK compatibility, and snapshot management.
FreeRust-based Python sandbox for running AI-generated code with controlled access to host functions and mounts.
FreemiumOpen-source distributed LLM inference serving with intelligent routing and production operations on Kubernetes.
FreeAn open-source runtime that isolates AI agents and enforces policies for files, networks, processes, and credentials.
FreeLocal-first AI memory with verbatim conversation storage, semantic search, CLI access and MCP integration.
FreeOpen-source OCR and document parsing that converts PDFs and images into structured Markdown and JSON for AI workflows.
FreePersistent memory for Claude Code with automatic recall, conversation capture, and shared repository context.
FreemiumFind local LLMs that fit your CPU, RAM, GPU, and VRAM, with hardware detection and performance estimates.
Free



































