A LLaMA-based research chatbot trained on user-shared conversations to handle multi-turn dialogue.
LLM Infrastructure
Tools for serving, routing, evaluating and monitoring large language models
206tools listed
Pricing mix
- 102 Free
- 85 Freemium
- 19 Paid
- Free
Manage and verify AI models, run them offline on a CPU, and serve responses locally.
FreeA cross-platform tensor library for running large machine learning models on commodity hardware.
FreePre-trained English embeddings and text classifiers for Node.js, with a focus on serverless cold-start performance.
FreeAn open-source TypeScript toolkit for building AI applications and agents with streaming and multi-provider support.
FreeA local gateway for choosing models, sharing subscriptions and masking secrets across coding agents.
FreeAn open-source programming language for AI agents with typed outputs, concurrency and built-in observability.
FreeOpen-source LLM inference and local serving for Apple silicon Macs using Metal megakernels and DSpark decoding.
FreeOpen-source AI accelerator with hardware design, a compiler, a simulator and profiling tools in one repository.
FreeOpen-source agentic reinforcement learning post-training with SGLang rollout and Megatron training.
FreeBuild Neo4j knowledge graphs from documents, videos and web pages, then query the data through chat.
FreeCompile notes, documents, and transcripts into a self-hosted Markdown wiki with cited answers and MCP access.
FreeOpen-source tokenization library for encoding and decoding text in research and production.
FreeOpen-source LLM inference with multimodal models, local coding agents, compatible APIs, and Python and Rust SDKs.
FreeOpen-source AI gateway for model routing, SDK compatibility, request tracing and cost control.
FreeAudit Claude Code token usage, diagnose limits, and trace context overhead from local session logs.
FreeOpen-source Kubernetes orchestration for stateful sandboxes, AI agent runtimes, and reinforcement learning workloads.
FreeOpen-source optimization of prompts, code, agent architectures, and configurations using LLM reflection.
FreeRun Qwen Mixture-of-Experts models locally on Macs and iPhones by streaming expert weights from storage.
FreeOpen-source AI red teaming with agent, skill, MCP, infrastructure and LLM security scanners.
FreeDesktop account management, API protocol conversion, and request routing for AI services.
FreeOpen-source PyTorch distributed training and fine-tuning for language and vision-language models
FreeOpen-source AI gateway for enterprise model routing, access control, usage attribution, and cost governance.
FreePack repositories into AI-friendly files with token counts, configurable exclusions, and optional code compression.
FreeOpen-source context graphs, knowledge graphs, deterministic reasoning, and decision provenance for AI systems.
FreeOpen-source orchestration for durable AI agents, stateful applications, and replayable workflows.
FreeOpen-source local LLM inference for Metal, CUDA and ROCm, with a coding agent and HTTP server.
FreePersistent memory for AI agents using a Python script, an append-only log and searchable summaries.
FreeOfficial Python library for the OpenAI API with synchronous, asynchronous, streaming, and Realtime support.
FreeSkillOpt trains reusable natural-language skills for frozen LLM agents without changing model weights.
FreeLocal-first clinical entity extraction and PII de-identification across Python, Apple, Android and browser runtimes.
FreeAn open-source Python framework for building language model systems and optimizing their prompts and weights.
FreeA shared memory hub for AI agents that turns conversations, documents, and code into reusable team assets.
Free



































