| Aphrodite Engine |
https://github.com/PygmalionAI/aphrodite-engine |
tool, infrastructure |
integrated |
docs/tools/infrastructure/aphrodite-engine.md |
Inference engine forked from vLLM for local use |
| MLX |
https://github.com/ml-explore/mlx |
tool, infrastructure |
integrated |
docs/tools/infrastructure/mlx.md |
Apple's array framework for ML on Apple Silicon |
| vLLM |
https://github.com/vllm-project/vllm?update=2026-03-02 |
tool, infrastructure |
integrated |
docs/tools/infrastructure/vllm.md |
High-throughput LLM serving engine (PagedAttention) |
| Text Generation Inference (TGI) |
https://github.com/huggingface/text-generation-inference?update=2026-03-02 |
tool, infrastructure |
integrated |
docs/tools/infrastructure/tgi.md |
Hugging Face's production inference server |
| SGLang |
https://github.com/sgl-project/sglang?update=2026-03-02 |
tool, infrastructure |
integrated |
docs/tools/infrastructure/sglang.md |
Fast structured generation runtime from LMSYS |
| ExLlamaV2 |
https://github.com/turboderp/exllamav2?update=2026-03-02 |
tool, infrastructure |
integrated |
docs/tools/infrastructure/exllamav2.md |
Optimized GPTQ/EXL2 inference for consumer GPUs |
| LangGraph |
https://github.com/langchain-ai/langgraph?update=2026-03-02 |
tool, framework |
integrated |
docs/tools/agents/langgraph.md |
Stateful agent orchestration by LangChain. |
| Agency Swarm |
https://github.com/VRSEN/agency-swarm?update=2026-03-02 |
tool, framework |
integrated |
docs/tools/agents/agency-swarm.md |
Collaborative multi-agent orchestration framework. |
| Composio |
https://github.com/composiohq/composio?update=2026-03-02 |
tool |
integrated |
docs/tools/agents/composio.md |
Tool integration platform for AI agents. |
| Phidata |
https://github.com/agno-agi/agno?update=2026-03-02 |
tool, framework |
integrated |
docs/tools/agents/phidata.md |
Framework for building AI assistants with memory and tools. |
| Bee Agent Framework |
https://github.com/i-am-bee/beeai-framework?update=2026-03-02 |
tool, framework |
integrated |
docs/tools/agents/bee-agent-framework.md |
IBM's TypeScript/Python agent framework. |
| Agno |
https://github.com/agno-agi/agno?update=2026-03-02 |
tool, framework |
integrated |
docs/tools/agents/agno.md |
Lightweight Python framework (formerly Phidata v2). |
| DSPy |
https://github.com/stanfordnlp/dspy |
tool, framework |
integrated |
tools/frameworks/dspy.md |
Programming framework for algorithmically optimizing LLM prompts. |
| Haystack |
https://github.com/deepset-ai/haystack |
tool, framework |
integrated |
tools/frameworks/haystack.md |
Modular LLM framework for building RAG and search pipelines. |
| Semantic Kernel |
https://github.com/microsoft/semantic-kernel |
tool, framework |
integrated |
tools/frameworks/semantic-kernel.md |
Microsoft's SDK for integrating LLMs into applications. |
| CrewAI |
https://github.com/joaomdmoura/crewAI |
tool, framework |
integrated |
tools/frameworks/crewai.md |
Multi-agent orchestration framework. |
| AutoGen |
https://github.com/microsoft/autogen |
tool, framework |
integrated |
tools/frameworks/autogen.md |
Microsoft's multi-agent conversation framework. |
| Smolagents |
https://github.com/huggingface/smolagents |
tool, framework |
integrated |
tools/frameworks/smolagents.md |
Hugging Face's lightweight agent framework. |