Skip to main content

AI plugins

The 15 http plugins of the AI category.

AI15​

  • aiAn internal routing speed-up with no settings; added here it does nothing to requests.
  • ai-aliyun-content-moderationModerates request content with Alibaba Cloud before the LLM.
  • ai-aws-content-moderationModerates request content with AWS Comprehend before the LLM.
  • ai-cacheCaches LLM responses by exact or semantic match.
  • ai-lakera-guardChecks prompts with Lakera Guard before the LLM.
  • ai-prompt-decoratorPrepends or appends messages to the prompt sent to the LLM.
  • ai-prompt-guardAllows or denies prompts that match configured patterns.
  • ai-prompt-templateBuilds the prompt from a template and the request's variables.
  • ai-proxyProxies requests to an LLM provider with a unified API.
  • ai-proxy-multiProxies requests to several LLM providers with balancing and fallback.
  • ai-ragAdds retrieved documents to the prompt from a vector search.
  • ai-rate-limitingLimits requests to an LLM provider by tokens or count.
  • ai-request-rewriteRewrites the request body with an LLM before proxying.
  • mcp-bridgeBridges an MCP server's stdio transport over HTTP.
  • openapi-to-mcpServes an HTTP API to MCP clients from its OpenAPI document.
G8 dev · Apache APISIX® 3.19.0
Apache, Apache APISIX and APISIX are trademarks of The Apache Software Foundation.