How to using the mcp bridge and set up the ai gatway to host mcp servers?

[Flcwl]

I see the post is so good for hosting mcp server with sse. https://apisix.apache.org/zh/blog/2025/04/21/host-mcp-server-with-api-gateway/

[dosubot[bot]]

Hello @Flcwl! 👋 I'm Dosu, your friendly assistant here to help you with bugs, questions, and contributing. I'm ready to assist while you wait for a human maintainer. Let's dive into your MCP server setup! 🚀

To set up an AI gateway for hosting MCP servers with Server-Sent Events (SSE) using Apache APISIX and the mcp-bridge plugin, follow these steps:

1. Install Apache APISIX: Ensure that Apache APISIX is installed and running in your environment.

2. Enable the mcp-bridge Plugin: Configure Apache APISIX to use the mcp-bridge plugin. This plugin will manage the MCP server subprocess, handle stdio, and convert HTTP SSE requests into MCP protocol calls.

3. Configure the MCP Server: Set up your MCP server to run as a subprocess under the control of the mcp-bridge plugin. The plugin will take over the stdio channel of the MCP server.

4. Set Up SSE Streaming: The mcp-bridge plugin will wrap MCP RPC calls into SSE message streams, allowing clients to receive real-time outputs from the subprocess as streaming SSE responses.

5. Manage Sessions: Utilize the plugin's lightweight session management features, including session ID, ping keep-alive, and queuing, to ensure stable connections and efficient resource management. The plugin supports session sharing across multiple workers, enhancing stability in multi-worker environments.

6. Integrate with APISIX Features: Leverage APISIX's traffic control, authentication, and rate-limiting plugins to manage access and ensure the scalability of your AI gateway. Use authentication plugins like OAuth 2.0, JWT, and OIDC to secure your API, and rate-limiting plugins to prevent system overload.

7. Future Enhancements: Consider the roadmap for future improvements, such as session sharing across multiple APISIX instances, event-driven architecture, and advanced session management modules.

By following these steps, you can effectively transform stdio-based MCP services into scalable HTTP SSE services managed through an API gateway, providing a modern interface for traditional services ^[1][2].

To continue talking to Dosu, mention @dosu.

---

^{Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Bug Report | Other}

[Flcwl]

@dosu Have any guide docs to using these abilities? such as How to enable the mcp-bridge Plugin?

[dosubot[bot]]

You can find the official documentation for enabling the mcp-bridge plugin in Apache APISIX at the following link: Documentation ^[1].

To continue talking to Dosu, mention @dosu.

---

^{Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Bug Report | Other}

[Flcwl]

@dosu The documentaion link is homepage, No answer for me

[dosubot[bot]]

This is a tough nut to crack, could really use your help on this, @moonming.

To continue talking to Dosu, mention @dosu.

---

^{Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Bug Report | Other}

[Flcwl]

Nobody maintain it now?

[moonming]

you can check PR and test cases #12151

[Flcwl]

@moonming have any demo to config it? I want to try but I don't know how use apisix to setup mcp servers. thx~

[Flcwl]

Is this configuration correct? It seems that the plugin can't be found?

[moonming]

you need to try master code of apisix

[Flcwl]

you need to try master code of apisix你需要尝试 apisix 的主代码

Can u tell me how to use master code of apisix please?

[Flcwl]

hello, why close it? I think this is good idea to support mcp servers