Edit on GitHub

Serving extensions

mlem serve functionality is used to spin up something that can serve models, like a FastAPI server or RabbitMQ producer/consumer. See User Guide for more details on how this works.

Serving extensions add new types of servers to use with serve API and CLI commands.

Typicaly they will implement Server and Client interfaces.

šŸ› Found an issue? Let us know! Or fix it:

Edit on GitHub

ā“ Have a question? Join our chat, we will help you:

Discord Chat