Edit on GitHub


class FastAPIServer

MlemABC parent type: server

MlemABC type: fastapi

Serves model with http


  • request_serializer: Serializer - Serializer to use for all requests

  • response_serializer: Serializer - Serializer to use for all responses

  • standardize: bool = True - Use standard model interface

  • host: str = "" - Network interface to use

  • port: int = 8080 - Port to use

  • debug: bool = False - If true will not wrap exceptions


­čÉŤ Found an issue? Let us know! Or fix it:

Edit on GitHub

ÔŁô Have a question? Join our chat, we will help you:

Discord Chat