MLEM now offers deployment to Kubernetes and Sagemaker with a single command.
Docker is a platform for shipping applications in an isolated environment known as a container.
Deploying to Docker essentially means running a model inside a Docker Container locally.
$ pip install mlem[docker]
# or
$ pip install dockerDeploying to a docker container involves 2 main steps:
docker build under the hood.docker run under the hood.One can do this via a single line:
$ mlem deploy run docker_container deployment.mlem -m model
💾 Saving deployment to deployment.mlem
⏳️ Loading model from model.mlem
🛠 Creating docker image mlem-deploy-1666728279
🛠 Building MLEM wheel file...
💼 Adding model files...
🛠 Generating dockerfile...
💼 Adding sources...
💼 Generating requirements file...
🛠 Building docker image mlem-deploy-1666728279:latest...
✅ Built docker image mlem-deploy-1666728279:latest
✅ Container mlem-deploy-1666728455 is upOne can check the docker image built via docker image ls which should give the
following output:
REPOSITORY TAG IMAGE ID CREATED SIZE
mlem-deploy-1666728279 latest fad02f76dbed 19 seconds ago 734MB
...and the running container with docker container ls:
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
0aa976159580 mlem-deploy-1666728279:latest "/bin/sh -c 'sh run.…" 26 seconds ago Up 25 seconds mlem-deploy-1666728455
...A lot of parameters can be configured, the full list of which can be accessed
using mlem deploy run docker_container -h.