Edit on GitHub

apply-remote

Apply a deployed-model (possibly remotely) to data. The results will be saved as a MLEM object to output if provided. Otherwise, it will be printed to stdout.

Synopsis

usage: mlem apply-remote [options] [subtype] data

arguments:
[SUBTYPE]  Type of client. Choices: ['http', 'rmq']
DATA       Path to dataset object  [required]

Description

Models which are deployed somewhere remotely or are being served locally, can have their methods called using the apply-remote command. This command is similar to apply, with the only difference being the model is deployed remotely using a deployment, or served locally. To access the methods of the served model, a client is needed. Currently, the available clients are http and rmq - which are used to launch requests against the fastapi and rmq server types, correspondingly.

Options

  • -p, --project TEXT: Path to MLEM project [default: (none)]
  • --rev TEXT: Repo revision to use [default: (none)]
  • -o, --output TEXT: Where to store the outputs.
  • --target-project, --tp TEXT: Project to save target to [default: (none)]
  • -m, --method TEXT: Which model method is to be applied [default: predict]
  • --index / --no-index: Whether to index output in .mlem directory
  • --json: Output as json
  • -l, --load TEXT: File to load client config from
  • -c, --conf TEXT: Options for client in format field.name=value
  • -f, --file_conf TEXT: File with options for client in format field.name=path_to_config
  • -h, --help: Show this message and exit.

Example: Apply a locally hosted model to a local dataset

Given a hosted model server (see serve example as a way to easily do this) and a local MLEM dataset mydataset, run the following command to infer the entire dataset with the model and save the output result to myprediction

$ mlem apply-remote http mydataset --conf host="127.0.0.1" --conf port=3000 --output myprediction
Content

­čÉŤ Found an issue? Let us know! Or fix it:

Edit on GitHub

ÔŁô Have a question? Join our chat, we will help you:

Discord Chat