ReleaseModeModelRunner ‐ production mode implementation of the MLModelRunner. It uses an AOT‐compiled SavedModel for efficient execution.

Synopsis

Declared in <llvm/Analysis/ReleaseModeModelRunner.h>

struct EmbeddedModelRunnerOptions;

Member Functions

Data Members

Name

Description

FeedPrefix

Feed and Fetch feature prefixes ‐ i.e. a feature named "foo" will be looked up as {FeedPrefix}_foo; and the output named "bar" will be looked up as {FetchPrefix}_bar

FetchPrefix

ModelSelector

ModelSelector is the name (recognized by the AOT‐ed model) of a sub‐model to use. "" is allowed if the model doesn't support sub‐models.

Created with MrDocs