llvm::EmbeddedModelRunnerOptions

ReleaseModeModelRunner - production mode implementation of the MLModelRunner. It uses an AOT-compiled SavedModel for efficient execution.

Synopsis

Declared in <llvm/Analysis/ReleaseModeModelRunner.h>

struct EmbeddedModelRunnerOptions;

Member Functions

Name
setFeedPrefix
setFetchPrefix
setModelSelector

Data Members

NameDescription
FeedPrefix Feed and Fetch feature prefixes - i.e. a feature named "foo" will be looked up as {FeedPrefix}_foo; and the output named "bar" will be looked up as {FetchPrefix}_bar
FetchPrefix
ModelSelector ModelSelector is the name (recognized by the AOT-ed model) of a sub-model to use. "" is allowed if the model doesn't support sub-models.