ReleaseModeModelRunner - production mode implementation of the MLModelRunner. It uses an AOT-compiled SavedModel for efficient execution.
Declared in <llvm/Analysis/ReleaseModeModelRunner.h>
struct EmbeddedModelRunnerOptions;
| Name |
|---|
setFeedPrefix |
setFetchPrefix |
setModelSelector |
| Name | Description |
|---|---|
FeedPrefix | Feed and Fetch feature prefixes - i.e. a feature named "foo" will be looked up as {FeedPrefix}_foo; and the output named "bar" will be looked up as {FetchPrefix}_bar |
FetchPrefix | |
ModelSelector | ModelSelector is the name (recognized by the AOT-ed model) of a sub-model to use. "" is allowed if the model doesn't support sub-models. |