Production MLModelRunner that evaluates an AOT‐compiled SavedModel.
Synopsis
Declared in <llvm/Analysis/ReleaseModeModelRunner.h>
template<class TGen>
class ReleaseModeModelRunner final
: public MLModelRunner
Description
It uses an AOT‐compiled SavedModel for efficient execution.
Base Classes
Name |
Description |
Interface for evaluating an ML model given tensors as arguments. |
Enums
Name |
Description |
Kind of concrete MLModelRunner implementation. |
Member Functions
Name |
Description |
|
Construct a release‐mode runner over an AOT‐compiled model. |
|
Destroy this ReleaseModeModelRunner. |
|
Deleted copy assignment; MLModelRunner is not assignable. |
Evaluate the model and return the result cast to type |
|
Return the concrete runner kind of this instance. |
|
|
|
|
|
|
Switch the evaluation context to the named context |
Static Member Functions
Name |
Description |
Return true if |
Protected Member Functions
Name |
Description |
|
Run the model and return an untyped pointer to the result buffer. |
Bind input buffer |