Production MLModelRunner that evaluates an AOT‐compiled SavedModel.

Synopsis

Declared in <llvm/Analysis/ReleaseModeModelRunner.h>

template<class TGen>
class ReleaseModeModelRunner final
    : public MLModelRunner

Description

It uses an AOT‐compiled SavedModel for efficient execution.

Base Classes

Name

Description

MLModelRunner

Interface for evaluating an ML model given tensors as arguments.

Enums

Name

Description

Kind

Kind of concrete MLModelRunner implementation.

Member Functions

Name

Description

ReleaseModeModelRunner [constructor]

Construct a release‐mode runner over an AOT‐compiled model.

~ReleaseModeModelRunner [destructor] [virtual]

Destroy this ReleaseModeModelRunner.

operator= [deleted]

Deleted copy assignment; MLModelRunner is not assignable.

evaluate

Evaluate the model and return the result cast to type T.

getKind

Return the concrete runner kind of this instance.

getTensor

getTensor overloads

getTensorUntyped

getTensorUntyped overloads

switchContext [virtual]

Switch the evaluation context to the named context Name.

Static Member Functions

Name

Description

classof

Return true if R is a ReleaseModeModelRunner.

Protected Member Functions

Name

Description

evaluateUntyped [virtual]

Run the model and return an untyped pointer to the result buffer.

setUpBufferForTensor

Bind input buffer Index to Buffer, or allocate owned storage.

Protected Data Members

Name

Description

Ctx

LLVM context used for diagnostics by this runner.

Type

Concrete kind of this MLModelRunner instance.

Created with MrDocs