Model Governance: Standard Model Definition
This article describes how to use the ModelOp Command Center as the central repository for governing models, including how ModelOp Center provides a standard representation of a model regardless of the model factory from which it came, or the infrastructure upon which it will run.
Table of Contents
Standard Model Definition
ModelOp Center provides the most robust and extensible definition of a model to allow for consistent deployment, monitoring, and governance of all models across the enterprise.
Elements of the Standard Model Definition
The ModelOp Standard Model Definition includes all of the metadata, technical model details, version information, MLC’s, and test results related to a given model. This information is listed in the Model Details page within ModelOp Center:
Model Info |
Custom Metadata: Note that Custom Metadata can be added to a given model. Any metadata that adheres to valid JSON can be added/updated throughout the lifecycle of the model. The Custom Metadata will be displayed in the Model Details page. See the “Model Governance: Standard Model Definition” reference document for more details on adding/modifying custom metadata.
|
Model Source | Provides details of all the source code assets, typically stored in a remote git repository. The “Source” tab provides a view into the actual source code asset: The “Metadata” tab lists all of the details of the source code management capability that is backing the source code assets, including remote repository URL / branch, last commit ID, and the repository type:
|
Schemas | Defines the input and output schemas to which the input data and output scores must adhere as part of model scoring. The schemas use the well-adopted Avro standard to enable a contract between the data ingress / egress and the model code. For more information on creating input and output schemas, see the Schema Management page. |
Versions | Detailed list of all versions of the model, last modification date, related tests, and a URL to view the Version details. See the “Model Governance: Model Versioning” page for more details on model versions. |
Model Platform | Lists the dependencies used by the model, both system and framework-specific libraries/frameworks. Note that the current libraries are captured via the ModelOp Center Jupyter plugin. |
Attachments | Attachments are other model artifacts used during the life cycle of a model, including items such as training model coefficients/binaries, documents, decision tables, test data references, or other items. For each attachment, an “Asset Role” can be assigned (e.g. weights file, test data, readme), which can be leveraged to enable seamless usage of the attachment within a Model Life Cycle (MLC). |
For more details on the metadata that is collected and persisted for a Model, see the “Model Governance: Standard Model Definition” reference document.
Supported Languages & Frameworks
While ModelOp Center supports almost any model language, framework, and overall model factory, below is a sampling of some of the more common ones that are supported in ModelOp Center. Each of these are encoded in ModelOp Center’s standard model definition
Next Article: Model Governance: Production Model Inventory >