The ModelOp Command Center displays a single screen with access to all of the tools to monitor and manage your models. This section describes the components of the Command Center which appear on the Dashboard. The components include the three panes in the middle of the screen, and the four icons in the column on the left.
Models Pane
On the Models pane, you can see the current status of the models in your system. The Models pane shows:
The number of models that are currently registered. This is the number of models being managed.
The number of models that are currently deployed in an MLC Engine
The number of model tests that have failed
The number of those failures that are errors in the model as opposed to system or MLC errors
You can click on a category that is populated to see details. For instance, if Test Failures shows the number 2, you can click on the number to see details about the failures.
Processes Pane
The Processes pane displays how many MLC processes are currently deployed.
The MLC Processes
Each MLC Process has built in monitoring tasks that report events and errors to the Command Center. This pane displays the following:
The number of defined MLC Processes
The number of reported incidents
The number of active MLC Processes
The number of MLC Process errors
Each model can have only one MLC Process deployed with it.
Engines Pane
The Engines pane displays information about the runtime engines in the system. These are the environments where models are deployed.
This pane displays how many engines are available, active, idle, and if there are any engine errors.
Tasks and Alerts Icon
The Tasks and Alerts screen has two tabs, My Tasks and Approvals.
My Tasks
Tasks are defined as User Tasks in the MLC Process. They can be configured to assign tasks to a specific person, and to one of the categories in this section of the ModelOp Command Center.
Tasks are things a user has to do - such as approve a model or acknowledge a failed test - so that the MLC Process can move forward.
The My Tasks page filters tasks in two categories:
All Open Tasks
Tasks in Progress
Approvals
My active Tasks - # outstanding
ds_team - awaiting assignment - # outstanding
python_approvers - awaiting assignment - # outstanding
r_approvers - awaiting assignment - # outstanding
other_approvers - awaiting assignment - 0 outstanding
Runtimes Icon
The Runtimes screen has the following tabs:
Jobs | Displays how many jobs are running, how many have failed, how many were successful and the total. |
Runtime Dashboard | Displays high level status for all currently deployed runtime engines, each in it’s own pane. Click on the pane for access to details about that Runtime engine. Tabs under the Runtime Dashboard pane include:
|
Engine Stats | Lists all available engines. Click through an engine for details about that engine. |
Models Icon
Tabs under the Models icon are Model Details, Model Tests and Champion/Challenger tabs.
Model Details
The following table describes the details available under the Model Details tab. These fields are available only after you select a model from the list.
Model Info | Displays the name of the model, the description, and any tags applied to the model. |
Model Source | Source code that defines the model. Beginning statement initializes the model, loads any attachments into the engine with the model. If you retrain the model and update the attachment, the model is automatically updated. |
Attachments | Attachments are training artifacts that get loaded into the model |
Input Schemas | Defines the parameters of what is passed to the model. |
Output Schemas | Defines the parameters and format of what is passed from the model. |
Model Functions | Access to view the some details about the functions of a model |
Model Platform | Lists the dependencies used by the model. |
Model Tests
Lists the models in the system. Click a model to access the results of tests on that model.
Click on a test to see visualizations of the tests. The visualizations available depend on the tests built into a MLC Process.
Champion/Challenger
Champion/Challenger is an industry standard technique to compare the performance of competing model strategies, or the performance of a recently updated model against a previous version of the same model.
Lists the models in the system. Click a model to access the results of tests on that model and choose two tests two compare them against each other.
Model Life Cycle Icon
The Model Life Cycle screen has two tabs, MLC Overview and MLC Processes.
The MLC Overview tab displays information about all the activities being handled by the MLC Engine.
Active MLC Processes
Total Incidents
Total Tasks
Runtime information
Oldest Tasks information
The MLC Processes tab displays the diagrams of the MLC Processes that are currently running.