Versions Compared

Old Version 2

changes.mady.by.user Dave Trier

Saved on

compared with

New Version Current

changes.mady.by.user Dave Trier

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

This article lists the out-of-the-box tests and monitors that can be run against a variety of model implementation types: LLM, NLP, regressions, classifiers, etc.

Table of Contents

Table of Contents

Out of the Box Metrics

ModelOp Center ships with multiple out-of-the-box monitors, which are registered as associated models. The user may add one of these associated monitors to his/her model or decide to write a custom metric function (see next section). These monitors can also be customized via the ModelOp monitoring Python package. See here for documentation on the monitoring package. Here is a sampling of out of the box tests and monitors:

image-20240716-212408.png

For more details, please visit the /wiki/spaces/dv33/pages/1978445995 ModelOp Center Monitoring Package section (subscribed Customers only).

Next Article: Operational Monitoring & Reporting - How To's >