Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 2 Current »

This article lists the out-of-the-box tests and monitors that can be run against a variety of model implementation types: LLM, NLP, regressions, classifiers, etc.

Table of Contents

Out of the Box Metrics

ModelOp Center ships with multiple out-of-the-box monitors, which are registered as associated models. The user may add one of these associated monitors to his/her model or decide to write a custom metric function (see next section). These monitors can also be customized via the ModelOp monitoring Python package. See here for documentation on the monitoring package. Here is a sampling of out of the box tests and monitors:

image-20240716-212408.png

For more details, please visit the /wiki/spaces/dv33/pages/1978445995 section (subscribed Customers only).

Next Article: Operational Monitoring >

  • No labels