Out-of-the-Box Tests & Monitors

Owned by Dave Trier
Last updated: Jul 16, 2024
1 min read

This article lists the out-of-the-box tests and monitors that can be run against a variety of model implementation types: LLM, NLP, regressions, classifiers, etc.

Table of Contents

Out of the Box Metrics

ModelOp Center ships with multiple out-of-the-box monitors, which are registered as associated models. The user may add one of these associated monitors to his/her model or decide to write a custom metric function (see next section). These monitors can also be customized via the ModelOp monitoring Python package. See here for documentation on the monitoring package. Here is a sampling of out of the box tests and monitors:

image-20240716-212408.png

For more details, please visit the ModelOp Center Monitoring Package section (subscribed Customers only).

 

Next Article: Monitoring & Reporting - How To's >