Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  1. Define KPIs and thresholds for model 

    1. Edit the provided Data-drift.dmn file to reflect your desired tolerance for data drift

    2. Repeat for the provided Concept-drift.dmn file Performance-test.dmn

    3. Save the files locally to your machine.

  2. Associate Monitor models to snapshot

    1. Navigate to the specific model snapshot

  3. Using the Associated Models widget, create a data drift association

    1. Image RemovedImage Added
    2. Use the provided data and the DMN you made in step 2.

      1. Use the provided data and the DMN you made in step 2.

  4. Before leaving the Model snapshot screen, copy the ID from the URL bar, you’ll need this for later

  5. To test, run a monitoring job manually

    1. Make a REST call to MOC’s automation engine to trigger a data drift detection job on your model

      1. Obtain a valid auth token

      2. Make a call to the MLC API to initiate the monitor:

...

This model uses a Spark MulticlassClassificationEvaluator to determine the accuracy of the predictions generated by the titanic model.

Next Article: Model Governance: Standard Model Definition Statistical Monitoring >