...
Define KPIs and thresholds for model
Edit the provided
Data-drift.dmn
file to reflect your desired tolerance for data driftRepeat for the provided
Concept-drift.dmn
filePerformance-test.dmn
Save the files locally to your machine.
Associate Monitor models to snapshot
Navigate to the specific model snapshot
Using the Associated Models widget, create a data drift association
Use the provided data and the DMN you made in step 2.
Use the provided data and the DMN you made in step 2.
Before leaving the Model snapshot screen, copy the ID from the URL bar, you’ll need this for later
To test, run a monitoring job manually
Make a REST call to MOC’s automation engine to trigger a data drift detection job on your model
Obtain a valid auth token
Make a call to the MLC API to initiate the monitor:
...
This model uses a Spark MulticlassClassificationEvaluator
to determine the accuracy of the predictions generated by the titanic model.
Next Article: Model Governance: Standard Model Definition Statistical Monitoring >