Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

ModelOp Center “Assets” support various data technologies, including:

  • S3 Files

  • Azure Blob Storage Files

  • HDFS Files

  • SQL data sources

...

Action

Data Required

Available via:

MOC Asset Examples [ASSET_ROLE : EXAMPLE}

Add an AttachmentAsset (to a StoredModel)

All types

CLI: s3 & embedded assets only

UI: all

API: all

Applicable to S3, HDFS, and SQL Asset

Run a Metrics Job

(e.g. “Back Test” using labeled data)

Evaluation Data

CLI, UI, API, MLC

S3:

Test_Data: s3://<model_base>/EvaluationData.csv

HDFS:

Test_Data: hdfs://<model_base>/EvaluationData.csv

SQL Asset:

Test_Data: SELECT * FROM <read_only_Eval_table> WHERE <conditions>

Run a Data Drift Job

•Training/Baseline Data

•Comparator Data

CLI: would trigger the API

API, MLC

S3:

Training_Data: s3://<model_base>/TrainingData.csv

Compare_Data: s3://<model_base>/ComparatorData.csv

HDFS:

Training_Data: hdfs://<model_base>/TrainingData.csv

Compare_Data: hdfs://<model_base>/ComparatorData.csv

SQL:

Training_Data: SELECT * FROM <read_only_Training_table> WHERE <conditions>

Compare_Data: Training: SELECT * FROM <read_only_Comparator_table> WHERE <conditions> … may need to have tag to specify input vs. output comparator data

Run a Model Concept Drift Job

•Training/Baseline Data

•Comparator Data

CLI: would trigger the API

API, MLC

S3:

Training_Data: s3://<model_base>/TrainingData.csv

Compare_Data: s3://<model_base>/ComparatorData.csv

HDFS:

Training_Data: hdfs://<model_base>/TrainingData.csv

Compare_Data: hdfs://<model_base>/ComparatorData.csv

SQL:

Training_Data: SELECT * FROM <read_only_Training_table> WHERE <conditions>

Compare_Data: Training: SELECT * FROM <read_only_Comparator_table> WHERE <conditions> … may need to have tag to specify input vs. output comparator data

Run a Bias Detection Job

Evaluation Data

CLI, UI, API, MLC

S3:

Test_Data: s3://<model_base>/EvaluationData.csv

HDFS:

Test_Data: hdfs://<model_base>/EvaluationData.csv

SQL Asset:

Test_Data: SELECT * FROM <read_only_Eval_table> WHERE <conditions>

Run a Training Job

•Training Data

MLC, UI, API

S3:

Training_Data: s3://<model_base>/TrainingData.csv

HDFS:

Training_Data: hdfs://<model_base>/TrainingData.csv

SQL Asset:

Training_Data: SELECT * FROM <read_only_Training_table> WHERE <conditions>

...

  1. Go to the Model Details page by clicking on the model from the Models page

    Image RemovedImage Added

  2. View the existing Assets by clicking on Assets tab:

    Image RemovedImage Added

  3. Click on “Add Assets” , which opens a dialog box to select a local file.

    Image RemovedImage Added

  4. The user is presented with multiple options for adding assets: as a local file upload, by providing a reference to an existing location, or by providing as SQL query:

    1. Image RemovedImage Added

For Local File Upload:

  1. Click on the “Add File Upload”.

  2. Click on “Upload file”:

    1. Image RemovedImage Added

  3. Select the file from your local computer

  4. Select to Upload the file:

    1. Image RemovedImage Added

  5. The file will be uploaded as a new asset on the model

...

  1. Provide the URL to the file.

  2. Select the type of asset: S3, HDFS, Azure Blob Store

    Image RemovedImage Added

  3. Click Add Asset

  4. The file will be uploaded as a new asset on the model

...