Page Comparison

Full List of Enhancements:

• Java 21: upgraded core ModelOp Services to Java 21

  • Upgraded Spring Boot to v3.3.2

  • Upgraded Camunda to v7.21.0

• Jira SDK: replaced the Atlassian Jira SDK with an upgraded Feign-based client

  • Overcomes the issue where Customers had more than 500 custom fields within their Jira projects.

• Inventory & Reporting:

• Risk Management:

• Model Use Case Page:

  • Added a list of Running Model Lifecycles to the Use Case page. Note that this will show ALL related running model lifecycles, across Use Cases, Model Implementations, or Snapshots of a Model Implementation

  • Updated the Governance Score to refresh automatically upon saving of Custom Form Data

• Governance Score:

  • Updated the default Governance Score rules to look for Model Cards for a specific snapshot, instead of at the use case level

  • Updated the default Governance Score rules to check that there are no high and open Notifications

• Model Card Generation:

• Custom Forms: Git:

  • Added support to allow multiple models to exist within a given git repository. Note that the models must exist under different folders within the Git repository.

• My Work:

• MLC:

  • REST Delegate: Added ability to post to a REST endpoint and wait for a response. The wait can used REGEX to filter the response for a specific value

• Dashboard & Tests/Monitors:

  • Privacy (PII Detection): added the PII detection monitor to the OOTB standard risk tests, allowing users to detect any potential PII leakage in a model output

  • Dashboard:

    • Updated the Default Dashboard Monitor to support LLM-based metrics, including PII detection and SBert Similarity analysis.

    • Also updated the Default Dashboard Monitor to include Risk Tier and Governance Score, by default

    • Added support to filter the Models by the available columns (e.g. Business Unit). This includes support for any custom columns defined by the Customer.

    • Added a “summary section” to a Model Test Result page that allows the Model Test Result to display a configurable heatmap to summarize the contents of the test result. This is useful for situations where the user may want to analyze different segments of a model in a detail, but still have a rollup across all segments.

    • Updated the Home Dashboard to allow an individual Red / Green / Yellow item in the heatmap to be clickable, thus directing the user to the specific metrics that generated the heatmap item

  • OOTB Monitors:

    • Updated the default behavior of the OOTB monitors to WARN instead of ERROR out a job, should there be a python-based warning in the monitor execution

• Documentation Generation:

• AWS SageMaker:

• Spark Runtime:PowerBI:

  • Updated connector to include new core metadata fields (e.g. modelStage) that were introduced in v3.3.x

• ModelOp Runtime:

• Jira/ServiceNOW:

• Jupyter:

  • Upgraded the Jupyter plugin to disable/Hide buttons if user does NOT have required permissions

• Security:

• Installation / Configuration

• Other

Bug Fixes:

• Git:

• Dashboard & Tests/Monitors

• CLI:

• UI::

  • Addressed sporadic issue where the git sync would fail with a 504 error

• Tableau:

  • Addressed an issue where the Tableau connector was failing to import data when the custom metadata contained special characters

• Scheduler:

  • Addressed an issue with the advanced scheduler (cron) option, where if the users saves a Schedule with a invalid cron expression, other newer expressions are not saved either.

  • Additionally provided UI-based warnings if a user attempts to save an invalid cron expression

• Champion/Challenger:

  • Addressed a UI routing issue when attempting to open the Champion/Challenger view from the Inventory and Model Details page

• AWS SageMaker:

  • Addressed an issue in the UI where AWS SageMaker jobs could not be re-run

• Custom Form Configuration - Custom Field Types:

  • Addressed an issue with the Custom Field Types (in the Forms Configuration admin page) where the user could not change the name of the field when a custom field type was added to a form.

• Model Implementations:

  • Addressed an issue in the Model Implementation Details page where all notifications were being shown, instead of notifications specific to that Model Implementation

• ModelOp Python SDK:

Security Fixes/Patches:

NOTE: many of the below are NOT related to ModelOp software, but rather related to dependencies

• Addressed CVE-2024-22243 & CVE-2024-22259 - Spring framework: URL Parsing with Host validation.

  • Issue Link: https://avd.aquasec.com/nvd/cve-2024-22243|https://avd.aquasec.com/nvd/cve-2024-22243