API Endpoints¶
The API Endpoints screen lists all endpoints that Unified Monitoring can detect.
Unified Monitoring can monitor:
Endpoints of API Services: API Services deployed to an infrastructure defined in the Deployer, including third-party infrastructures (Amazon SageMaker, Google Vertex AI, Microsoft Azure Machine Learning, Databricks or Snowflake Snowpark Container Services). Also see First API (with API Deployer).
External Endpoints: Endpoints deployed to third-party infrastructures, not managed by Dataiku. To see these endpoints, you need to declare additional “Monitoring Scopes” (only available to administrators) as detailed in Unified Monitoring Settings.
Every API Endpoint has a “Global Status” and a “Deployment Status”. It may also have a “Model Status” and a “Governance Status” if Unified Monitoring was able to link the endpoint to a DSS Saved Model.
Unified Monitoring also displays endpoint activity metrics for the last 24 hours, such as “Response time” (P95 response latency), “Volume” (number of calls to the endpoint), and an “Activity” graph of calls. These statistics require the Activity server to be correctly configured in the API infrastructure.
Deployment Status¶
The Deployment Status of an API Endpoint is the health status of the endpoint, as reported by the underlying infrastructure.
Model Status¶
The Model Status of an API Endpoint is the worst model status of all models matched to this API Endpoint.
Please see Understanding Model Status for more details.
Note
For External Endpoints, the Model Status can be computed only if this endpoint has a corresponding External Model
Governance Status¶
Note
Governance Status is only available if Dataiku Govern is enabled and available in your license.
The Governance Status of an endpoint is computed based on the validation status of the deployed Saved Model Version in Dataiku Govern and the “Govern check policy” configured for the infrastructure.
If the model version is Approved in Govern, the status is Healthy.
If the model version is in any other state (e.g., In validation, Rejected), the status depends on the “Govern check policy” of the underlying infrastructure:
Warn: The status is Warning.
Prevent: The status is Error.
No check: The status is No Status.
Global Status¶
In addition to the three statuses detailed in the previous sections, every API Endpoint has a “Global status”, which is computed by taking the worst of “Deployment Status”, “Model Status”, and “Governance Status”.
Activity Metrics¶
For every API Endpoint, Unified Monitoring will display activity metrics, if available.
Note
Activity metrics are retrieved on a best-effort basis, as there are a number of scenarios where DSS might not be able to retrieve anything, including (but not limited to):
Permission issues with the monitoring solution of the third-party cloud provider.
For Dataiku endpoints, disabling or not correctly configuring the “Monitoring” section of the infrastructure.
For External endpoints, disabling or not correctly configuring the monitoring solution of the third-party cloud provider.
No longer available External Endpoints¶
If an External Endpoint, once monitored, is no longer detectable by Unified Monitoring (possibly due to its deletion from the cloud provider), it will be displayed in an error state.
To remove such API Endpoints from Unified Monitoring, click on the relevant row and click on the “Remove” button in the modal window that appears (only available to administrators).