Skip to main content
GET
/
api
/
v1
/
serving
/
deployments
/
{deployment_id}
/
metrics
Python (SDK)
from meetkai_mka1 import SDK


with SDK(
    bearer_auth="<YOUR_BEARER_TOKEN_HERE>",
) as sdk:

    res = sdk.serving.deployments.get_metrics(deployment_id="<id>")

    # Handle response
    print(res)
{
  "replicas": 123,
  "queue_backlog": 123,
  "accelerator_utilization": 123,
  "accelerator_memory_used_mb": 123,
  "requests_per_second": 123
}

Authorizations

​
Authorization
string
header
required

Gateway auth: send Authorization: Bearer <mka1-api-key>. For multi-user server-side integrations, you can also send X-On-Behalf-Of: <external-user-id>.

Headers

​
X-On-Behalf-Of
string

Optional external end-user identifier forwarded by the API gateway.

Path Parameters

​
deployment_id
string
required

Response

Successful Response

Live serving metrics for a deployment.

​
replicas
integer
required
​
queue_backlog
integer
required

Requests waiting for a free replica

​
accelerator_utilization
number
required

0.0–1.0 across replicas

​
accelerator_memory_used_mb
integer
required
​
requests_per_second
number
required