Saltar al contenido principal
POST
/
api
/
v1
/
llm
/
evals
/
imports
/
huggingface-results
Python (SDK)
from meetkai_mka1 import SDK


with SDK(
    bearer_auth="<YOUR_BEARER_TOKEN_HERE>",
) as sdk:

    res = sdk.llm.evals.import_historical_results(x_hugging_face_token="hf_your_read_token", source={
        "path_prefix": "qwen/ur/",
    }, suite_name="MKA1 historical eval results", create_missing_tasks=True, dry_run=False, metadata={
        "owner": "eval-team",
    })

    # Handle response
    print(res)
{
  "object": "eval.import",
  "source": {
    "type": "huggingface",
    "repo": "meetkai/lm-eval-harness-result",
    "revision": "main"
  },
  "suite_id": "eval_suite_aa87e2b1112a455b8deabed784372198",
  "suite_version": 1,
  "created_suite": true,
  "created_suite_version": true,
  "dry_run": false,
  "discovered_files": 30,
  "imported_runs": 30,
  "skipped_runs": 0,
  "imported_samples": 8870
}

Autorizaciones

Authorization
string
header
requerido

Gateway auth: send Authorization: Bearer <mka1-api-key>. For multi-user server-side integrations, you can also send X-On-Behalf-Of: <external-user-id>.

Encabezados

X-HuggingFace-Token
string
requerido

Caller-owned Hugging Face token with read access to the source dataset repository. Gateway does not use its server-side Hugging Face token for historical imports.

X-On-Behalf-Of
string

Optional external end-user identifier forwarded by the API gateway.

Cuerpo

application/json
source
object
suite_id
string

Conjunto existente para importar. Las tareas faltantes se añaden como una nueva versión por defecto.

suite_name
string
predeterminado:Historical lm-eval harness results
Required string length: 1 - 255
suite_description
string
Maximum string length: 10000
create_missing_tasks
boolean
predeterminado:true
dry_run
boolean
predeterminado:false
limit_files
integer

Número máximo de archivos de resultados a importar desde Hugging Face, limitado a 100. Las importaciones de la lista de repositorios son, por defecto, 50; las importaciones de source.files explícitas no tienen límite a menos que esto esté configurado.

Rango requerido: 1 <= x <= 100
metadata
object

Respuesta

200 - application/json

Está bien

object
any
requerido
source
object
requerido
suite_id
string
requerido
suite_version
integer
requerido
Rango requerido: -9007199254740991 <= x <= 9007199254740991
created_suite
boolean
requerido
created_suite_version
boolean
requerido
dry_run
boolean
requerido
discovered_files
integer
requerido
Rango requerido: 0 <= x <= 9007199254740991
imported_runs
integer
requerido
Rango requerido: 0 <= x <= 9007199254740991
skipped_runs
integer
requerido
Rango requerido: 0 <= x <= 9007199254740991
imported_samples
integer
requerido
Rango requerido: 0 <= x <= 9007199254740991