Back to search
100
MCP live MCP 2025-06-18 streamable-http

com.rubrkit/rubrkit

com.rubrkit/rubrkit

MCP-native AI evaluation: rubric audits, eval suites, and proof reports for AI/LLM output.

Uptime
100.0%
2 direct probes · 30d
Response
1329ms
last probe
Tools
41
callable
Resources
2
readable
Prompts
0
available
Primary URL
https://www.rubrkit.com/api/v1/mcp

Tools · 41

rubrkit_search_api_docs

Search the canonical docs/api Markdown guides and OpenAPI operation summaries.

rubrkit_read_api_doc

Read a docs/api Markdown guide or OpenAPI source by slug, file name, or docs/api path.

rubrkit_read_openapi_contract

Read the canonical docs/api/openapi.yaml contract.

rubrkit_create_artifact_bundle

Create an artifact bundle through /api/v1/artifact-bundles. Requires artifact_bundles:write for API keys.

rubrkit_list_artifact_bundles

List artifact bundles through /api/v1/artifact-bundles. Requires artifact_bundles:read for API keys.

rubrkit_read_artifact_bundle

Read artifact bundle details, files, and file tree. Requires artifact_bundles:read for API keys.

rubrkit_delete_artifact_bundle

Archive an artifact bundle (soft delete) through DELETE /api/v1/artifact-bundles/{artifactBundleId}. The bundle moves to the archived state and can be restored or permanently deleted later. Requires a…

rubrkit_hard_delete_artifact_bundle

Permanently delete an archived artifact bundle and all of its files, versions, and run history through DELETE /api/v1/artifact-bundles/{artifactBundleId}/permanent. This is irreversible and only works…

rubrkit_upload_artifact_files

Upload one or more text files into an artifact bundle. Requires files:write for API keys.

rubrkit_list_artifact_files

List files in an artifact bundle. Requires files:read for API keys.

rubrkit_read_artifact_file

Read the latest file metadata and content. Requires files:read for API keys.

rubrkit_update_artifact_file

Write a new editable version for a file. Requires files:write for API keys.

rubrkit_start_audit

Start an async audit job. Audit results are cached per account by a content hash of their inputs; pass force: true to bypass the cache and run a fresh audit (the same as the CLI's --no-cache flag). Re…

rubrkit_list_audits

List persisted audit history. Requires artifact_bundles:read for API keys.

rubrkit_read_audit

Read a single audit run. Requires artifact_bundles:read for API keys.

rubrkit_apply_audit_rewrite

Apply a completed audit's AI rewrite to the bundle files (a new version per changed file). Requires audits:run for API keys.

rubrkit_convert_to_rubr_flow

Start an async rubr_flow conversion job. Requires rubr_flow:convert for API keys.

rubrkit_list_rubr_flow_conversions

List conversion history. Requires artifact_bundles:read for API keys.

rubrkit_read_rubr_flow_conversion

Read one conversion report. Requires artifact_bundles:read for API keys.

rubrkit_poll_job

Read async job progress. Requires jobs:read for API keys.

rubrkit_list_job_events

Read append-only job progress events. Requires jobs:read for API keys.

rubrkit_list_artifact_bundle_versions

List bundle-level version events. Requires artifact_bundles:read for API keys.

rubrkit_restore_artifact_bundle_version

Restore files from a prior artifact-bundle version by creating new file versions. Requires artifact_bundles:write and files:write for API keys.

rubrkit_list_file_versions

List immutable versions for a file. Requires files:read for API keys.

rubrkit_restore_file_version

Restore a prior file version by creating a new version. Requires files:write for API keys.

rubrkit_run_evals

Start an async eval run. Requires evals:run for API keys. Set mode: "advanced" with baselineVersionId and candidateVersionId to run a statistically-backed A/B (repeats defaults to 3, max 5).

rubrkit_list_evals

List eval history. Requires artifact_bundles:read for API keys.

rubrkit_read_eval

Read one eval run, including the `stats` statistical verdict on advanced-mode runs (empty for standard runs). Requires artifact_bundles:read for API keys.

rubrkit_export_proof_report

Start an async proof report job with export storage enabled by default. Requires evals:run for API keys.

rubrkit_read_proof_report

Read one proof report. Requires artifact_bundles:read for API keys.

rubrkit_list_golden_cases

List the golden cases for an artifact bundle via /api/v1/artifact-bundles/{artifactBundleId}/golden-cases. Requires artifact_bundles:read (or artifacts:pull) for API keys.

rubrkit_add_golden_case

Add a golden case (a real edge-case input with a confirmed-correct output) to an artifact bundle via POST /api/v1/artifact-bundles/{artifactBundleId}/golden-cases. Requires artifact_bundles:write for …

rubrkit_retire_golden_case

Retire a golden case via DELETE /api/v1/golden-cases/{goldenCaseId}. Requires artifact_bundles:write for API keys.

rubrkit_create_drift_monitor

Create a drift monitor pinned to a file version via POST /api/v1/artifact-bundles/{artifactBundleId}/drift-monitors. Requires artifact_bundles:write for API keys.

rubrkit_list_drift_monitors

List the drift monitors for an artifact bundle via /api/v1/artifact-bundles/{artifactBundleId}/drift-monitors. Requires artifact_bundles:read (or artifacts:pull) for API keys.

rubrkit_read_drift_observations

List the recorded observations for a drift monitor via /api/v1/drift-monitors/{driftMonitorId}/observations. Requires artifact_bundles:read (or artifacts:pull) for API keys.

rubrkit_run_drift_check

Queue a drift check immediately instead of waiting for the monitor's schedule, via POST /api/v1/drift-monitors/{driftMonitorId}/check. The first check on a new monitor calibrates its baseline. Costs o…

rubrkit_set_drift_monitor_status

Pause or resume a drift monitor via PATCH /api/v1/drift-monitors/{driftMonitorId}. Requires artifact_bundles:write for API keys.

rubrkit_record_outcome

Record a production outcome event (input feature, metric, and/or label) for an artifact bundle via POST /api/v1/artifact-bundles/{artifactBundleId}/outcomes. Requires artifact_bundles:write for API ke…

rubrkit_read_input_drift

Compare recent production inputs against a prior reference window (population stability index) for an artifact bundle via GET /api/v1/artifact-bundles/{artifactBundleId}/drift/input. Requires artifact…

rubrkit_read_validity_drift

Correlate rubric scores against recorded outcome metrics for an artifact bundle to check whether the rubric is still predictive via GET /api/v1/artifact-bundles/{artifactBundleId}/drift/validity. Requ…

Resources · 2

openapi.yaml

Canonical OpenAPI YAML contract for /api/v1.

rubrkit://api-docs/openapi.yaml
README.md

Canonical docs/api Markdown guide: Rubrkit API Docs.

rubrkit://api-docs/README.md

How to use

Add to your Claude Desktop / Cursor / Cline MCP config:

{
  "mcpServers": {
    "com.rubrkit/rubrkit": {
      "url": "https://www.rubrkit.com/api/v1/mcp",
      "transport": "streamable-http"
    }
  }
}