Pricing
Changelog

What is new in Rubrkit.

Every release that shaped the grading instrument, newest first. Dates and versions are exact.

Jul 19, 2026
v0.12.0

Drift watch and production outcomes

Added

Drift watch re-audits one pinned version on a schedule (daily, weekly, or monthly) and reports when its score leaves the range measured at calibration. The artifact never changes, so a move outside that range means the model or the rubric shifted, not your prompt. Create one from the Drift panel or POST /artifact-bundles/{id}/drift-monitors.

Added

A Check now control and POST /drift-monitors/{id}/check to run a check immediately instead of waiting for the schedule. The first check on a new monitor measures the version's own noise band before it can report anything as drift.

Added

Send real production results back with POST /artifact-bundles/{id}/outcomes (or the rubrkit_record_outcome MCP tool) to unlock two signals the offline rubric cannot give: input drift, which compares recent traffic against your reference window, and validity drift, which measures whether the rubric score still tracks the real outcome. Both stay blank until there is enough data to answer them honestly.

Changed

The background job drainer now runs every ten minutes instead of every minute, so a queued job may take a few minutes longer to start but the database is no longer held awake around the clock.

Jul 18, 2026
v0.11.0

Statistical comparison and golden sets

Added

An advanced comparison mode that audits two versions of a file several times each and reports whether the difference is larger than the evaluator's own run-to-run noise — better, not just different. Every rubric dimension gets a 95% confidence interval, corrected across dimensions, so a bar that crosses zero is not a real change. Available in the Compare panel or by POSTing an eval run with mode advanced, repeats, baselineVersionId, and candidateVersionId.

Added

Golden sets: pin the real inputs a bundle must keep handling correctly, so the last thing that broke can never break silently again. Manage them from the Golden set panel, over REST at /artifact-bundles/{id}/golden-cases, or with the MCP tools rubrkit_add_golden_case, rubrkit_list_golden_cases, and rubrkit_retire_golden_case.

Added

Proof reports exported from an advanced comparison now carry the statistical verdict — the effect size, confidence interval, and which dimensions moved — instead of a bare pair of scores.

Changed

Advanced comparisons measure rubric-judged quality across repeated audits, not real-user outcomes, and the interface says so wherever a verdict appears. A single offline run is still a first gate, never a claim of statistical significance about your users.

Jun 29, 2026
v0.10.0

Bundle management: pagination, permanent delete, and MCP parity

Added

Permanently delete an archived artifact bundle from the dashboard or the API (DELETE /artifact-bundles/{id}/permanent). A permanent delete removes the bundle and all of its files, version history, and run history, and only works once a bundle has been archived.

Added

A Load more control on the Artifact Bundles dashboard, backed by a new offset parameter and nextOffset response field on the list API, so long bundle lists page in instead of silently capping.

Added

New MCP tools rubrkit_delete_artifact_bundle (archive) and rubrkit_hard_delete_artifact_bundle (permanent), plus a force option on rubrkit_start_audit that bypasses the audit cache — the same as the CLI's --no-cache flag.

Fixed

Artifact type auto-detection now takes precedence over a format-level type sent by a client, so a SKILL.md uploaded by the CLI is detected as a skill instead of plain markdown. Re-upload an existing bundle to pick up the corrected type.

Jun 28, 2026
v0.9.0

Open skill library

Added

A curated Skill Library at /skills — open, install-ready skills for frontend and backend development that you can browse, copy, or pull from GitHub at github.com/Rubrkit/development-skills with npx skills add.

Added

The published skills are graded by Rubrkit in CI on every push: a skill that scores below 75 fails the build, so the open collection is held to the same bar as everything else.

Added

The CLI test --remote now syncs into an existing artifact bundle — updating changed files, adding new ones, and removing stale ones — so a pinned CI bundle no longer conflicts on repeat runs (rubrkit 0.4.0).

Jun 26, 2026
v0.8.0

Account data export and deletion

Added

A new Account section in the dashboard where you can export all of your data as a single JSON file — profile, bundles and file metadata, audit/eval/proof history, usage, credits, and billing identifiers.

Added

Permanent account deletion from the Account page: a type-to-confirm step removes your profile, bundles, files, API keys, and run history, and cancels any active subscription. Financial records are anonymized and retained as required by law.

Security

Account export and deletion require a signed-in session (login token); API keys cannot trigger either action.

Jun 25, 2026
v0.7.0

Deterministic audit results

Added

Audit results are cached per account by a content hash of their inputs, so re-running an audit on unchanged files returns the identical result instantly and charges no credits — repeated CI runs are reproducible.

Added

A --no-cache CLI flag (and force API option) to bypass the cache and force a fresh audit run.

Changed

The audit API and CLI now report whether a result was served from cache.

Jun 20, 2026
v0.6.0

Developer surface: API, CLI, and MCP

Added

Public API reference at /docs/api, generated from the canonical OpenAPI contract so it can never drift.

Added

CLI reference at /docs/cli for the rubrkit npm package: pull, validate, test, audit, eval, and report.

Added

MCP server docs at /docs/mcp with the full tool catalog and connection config.

Changed

Collapsed the separate doc links into a single Docs menu in the header.

Jun 13, 2026
v0.5.2

Audit and proof reliability

Fixed

Audit jobs no longer stall when a rubric dimension returns zero findings.

Fixed

Proof report exports retry transient blob-storage failures instead of failing the job.

Security

Tightened API-key scope checks on file-write endpoints so a read-only key can never mutate a bundle.

Jun 5, 2026
v0.5.0

Evals and proof reports

Added

Eval runs that score rubric-backed test cases against a rewrite.

Added

Exportable proof reports that show an instruction held up to its eval.

Changed

The credits ledger now previews the cost of a run before you start it.

May 28, 2026
v0.4.1

Version-history fixes

Fixed

Restoring a file version now writes a new version instead of overwriting history.

Fixed

Corrected an off-by-one in bundle version-history pagination.

May 22, 2026
v0.4.0

Artifact-bundle versioning

Added

Full version history for artifact bundles and individual files.

Added

Restore any prior bundle or file version from the dashboard or API.

Changed

File uploads are content-addressed, so identical content no longer creates duplicate versions.

May 15, 2026
v0.3.1

rubr_flow polish

Changed

The rubr_flow validator now accepts the optional ON and STATE blocks.

Fixed

Conversion job progress events now stream in order.

May 8, 2026
v0.3.0

rubr_flow conversions

Added

Convert a loose instruction into a bounded rubr_flow procedure through the API.

Added

A dedicated rubr_flow page covering the anatomy, how to write one, and worked specimens.

May 1, 2026
v0.2.2

Examples and dashboard

Added

A before-and-after examples gallery showing weak instructions graded and rewritten.

Changed

The dashboard bundle list now shows each bundle’s last-audited score.

Fixed

Contact and newsletter forms now confirm submission with a snackbar instead of a silent reset.

Apr 29, 2026
v0.2.1

Auth hardening

Security

Login tokens are verified before an identity is mapped to a Neon-backed user.

Fixed

Expired or revoked API keys now return a clear unauthorized error instead of a generic failure.

Apr 23, 2026
v0.2.0

Public API preview

Added

Scoped API keys with explicit read and write scopes per resource.

Added

Artifact-bundle, file, and audit endpoints under /api/v1.

Added

Async job polling for long-running audits and conversions.