AuraOne

AuraOne is a human data company for AI teams and a workflow service for enterprises. It supplies expert judgment, speech, physical-world data and checked workflows.

Website | Company facts | Open tools | GitHub | LinkedIn | X

Open tools

All MIT licensed.

ToolWhat it doesSource
EvalKit Python CLI for rubric validation and linting, deterministic scoring, reviewer agreement, judge calibration, drift and leakage checks, and evidence reports. Runs on files you own. auraoneai/open
rubric-spec Validate, lint, diff, and convert portable AuraOne Rubric Schema v1 files. auraoneai/rubric-spec
iaa-kit Measure inter-annotator agreement with modern metrics, uncertainty, ordinal support, and missing-data handling. auraoneai/iaa-kit
judge-bench Probe judge behavior for position, verbosity, self-preference, paraphrase, anchoring, and calibration failures. auraoneai/judge-bench
lerobot-quality-gates Check a LeRobot-style dataset's metadata, episodes, timestamps and video references before training or publication. auraoneai/lerobot-quality-gates
Rubric Studio Open Author, validate, preview, calibrate, diff, and export criterion-level AI evaluation rubrics. auraoneai/rubric-studio-open
Agent Studio Open Connect agent systems, inspect tool traces, replay failures, compare candidates, and export regression evidence. auraoneai/agent-studio-open

Packages

Python, on PyPI: auraone-evalkit, rubric-spec, iaa-kit, judge-bench, lerobot-quality-gates.

JavaScript, on npm under the @auraone scope: @auraone/sdk, @auraone/agent-studio, @auraone/github-app, @auraone/aura-ide-kit, @auraone/platform-contracts, @auraone/proofline-oss.

Datasets

Small synthetic tutorial datasets for the tools above. The rows are hand-written. They are not expert-authored, not human-validated, and not for training or benchmarking.

AuraOne (auraone.ai) is a different company from Aura, the identity-protection service at aura.com.