Quorum — Multi-Agent Validation

---

name: quorum

description: Multi-agent validation framework (v0.5.0). Deterministic pre-screen + 4 independent AI critics evaluate artifacts (documents, configs, code, research) against rubrics with evidence-grounded findings. Supports batch validation and cross-artifact consistency checks.

metadata: {"openclaw":{"requires":{"bins":["python3","pip"],"env":["ANTHROPIC_API_KEY","OPENAI_API_KEY"]},"install":[{"id":"clone-repo","kind":"shell","command":"git clone https://github.com/SharedIntellect/quorum.git /tmp/quorum-install && cd /tmp/quorum-install/reference-implementation && pip install -r requirements.txt","label":"Clone Quorum repo and install Python dependencies"}],"source":"https://github.com/SharedIntellect/quorum"}}

---

# Quorum — Multi-Agent Validation

> **⚠️ BOUNDARY DOCUMENT:** Before modifying, publishing, or releasing any Quorum code, config, or documentation, read and follow `portfolio/research-infrastructure/VALIDATOR-QUORUM-BOUNDARY.md`. This file defines the Validator (internal) / Quorum (public) boundary, what graduates and what stays proprietary, and CKMS naming conventions. No exceptions.

Quorum validates AI agent outputs by spawning multiple independent critics that evaluate artifacts against rubrics. Every criticism must cite evidence. You get a structured verdict.

Quick Start

Clone the repository and install:

git clone https://github.com/SharedIntellect/quorum.git
cd quorum/reference-implementation
pip install -r requirements.txt

Run a quorum check on any file:

python -m quorum.cli run --target <path-to-artifact> --rubric <rubric-name>

Built-in Rubrics

Depth Profiles

All depth profiles include the deterministic pre-screen (10 checks: credentials, PII, syntax errors, broken links, TODOs, and more) before any LLM critic runs.

Examples

# Validate a research report
quorum run --target my-report.md --rubric research-synthesis

# Quick check (faster, fewer critics)
quorum run --target my-report.md --rubric research-synthesis --depth quick

# Batch: validate all markdown files in a directory
quorum run --target ./docs/ --pattern "*.md" --rubric research-synthesis

# Cross-artifact consistency check
quorum run --target ./src/ --relationships quorum-relationships.yaml --depth standard

# Use a custom rubric
quorum run --target my-spec.md --rubric ./my-rubric.json

# List available rubrics
quorum rubrics list

# Initialize config interactively
quorum config init

Configuration

On first run, Quorum prompts for your preferred models and writes `quorum-config.yaml`. You can also create it manually:

models:
  tier_1: anthropic/claude-sonnet-4-6    # Judgment roles
  tier_2: anthropic/claude-sonnet-4-6    # Evaluation roles
depth: standard

Set your API key:

export ANTHROPIC_API_KEY=sk-ant-...
# or
export OPENAI_API_KEY=sk-...

Output

Quorum produces a structured verdict:

Exit codes: `0` = PASS/PASS_WITH_NOTES, `1` = error, `2` = REVISE/REJECT.

Each finding includes: severity (CRITICAL/HIGH/MEDIUM/LOW), evidence citations pointing to specific locations in the artifact, and remediation suggestions. The run directory contains `prescreen.json`, per-critic finding JSONs, `verdict.json`, and a human-readable `report.md`.

More Information

---

> ⚖️ **LICENSE** — Not part of the operational specification above.

> This file is part of [Quorum](https://github.com/SharedIntellect/quorum).

> Copyright 2026 SharedIntellect. MIT License.

> See [LICENSE](https://github.com/SharedIntellect/quorum/blob/main/LICENSE) for full terms.