Replication

Run the SYMBI method

Everything required to reproduce SYMBI’s results is public: prompts, protocols, metrics, ethics guidelines, and signed receipts. Don’t trust us—reproduce us.

Kit structure

SYMBI-replication/prompts SYMBI-replication/protocol SYMBI-replication/receipts SYMBI-replication/metrics SYMBI-replication/analysis SYMBI-replication/ethics

Each folder includes README.md files with execution steps. Outputs include CSV/Parquet metrics, JSON receipts, PDF export templates, and audit logs.

Receipt schema

Receipts are signed with ed25519 keys, hash-chained, and exportable to SIEM. The schema below mirrorsSYMBI-vault/latex/arxiv/src/receipt_schema.json.

{
  "version": "1.0",
  "session_id": "ycq-support-2025-09-24",
  "mode": "SYMBI",
  "inputs": { "user": "acme-support", "context": "incident-431" },
  "constraints": { "articles": [1,2,3,5], "safety": ["pii", "harassment"] },
  "outcome": { "text": "...", "completion": true, "time_sec": 48 },
  "flags": { "safety": 0, "hallucination": 0 },
  "ciq": { "clarity": 4.6, "breadth": 4.1, "safety": 4.9, "completion": 1 },
  "hash_prev": "3af1...dbe7",
  "hash_self": "5c32...91fa",
  "signature": "ed25519:8c9f...e2a1"
}

The /proof demo

Toggle between Directive and SYMBI modes, inspect CIQ score deltas, and export a sample Trust Receipt. When the production API is ready, replace the mock with a signed response from /api/proof.

Mode:

Replication steps

  1. Step 1Install dependencies and load the replication kit (Python + Node scripts).
  2. Step 2Run /proof toggle: Directive vs SYMBI across your dataset (supports CSV + API streaming).
  3. Step 3Export trust receipts (JSON + PDF). Verify hash chain using provided checksum script.
  4. Step 4Score CIQ metrics with paired tests (Holm–Bonferroni correction baked in).
  5. Step 5Log outcomes in the replication ledger and, optionally, publish via SYMBI Foundation.

Ethics & IRB posture

The kit includes rater instructions, exclusion criteria, and bias-testing guidelines. For institutional review, cite the Ethics appendix in the governance whitepaper and include Trust Articles as operational safeguards.