AI Character Index · Use the tool

Use the tool

A tool for researchers working in the model-spec space. Point a panel of LLM judges at a spec and give the panel a behaviour you care about. You get back a passage-level coverage map: every place the spec addresses that behaviour, scored by each judge and quoted verbatim.

Get it on GitHub ↗

What people use it for

Assess coverage. How well does a spec address a behaviour you are interested in? Is it a defining commitment, a passing mention, or a gap?
Locate the exact text. Every verdict anchors to a specific passage, so you see precisely where in the spec a behaviour is addressed.
Select passages for downstream work. Every citation is a stable, re-resolvable locator plus a verbatim quote, in plain JSON -- ready to feed automated adherence evals testing whether models actually follow the passages you selected.
Experiment with spec edits. Register your own spec versions locally, run the panel against each, and compare how coverage shifts as you rewrite.

Two repositories, and which one you want

The original is AndresCotton/ai-character-index, and it is the one to clone. It stands alone: Python, a browser, and no other machinery. That is what the commands below assume, nothing in it depends on us, and it is the version to take if you want to run the tool yourself. It is published at ai-character-index.pages.dev.

This site is the fork, polariscollective/ai-character-index, run by Polaris Collective. It is going somewhere different: a signed-in surface with the judging panel running on our own infrastructure, so that a new behaviour, a new judge or a new specification can be added from the browser instead of a terminal. That direction will in time cost this copy the ability to run from a bare clone. The original keeps it, which is why it stays the one we point you at.

Get it

Open a terminal and copy-paste:

git clone https://github.com/AndresCotton/ai-character-index.git
cd ai-character-index
python3 -m http.server 8080 --directory site

If you'd like to run new judges, simply add an OpenRouter API key. Follow the README for more details.

Or hand it to an agent

Everything can be done by a coding agent. Open one in your clone and say “register a behaviour about X and run the panel” -- the repository ships agent instructions (AGENTS.md) carrying the steps and their gotchas, so no by-hand setup is needed.

Credits

The AI Character Index was created by Andrés Cotton and Matt Stults, and almost everything you are using is theirs. The vision and the initial execution are Andrés's, including the first version of this spec reader; Matt did the work of getting that production ready. Between them they wrote the judging pipeline, the citation resolver and the reader itself, in AndresCotton/ai-character-index, published at ai-character-index.pages.dev.

Their work was supported by Generator Residency (Kairos & Constellation) and BlueDot Impact.

Run by Polaris Collective since September 2026, with Andrés's agreement, and started by him.