Your website, your guides, your training decks, and your referral lists are the raw material for every AI tool. This is the cohort's playbook for turning that backlog into a knowledge base an AI can use safely, without losing control. It is a journey through stages, not a one-time export, and you do not have to reach the end to get value.
Every tool runs on your content. Before any of them helps a person, your content has to be gathered, structured, tagged, and made safe to serve. The stages run in order, and each one produces something you can use on its own.
You do not need the whole journey to get value. Take one high-traffic issue, like eviction or debt. Index and tag it, assign its authority tier, chunk it, put a safety layer in front of it, and serve it through one interface. Grow from there.
Agreeing who shares what comes before any tagging. State teams have taken different coordination approaches, from a light touch to full federation, and all of them are valid starting points. The right level depends on how many organizations you are working with and how much trust is already in place. For example, one Texas team keeps the ask deliberately small: give me your URL, your subject matter, and the languages you offer, and I will build the knowledge base and the referral mechanism from that.
| Source | Owner | Their context | First ask |
|---|---|---|---|
| Website CMS | Comms lead | Owns the publishing workflow | Export one section |
| Referral database | Partner org | Small team, limited time | URL, subject, languages |
| Advocate know-how | Senior staff attorney | Accountable for accuracy | A 30-minute interview |
Audit your content, decide what is in, and tag it as it comes in. On the gathering method, there is a real choice, and the cohort has a recommendation. The cohort built its index from a content management system export, from Drupal, WordPress, or similar, and recommends that route, because an export gives you the metadata, the revision history, and the internal relationships that a scrape cannot see, and it keeps you in control of exactly what enters the knowledge base. Scraping is a reasonable fallback for public content you do not control, and AI-assisted ingestion helps at large volume.
| Tier | Source | Trust |
|---|---|---|
| Tier 1 | Expert-authored, taxonomy-tagged | Highest |
| Tier 2 | AI-outlined, expert-filled | High |
| Tier 3 | Scraped public content | Medium |
| Tier 4 | User-contributed | Lower |
Split the content, attach safety to each piece, and embed it. How you split depends on the content type. There are three broad strategies: fixed-size chunks of 400 to 500 words with overlap, which work when the source content is well-written; semantic chunking by heading or section, which preserves structure for complex documents; and a hybrid that retrieves many chunks and re-ranks to the best few. The most important lesson in this stage is about safety, because disclaimers in a system prompt are not enough. The stronger pattern is a deterministic set of rules that sits on top of the content and decides how each chunk is displayed.
"In California, you have 10 court days to respond to an eviction complaint after you are served."
People's Law School's Beagle+ works this way: it parses pages into 200 to 600 word chunks with overlap, tags each with source, title, topic, and date, embeds them, and re-runs the pipeline nightly so the index stays current.
Set up the storage and wire the relationships between records. Storage is a vector database for semantic search plus a metadata store, like PostgreSQL, Airtable, or Sanity, for filtering and facets. You define the relationships that let a tool navigate, such as the issue hierarchy from Housing to Eviction to Eviction Defenses, along with document-to-section and guide-to-form links. The working group converged on an MCP server as the standard interface, so any bot, tool, or partner queries the same content the same way.
Semantic search over your chunks.
Filter by jurisdiction, issue, type, tier.
One interface for every bot and partner.
Grade the system against a test set before it reaches a person. Define your evaluation criteria across retrieval accuracy, answer correctness, safety compliance, and citation coverage. Build a test set of representative queries, edge cases like multi-jurisdiction and complex eligibility, and known-tricky scenarios with conflicting guidance. Then run the evaluations and iterate, fixing gaps in content, improving chunking where retrieval fails, and adding guardrails where safety issues show up.
| Criterion | How measured | Result |
|---|---|---|
| Retrieval accuracy | Automated metric | Pass |
| Answer correctness | Expert spot-check | Needs edit |
| Safety compliance | Harm test set | Pass |
| Citation coverage | Automated metric | Fail · uncited claim |
The scorecard tells you exactly what to fix before launch: here, a claim that does not carry its citation.
Put it into production, then keep it alive. Choose initial use cases, like website search, a chatbot, service matching, or advocate tools, and build the interfaces, user-facing and admin, with monitoring dashboards. The longer and harder work is what comes after launch. Every team named maintenance as the hardest part, because stale content is universal, so the knowledge base is a living system, not a delivered project.
Cases, statutes, admin orders.
Thin or missing topics.
Flag stale content.
Every language you serve.
And around again, continuously. The cycle is the job, not a closing task.
Add relationships as a graph after stages 1 through 5 are working well. The graph is the last step, not the first. One state is planning a graph on the order of two million nodes, connecting organizations, services, eligibility, and issues, and it is building the simpler layers first.
The stages tag against shared vocabularies and lean on shared methods. A team building any of this starts here rather than from scratch.
The shared vocabularies you tag against: LIST codes for issues, FIPS codes for jurisdiction, content types, audience categories, and the authority tiers. Tag against this rather than inventing your own.
The deterministic rules that sit on top of the content: chunk-level warnings, linked warnings that travel with the content, retrieval rules, and a harm evaluation before launch.
How to build the test set and grade retrieval accuracy, answer correctness, safety compliance, and citation coverage, with the grounding and classification findings from the companion guides.
The datasets and vocabularies you can build on instead of starting cold, so you reuse the field's work rather than rebuilding it.
If a word above sent you here, this is what it means. You do not need the jargon to use the Playbook.
This playbook builds the knowledge base the tools run on. The reason to do it is the tools that content unlocks: the Q&A bot, the issue classifier, the referral router, and more.