How it works / NewsEnough
Skip to the index of this site

Between an event happening and the sentence you read, there are eight stages.

Notice 02, How it worksLast true on

The pipeline runs in one pass. It detects an event from media, and it writes the item from documents, so no outlet's body text is ever stored.

The product is not open yet. Every stage below is built, in the order it runs. A day goes out only after a named editor signs it off, and no editor has been appointed yet, so the Line is off.

We read the documents, not the pundits.

Stage three resolves a story to its origin document before anything is written, and where no origin document exists the story cannot be stated flat.

The eight stages

Each stage runs on its own queue, and every item records the version of the pipeline that produced it.

  1. 01Detect. In: headlines, timestamps, web addresses, section labels and metadata from the outlet feeds listed in the sources register, together with structured public records for planning, council committees, courts, schools, crime and licensing. Out: a signal, with its place and the entities it names. Never: a word of body text from any outlet.
  2. 02Cluster and rank. In: the day's signals. Out: clusters that describe one event, ordered by how far a story has spread across outlets, by its arrival rate against its own baseline, and by its consequence to the reader. Never: ranking on headline similarity, which is a tie-breaker and never the key.
  3. 03Resolve to origin. In: a cluster. Out: the primary document behind it, which is a statement, a filing, a judgment, a data release, a planning document or a set of minutes, with its publisher and its publication time. Never: a general web search. The agent reads the Grade A registers of the jurisdiction, and returns no origin rather than the wrong document.
  4. 04Corroborate. In: the origin document and the outlet metadata. Out: a claim set, each claim carrying its grade, its citation and its confidence. Never: a fact resting on one outlet without the label that says so.
  5. 05Rehydrate backstory. In: the story so far, from open-licence reference works. Out: discrete facts, each attributed, each resolved to a Grade A document where one exists. Never: pasted text. A backstory that repeats a run of words from a reference work is refused.
  6. 06Write once, at four depths. In: the origin extraction, the claim set, the backstory facts, the place resolution and the voice rules. Out: one sentence, a paragraph of sixty to ninety words carrying the line about what it means for you, a backstory of two hundred to three hundred and fifty words, and the sources. Never: outlet text in the prompt, because none is stored to put there. The four depths are written in one pass, so they cannot contradict each other.
  7. 07The human edit queue. In: the written item. Out: an approval, an amendment, a hold or a rejection, recorded with the editor and the reason. Never: publication of a flagged item without an approval row. An item held past its own story window expires instead of publishing late.
  8. 08Personalise by selection. In: a reader's place set, chips, standing instructions, follows, seen state and cadence. Out: an ordered list of three to six items, with backstory attached to anything missed. Never: a model call at this stage, and never a sentence rewritten for one reader.

No outlet's body text ever enters storage

This is the one rule that has to hold everywhere, because a single exception to it changes what the company is. No column, no cache, no log line, no queue payload, no embedding input and no model prompt in this system holds the body text of a work whose licence does not permit it. Headlines, web addresses, timestamps, metadata, structured records and facts are in scope. Body text of an outlet page is not, in any form, at any stage, transiently or otherwise.

Nobody's article is stored, in whole or in part.

Three things hold it. Each source adapter keeps the metadata and discards the rest of the document inside the same parse, so nothing after it is handed body text. The table that holds source documents takes only Grade A records under a listed open licence, and it has no column for article text. The writing step is handed stored claims and citations and nothing else, so an outlet's text has no route into a prompt.

The writing step has no input that carries article text. An item that cites nothing, or whose sentences are not each tied to a cited claim, is refused and not stored.

One editor for each region

A named editor signs off each region's day before it goes out. Every item in a flagged local category also needs its own approval: school ratings, crime, court items, any item naming a private individual, a licensing decision naming a person, and any item carrying the not-confirmed label.

The refusal sits at the delivery boundary rather than in the interface. A renderer refuses a flagged item whose approval row is absent, so an unapproved item is missing from the page, the email, the feed and the API alike.

No editor has been appointed yet. Until one is, no day is signed off and nothing is sent.

Personalisation is by selection, never by prose

Everyone in a region reads the same edited sentence about a story. Briefs differ in which items they carry, in what order, in how far the geography reaches, and in how much backstory attaches. No reader is given a differently worded version of a fact.

Selection cannot change a word.

Stage eight contains no model call. It chooses and orders items that are already written and edited, and it writes nothing.

The grades, the publish floor and the wording rules that stages four and six apply are set out in the corroboration policy. Every register the pipeline reads is published with its grade and its licence in the source register.

That is the whole pipeline, and no part of it keeps a word of anyone else's article.