Skip to content

0044 makes the ontology a view over what documents say - #710

Draft
WaylandYang wants to merge 11 commits into
devfrom
docs/a-document-is-read-in-stages
Draft

WaylandYang wants to merge 11 commits into
devfrom
docs/a-document-is-read-in-stages

Conversation

@WaylandYang

@WaylandYang WaylandYang commented Sep 15, 2026

Copy link
Copy Markdown
Contributor

Rewrites decision record 0044. The staged-reading draft proposed more stages around binding facts to the ontology at write time; a prototype run on 2026-09-15 found that binding at write time is where extraction errors come from.

What the record now proposes:

  • Three layers. Extraction writes an open graph in the documents' own words; a small ontology is proposed by an agent and approved by people; a typed graph is computed from the open graph, with bindings decided once per signature (phrase, subject classes, object classes) and cached with the ontology version.
  • Time is resolved like identity. Time mentions are facts; a document time context is carried across chunks (the document's own date, never its upload time, Upload time is used as the document date in extraction #714); the model returns an anchor, offset and granularity, and code computes the interval.
  • Identity across documents is decided on evidence. Candidates, deterministic scoring with cannot-links, the adjudicator only for undecided pairs, constrained clustering, re-evaluation.
  • An errata agent reviews the typed graph after extraction, through the gate.

Evidence (Re-DocRED 100 documents plus the FDA, statistics and SEC corpora; DeepSeek-V4-Flash, judged by a calibrated DeepSeek-V4-Pro): 0 of 333 open statements unstated against 4–9% of facts bound at write time; per-document slicing of a 967-property ontology keeps 86.6% of needed relations; an errata agent raised judged precision from 76.1% to 89.5%; token cost and a compact pipeline are measured in the record.

Nothing is built in the product. Stacked on #699 for 0043.

🤖 Generated with Claude Code

WaylandYang and others added 7 commits September 14, 2026 14:09
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Signed-off-by: WaylandYang <wayland0916@gmail.com>
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Signed-off-by: WaylandYang <wayland0916@gmail.com>
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Signed-off-by: WaylandYang <wayland0916@gmail.com>
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Signed-off-by: WaylandYang <wayland0916@gmail.com>
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Signed-off-by: WaylandYang <wayland0916@gmail.com>
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Signed-off-by: WaylandYang <wayland0916@gmail.com>
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Signed-off-by: WaylandYang <wayland0916@gmail.com>
@WaylandYang WaylandYang changed the title 0044 proposes reading a document in stages 0044 makes the ontology a view over what documents say Sep 15, 2026
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Signed-off-by: WaylandYang <wayland0916@gmail.com>
WaylandYang and others added 2 commits September 16, 2026 13:47
…bench

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Signed-off-by: WaylandYang <wayland0916@gmail.com>
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Signed-off-by: WaylandYang <wayland0916@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant