backend: add the reference library (参考文献)

One table per document the writer has read, and one for its contributors:

    reference          id, type, title, subtitle, title_translated,
                       container_title, volume, issue, pages, publisher,
                       publisher_place, event_*, publication_year/month/day,
                       accessed_date, doi, isbn, issn, url, patent_*,
                       standard_number, report_number, arxiv_id, abstract,
                       keywords, note, citation_key, language
    reference_author   reference_id, sort, name, family_name, given_name, role

The field set is the intersection of the formats a paper has to survive, taken
from the CSL JSON schema (103 fields, 45 types — what Zotero, Mendeley and
Pandoc exchange) against GB/T 7714-2015, BibTeX and RIS. The mapping is on
`app.models.reference` rather than in a commit message, because the next person
to add a column needs it more than this one does. Three decisions worth naming:

* **Partial dates.** Year, month and day are separate nullable integers, which
  is CSL's `issued`: a book has a year, a newspaper article a day, a patent its
  公告日期, and nothing invents the rest.
* **Contributors are rows, not a column.** A citation prints an ordered list
  with 编 / 译 marks, and styles rewrite names (「张三」 / "Zhang, S." /
  "S. Zhang"), so the printed form and its two halves are stored separately —
  display reads `name`, a reformatting style reads the halves, and an
  institutional author has neither.
* **`volume` / `issue` / `pages` are strings.** Journals print `12(Suppl.)`,
  `S1` and `e12345`, and a citation reproduces what is printed.

The library is global: the same article is cited from several papers, so the
entry cannot belong to one of them. The citation stays on the paper side in
`paper_sentence_reference`, which now carries a real foreign key to `reference`
(`ON DELETE RESTRICT`) — the column had been a loose integer waiting for this
table. A sentence may quote several documents and a document may be quoted by
many sentences, which is why the relation is a table and not a column on
`paper_sentence`.

Refusals are raised once, in the data layer, as `UnknownReference`, and
translated where each caller speaks: `400` with the offending ids for REST (one
exception handler, no route carries the check), a readable tool error for MCP
(one wrapper in the tool registry). Neither entry point can skip it, so the
foreign key never has to be the thing that complains.

API: `/references` CRUD plus batch delete, and `/references/{id}/citations` for
the reverse lookup — "where have I used this article?" — which is what tells a
writer whether an entry is safe to delete.

Verified: 29 new checks in `scripts/smoke_references.py` (partial dates, DOI
normalisation, author order and roles, search by author/type/year/cited, the
citation round trip, 400 on a phantom id, 409 on a cited entry), the paper
suite's 45 and the MCP suite's 47 still pass. The MCP suite now cites a real
entry instead of a phantom id, which is what an agent has to do now.
This commit is contained in:
2026-09-22 17:13:32 +08:00
parent 103b5544ba
commit d7bb777264
18 changed files with 1966 additions and 16 deletions
+26
View File
@@ -31,6 +31,7 @@ from sqlalchemy import func, or_, select
from sqlalchemy import update as sa_update
from sqlalchemy.orm import Session
from app.crud import reference as reference_crud
from app.crud.filters import LIKE_ESCAPE, like_pattern
from app.models import (
Paper,
@@ -528,6 +529,24 @@ def delete_many(db: Session, paper_ids: Sequence[int]) -> int:
# --- paragraphs and sentences ------------------------------------------------
def _assert_citations_known(
db: Session, sentences: Sequence[object]
) -> None:
"""Check every ``reference_id`` sent with a sentence against the library.
One place for the check, called by each write path, so a new entry point
cannot skip it and let the foreign key be the thing that complains.
"""
wanted = [
citation.reference_id
for sentence in sentences
for citation in getattr(sentence, "citations", []) or []
if citation.reference_id is not None
]
if wanted:
reference_crud.assert_exist(db, wanted)
def replace_paragraph(
db: Session,
paper: Paper,
@@ -546,6 +565,8 @@ def replace_paragraph(
Blank lines are kept if the client sends them: an empty sentence is a
legitimate placeholder and renders as a blank line rather than vanishing.
"""
_assert_citations_known(db, payload.sentences)
target = payload.target_sort if payload.target_sort is not None else field_sort
# Clear the source paragraph first, so that a move onto itself does not
@@ -583,6 +604,8 @@ def replace_paragraph(
def append_sentence(db: Session, paper: Paper, data: SentenceCreate) -> PaperSentence:
"""Add one sentence to a paragraph, at the end unless told otherwise."""
_assert_citations_known(db, [data])
sort = (
data.sort
if data.sort is not None
@@ -614,6 +637,9 @@ def update_sentence(
list is short, and replacing it wholesale is the only way to be sure that a
deleted citation really is gone.
"""
if data.citations is not None:
_assert_citations_known(db, [data])
if data.sort is not None:
sentence.sort = data.sort
if data.paper_template_filed_sort is not None: