1 Commits
Author SHA1 Message Date
cmos dev a21d2614d3 iter 7: prompt rules 27-29 driven by real-draft testing
First exercise of the tool against unfamiliar real-world drafts (user's
in-progress academic papers, not derived from CMOS quick guide
examples). Found three systemic patterns affecting ~14% of entries
across 134-entry and 13-entry drafts; this commit addresses all three.

Prompt additions:

 27. GOVERNMENT DOCUMENTS / INSTITUTIONAL REPORTS — when the author is
     a government body (GAO, US Census, WHO, Pew, etc.) and the source
     is a standalone report, italicize the title like a book; do NOT
     wrap it in quotes. CMOS 14.272.

 28. PRESERVE DELIBERATE LOWERCASING of proper nouns. Examples cited in
     the prompt: the journal "portal: Libraries and the Academy"
     (deliberately lowercase "p"), authors bell hooks / danah boyd /
     e e cummings, brand names iPhone / eBay. Headline-case
     normalization must NOT touch these.

Rule 17 also extended (was newspaper/magazine only):

 17. PERIODICAL NAMES — drop leading "The" from ANY periodical:
     newspapers, magazines, AND scholarly journals. Write "Journal of
     Academic Librarianship", not "The Journal of Academic
     Librarianship"; "Library Quarterly", not "The Library Quarterly";
     "American Archivist", not "The American Archivist". CMOS 14.191.
     Rule explicitly excepts BOOK titles and report titles, which keep
     their leading "The" (e.g., *The Library's Guide to Sexual and
     Reproductive Health Information*).

Empirical impact, Reading_Disrepair (13 entries):
  before: 3 errors (2 leading-The, 1 GAO format, 1 portal capitalized)
  after:  0 errors

Empirical impact, HML Submission (134 entries):
  before: ~21 errors (18 leading-The, 0 GAO in this draft, 3 portal)
  after:  ~1 error (a multi-author 2nd-author inversion bug newly
          surfaced — separate fix)

Also adds scripts/analyze_draft_output.py — a triage helper that
diff-walks input and output, surfacing common failure patterns
(leading-The, doi: prefix, bare-hyphen ranges, gov-report quoted, and
intentional lowercasing stripped). False positives are tolerated since
it's a human-review tool, not a validator.

Exemplar corpus is unchanged. Re-baseline against 14 canary exemplars
under the new rules: scalar 1.000, canary 1.000 (no regressions).

User's real drafts under rough_drafts/ remain untracked — they are
in-progress academic work and don't belong in git history.
2026-04-11 00:43:40 -04:00