Add or change a tell
Tells live in data/tells.yaml and the files in data/tells.d/, one entry each, in any of four layers: prose, interface, code or behavior. The registry schema lists every field.
Before you add one
A tell needs evidence that models use the pattern at a different rate from people. Measured evidence (Graphite's tables, a paper, a measure/ report) earns confidence: high. Patterns people complain about but nobody has counted belong in the file too, marked confidence: low.
Steps
- Add the entry with an
id, a pattern underdetect, afix, and an example pair. An interface, code or behavior tell also takes aspecimenthat shows it;npm run validatewarns without one. If no pattern can find the tell, usemethod: judgeand write the question a reader should ask. - Link it to measured terms with
measure.graphiteif Graphite's tables contain them, then runnpm run import:graphite. - For a prose tell, check it against human writing.
npm run eval -- <articles.jsonl.gz>prints how often each rule fires on human and on model articles in the train half. A rule that fires on people nearly as often as on models needs a narrower pattern, orseverity: 0so it reports without scoring. - Run
npm testandnpm run validate.
Changing a rule
Keep the id. Other tools refer to it in --disable lists and ignore settings. If a tell turns into a different pattern, add the new one and list it under the old one's substitutes.