Skip to content

Preserve task coverage and uncertainty in concise responses - #11

Merged
kmizu merged 1 commit into
mainfrom
improve-response-quality
Oct 5, 2026
Merged

kmizu merged 1 commit into
mainfrom
improve-response-quality

Conversation

@kmizu

@kmizu kmizu commented Oct 5, 2026

Copy link
Copy Markdown
Owner

Short questions could suppress necessary verification, and the one-topic/confirmation rules could interrupt work that was already authorized. Version 0.5.0 matches length to task complexity, preserves material uncertainty, covers all requested topics, and continues routine authorized fixes while retaining consequential clarifications and destructive-action confirmation.

Adds a bilingual response suite with 36 actual captured answers across no rules, 0.4.0, and 0.5.0, plus independent blinded semantic review and an offline scorer. Quality is separate from keyword indicators and character counts; source, answer, and reviewed-input fingerprints reject stale grades. CI checks the recorded candidate and its match to the shipped canonical rules. The Codex package is regenerated, README host sections are preserved, and the Claude hook banner is shortened to keep full output below 10 KB.

In this small pilot, semantic passes were 12/12 without concise, 8/12 with 0.4.0, and 12/12 with 0.5.0. The revised batch is 17.4% longer than 0.4.0 and 41.0% shorter than no rules. This is one batch per condition with an agent reviewer from the same model family; it does not establish general or cross-model improvement. Raw answers, review evidence, and limitations are in evals/PILOT.md.

Validation:

  • 47 unit tests passed, including native Codex installation/loading in a scratch home.
  • Claude marketplace and plugin manifest validation passed.
  • Generated Codex package check and revised semantic gate passed.
  • git diff --check passed; independent code review found no remaining blocking issues after integrity fixes.

Authored with OpenAI Codex. One implementation commit.

@kmizu
kmizu merged commit 6b87be5 into main Oct 5, 2026
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant