[rparundekar]

What this does

Adds agent.py beside the KYC workflow for the two odd jobs in the workflow-vs-agent guide.

• The customer who moved (interactive): the analyst asks three questions, each depending on the last answer. The agent answers from the handbook and the workflow's own check. Code fails any answer that hides where the handbook and the workflow disagree.
• The regulator's letter (one-off): it asks for every 2025 account opened on a mobile phone bill, and what was done about each. The workflow checks each file. Code reads every 2025 address scan itself to check that the agent found every account. The guide says no code can do that check, and this one does it.

Live results (5 runs each, using SIE Serverless, 10 Nov 2026)

• Conversation: 5 of 5 as expected.
• Letter: 2 of 5 as expected.
  • Two misses were right answers that the quote check refused, because "closed" is a one-word quote.
  • One miss was an SIE timeout that sent the job to a person.
• k25-011: the agent never found it on its own. The completeness check sent it back every time. The README draws the conclusion: the "find" half of the letter is a workflow, and the agent earns its cost on "what was done about each".

recipe.py gains one unused text field, and its results are unchanged. The README also records a kyc-06 run where the models failed in a different way from before.

Depends on the docs PR for the AGENTS.md layout and the CI step.

🤖 Generated with Claude Code

[rparundekar]

Self-review

Two review passes ran on this PR. One read the code: correctness, silent failures, tests and comments. The other covered security and checked the README against the code. Every finding below was fixed in 0a08207. Each fix has a selfcheck case that fails if the fix is undone.

Important (3, all fixed)

• The disagreement check missed most ways of saying yes. It looked only for a "counts" sentence with no negation word anywhere, and it never read the email. So "Yes, it counts, so no bill is needed", "she can use the tenancy agreement" and "it's valid proof of address" all passed without section 4.2, the sign-off or the workflow's address_document missing result. Fixed: while the latest KYC check shows the proof of address missing, any answer or email about the proof of address must carry all three. The check is now stricter, and the README says so.
• The sign-off check took a refusal as a sign-off. "Don't sign off the tenancy agreement yet", "I can't sign off ... until ..." and "Should I sign off ...?" were accepted, and the email dropped the proof-of-address ask. Fixed: a quote from a negated or question sentence is refused.
• Tools reached every customer. A line in an uploaded scan could get the agent to look up another case and paste its address into the email, and the email check only caught surnames and ids. Fixed: each job's tools reach only its own cases (kyc-13 for the conversation, the 2025 accounts for the letter). "Names no other customer" now holds by construction, and the email check stays as a backstop.

Suggestions (all fixed)

• Escaping: values in the .md outputs are escaped, and answers and emails are fenced.
• Section numbers: matched on word boundaries, and "Section 4.2" and "§4.2" are accepted.
• Row checks: nothing_recorded fails when a note records an approved exception, and exception_approved fails when a later document met every requirement or was never checked.
• Claude errors: classified as transient or fatal, and tokens are priced on the model that answered. The verdict lines now open Pass. or Miss.

Reruns after the fixes (5 live runs per job)

9 of 10 came out as expected, up from 7 of 10.

• Conversation: 5 of 5. The stricter check never had to send an answer back.
• Regulator's letter: 4 of 5. The right four rows came out every run. The one miss is the one-word quote "closed" again, and the README reports it.
• Account k25-011: the agent still never found it on its own. The completeness check in code sent it back on all 5 runs.