The scenario
Four interviews, four interviewers, and the candidate explains the same career history four times. Meanwhile the thing the second interviewer was unsure about never reaches the fourth, who could have probed it. Scorecards fix the decision. They do not fix the conversation.Step 1 — Scope notes to the candidate
Step 2 — Brief the next interviewer
Step 3 — See the shape of the panel
Evals
- Run one real loop, recording after each interview.
- Before the final interview, generate the briefing and ask that interviewer whether it changed their plan.
- Check no note leaks across candidates: query with a different
user_idand confirm nothing returns. - Compare time-to-decision against loops run without it.
Guardrails
- Do not let a briefing replace an independent read. Handing interviewer four a summary of three opinions is how a panel converges on the first opinion. Share what was covered; be careful about sharing what was concluded.
- Never use this to score or rank candidates automatically. It is a retrieval system, not an assessment, and in several jurisdictions automated decision-making here carries specific legal obligations.
- Keep the space off-limits to the hiring manager’s wider org. Scope is relevance, not access.
Built from
Both are complete, runnable scripts:support_bot_scoping.py,
knowledge_graph.py.