Improve reference files: graduated challenge, story freshness, calibration proxy, transcript formats#32
Closed
dbhat93 wants to merge 1 commit intonoamseg:mainfrom
Closed
Improve reference files: graduated challenge, story freshness, calibration proxy, transcript formats#32dbhat93 wants to merge 1 commit intonoamseg:mainfrom
dbhat93 wants to merge 1 commit intonoamseg:mainfrom
Conversation
…ation proxy, transcript formats challenge-protocol.md: - Graduated activation (Level 3 = Assumption Audit only, Level 4 = + Blind Spot, Level 5 = all 5 lenses) instead of binary Level 5 only - Challenge Debt: unresolved challenges tracked across sessions and surfaced at the start of the next relevant session instead of silently dropped - Avoidance Confrontation now has distinct Level 3/4 behaviors, not just a single Level 5 mode story-mapping-engine.md: - Framing Variety Constraint replaces "no story twice" rule: a story may appear twice in a mapping if the angles are substantively different, tested via a 3-criteria Substantiation Test (different competency, different STAR section, different interviewer takeaway) - Story Freshness Score: 3-factor decay function (use frequency risk, experience age risk, Proven Performer offset) replacing raw use-count overuse check. Verdict: Fresh / Fresh (Proven) / Moderate / Stale calibration-engine.md: - Practice Calibration Proxy (Section 8): plateau detection without real interview outcomes — when same answer type practiced 5+ times and scores vary ≤0.3 across 3 consecutive sessions, flag as practice ceiling and prescribe behavioral change. New status: practice-calibrating. - Score Confidence Display (Section 9): scores carry calibration status context (Low/Medium/High confidence) so candidates don't treat estimates as ground truth - De-escalation Check: root causes are explicitly resolved when affected dimensions improve, preventing over-diagnosis drift - Explicit transition rule: practice-calibrating → calibrating when 3+ real outcomes arrive transcript-formats.md: - Added Fireflies.ai as 9th supported format with disambiguation rules separating it from Grain - Zoom Webinar distinction: Panelist: prefix handling - Format Fingerprint for ambiguous cases: 5-signal fingerprint + medium- confidence detection decision, gives candidate basis to override - Granola quality signal: AI summary cross-checked against raw transcript, flags possible truncation or hallucination decode.md: - Pathway-weighted batch triage: Referral / Warm intro / LinkedIn / Cold / Internal dimension added to ranking. A Long-Shot Stretch with a Referral ranks above an Investable Stretch cold application. - JD Honest Limitations surfaced in every Standard/Deep output as a named section (not just reference knowledge). Quick Scans include a one-line reminder. Candidates never walk away treating a decode as a complete picture. feedback.md: - Memory reliability tagging for Type D (Post-Session Memory): Same-day / 1-2 days / 3+ days tags applied to Question Bank entries - Guided elicitation prompts for thin memories: surfaces what's actually there rather than accepting vague recall as complete capture - Rejection Leverage defers to graduated Challenge Protocol levels instead of hardcoding Level 5 behavior Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Author
|
Closing this — the changes here have been superseded by PR #35, which consolidates all v3.1-v3.3 work into a single PR. Thanks! |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Improvements to 6 reference files and the decode + feedback commands, built while deeply using the skill. These were developed collaboratively and pressure-tested before submission.
What's included
references/challenge-protocol.md(new file)references/calibration-engine.md(new file)practice-calibratingreferences/story-mapping-engine.md(new file)references/transcript-formats.md(new file)references/commands/decode.md(new file)references/commands/feedback.md(new file)Test plan
🤖 Generated with Claude Code