Interview Kit

Interview Kit

When to Use

• Designing a structured interview loop for a specific role and level
• Creating standardized question banks organized by interview round type
• Building scoring rubrics for consistent candidate evaluation across interviewers
• Reducing interviewer bias with process controls and calibration
• Turning a job description into a repeatable evaluation process
• Calibrating interview panels after quarterly hiring outcome reviews

Context Required

• From startup-context: Company stage, team size, engineering culture, current interview process (if any), hiring velocity
• From user: Role title, level (junior/mid/senior/staff), key competencies to evaluate, number of interview rounds the team can support, whether a take-home or live exercise is preferred

Workflow

1. Define competencies — Extract 4-6 core competencies from the job description. Split into technical skills, domain knowledge, collaboration traits, and startup-fit signals. Each competency must be evaluable with observable evidence.
2. Design the interview loop — Map competencies to interview stages with explicit, non-overlapping objectives per round. Typical startup loop: recruiter/founder screen, technical assessment, team interview, values interview. Assign timing and interviewers to each stage.
3. Write structured questions — For each stage, write 3-5 primary questions with follow-up probes. Every question must map to a specific competency. Include "what good looks like" answer guidance so interviewers know what signal they are looking for.
4. Build scorecards — Create a 1-4 rating scale (not 1-5 — it creates a "3 means fine" dead zone). Define behavioral anchors at each level specific to the role. Interviewers must score independently before the debrief.
5. Design take-home or live exercise — If applicable, create a practical assessment that mirrors real work. Time-cap it (2-4 hours max), share the evaluation rubric with the candidate upfront, and always follow up with a live walkthrough.
6. Add anti-bias guardrails — Require structured debrief instructions, independent scoring protocol, and a checklist of common bias traps. Every candidate for the same role gets the same core questions in the same order.
7. Plan calibration cadence — Set quarterly recalibration using hiring outcome data. Review whether loop design still surfaces the right signals based on quality-of-hire metrics.

Output Format

A complete interview kit document containing:

• Role summary and competency matrix (4-6 competencies with definitions)
• Interview loop overview (stages, duration, interviewers, competency mapping)
• Per-stage question sets with follow-up probes and scoring rubrics
• Take-home or live exercise brief with time cap and evaluation criteria
• Scorecard template (1-4 scale with behavioral anchors)
• Debrief protocol with independent scoring and evidence-based discussion rules
• Compensation benchmarking notes (if requested)

Frameworks & Best Practices

Competency Categories by Role Type

• Engineering: System design, code quality, debugging approach, technical communication, ownership/initiative
• Product: Customer empathy, prioritization frameworks, cross-functional communication, data-informed thinking, shipping velocity
• Go-to-market: Discovery/qualification, storytelling, objection handling, pipeline management, customer orientation
• Design: Design process, craft quality, user research fluency, systems thinking, collaboration with engineering

Scorecard Design (1-4 Scale)

• 1 — Does not meet bar: Could not demonstrate the competency. Clear concerns.
• 2 — Below bar: Showed partial ability but gaps are significant for the level.
• 3 — Meets bar: Demonstrated the competency at the expected level. Solid hire signal.
• 4 — Exceeds bar: Demonstrated exceptional strength. Would raise the team's capability.

Each score level must include 1-2 concrete behavioral anchors specific to the role being evaluated.