10 KiB
Heuristics and Checklists Templates
Quick-start templates for designing decision heuristics and error-prevention checklists.
Decision/Procedure Identification Template
What needs simplification?
Type: [Decision / Procedure]
Frequency: [How often does this occur? Daily / Weekly / Monthly]
Current approach: [How is this currently done?]
Problems with current approach:
- Too slow (takes [X] hours/days)
- Inconsistent outcomes (variance in quality)
- Errors frequent ([X]% error rate)
- Cognitive overload (too many factors to consider)
- Analysis paralysis (can't decide, keep searching)
- Knowledge not transferable (depends on expert intuition)
Goal: [What do you want to achieve? Faster decisions? Fewer errors? Consistent quality?]
Heuristic Design Template
Step 1: Define the Decision
Decision question: [What am I choosing?]
- Example: "Which job candidate to hire?"
- Example: "Which customer segment to prioritize?"
Options: [What are the alternatives?]
- [Option A]
- [Option B]
- [Option C] ...
Step 2: Choose Heuristic Type
Type selected: [Recognition / Take-the-Best / Satisficing / Fast & Frugal Tree]
Option A: Recognition Heuristic
Rule: If you recognize one option but not the other, choose the recognized one.
Applies when:
- Recognition correlates with quality (brands, cities, experts)
- Environment stable (not deceptive advertising)
Example: "Choose candidate from company I recognize (Google, Amazon) over unknown startup"
Option B: Take-the-Best Heuristic
Most important criterion: [What single factor best predicts outcome?]
Rule: Choose the option that scores best on this criterion alone. Ignore other factors.
Example: "For hiring engineers, use 'coding test score' only. Ignore school, years experience, personality."
Cue validity: [How often does this criterion predict success? Aim for >70%]
Option C: Satisficing
Minimum acceptable threshold: [What criteria must be met?]
| Criterion | Minimum | Notes |
|---|---|---|
| [Criterion 1] | [Threshold] | [e.g., "Coding score ≥80%"] |
| [Criterion 2] | [Threshold] | [e.g., "Experience ≥2 years"] |
| [Criterion 3] | [Threshold] | [e.g., "Culture fit ≥7/10"] |
Rule: Choose first option that meets ALL thresholds. Stop searching.
Search budget: [How many options to evaluate before lowering threshold? e.g., "Evaluate 3 candidates, if none meet threshold, adjust."]
Option D: Fast & Frugal Tree
Decision tree:
Question 1: [Binary question, e.g., "Is deal >$10k?"]
├─ Yes → [Action A or Question 2]
└─ No → [Action B]
Question 2: [Next binary question]
├─ Yes → [Action C]
└─ No → [Action D]
Example (Customer routing):
Is customer enterprise (>1000 employees)?
├─ Yes → Assign senior rep
└─ No → Is deal value >$10k?
├─ Yes → Assign mid-level rep
└─ No → Self-serve flow
Step 3: Define Exceptions
When this heuristic should NOT be used:
- [Condition 1: e.g., "Novel situation with no precedent"]
- [Condition 2: e.g., "Stakes >$100k (requires full analysis)"]
- [Condition 3: e.g., "Adversarial environment (deception likely)"]
Checklist Design Template
Step 1: Identify Critical Steps
Procedure: [What process needs a checklist?]
Brainstorm all steps (comprehensive list first):
- [Step 1]
- [Step 2]
- [Step 3] ...
Filter to critical steps (keep only steps that meet ≥1 criterion):
- Often skipped (easy to forget)
- Serious consequences if missed (failures, errors, safety risks)
- Not immediately obvious (requires deliberate check)
Critical steps (5-10 items max):
- [Critical step 1]
- [Critical step 2]
- [Critical step 3]
- [Critical step 4]
- [Critical step 5]
Step 2: Choose Checklist Format
Format: [READ-DO / DO-CONFIRM / Challenge-Response]
Guidance:
- READ-DO: Novices, unfamiliar procedures, irreversible actions
- DO-CONFIRM: Experts, routine procedures, familiar tasks
- Challenge-Response: Two-person verification for high-stakes
Step 3: Write Checklist
Checklist title: [e.g., "Software Deployment Pre-Flight Checklist"]
Pause points: [When to use this checklist?]
- Before: [e.g., "Before initiating deployment"]
- During: [e.g., "After migration, before going live"]
- After: [e.g., "Post-deployment verification"]
Format template (READ-DO):
[CHECKLIST TITLE]
☐ [Verb-first action 1]
└─ [Specific detail or criteria if needed]
☐ [Verb-first action 2]
⚠ [KILLER ITEM - must pass to proceed]
☐ [Verb-first action 3]
☐ [Verb-first action 4]
☐ [Verb-first action 5]
All items checked → Proceed with [next phase]
Format template (DO-CONFIRM):
[CHECKLIST TITLE]
Perform procedure from memory, then confirm each item:
☐ [Action 1 completed?]
☐ [Action 2 completed?]
☐ [Action 3 completed?]
☐ [Action 4 completed?]
☐ [Action 5 completed?]
All confirmed → Procedure complete
Example Heuristics
Example 1: Hiring Decision (Satisficing)
Decision: Choose job candidate from pool
Satisficing threshold:
| Criterion | Minimum |
|---|---|
| Technical skills (coding test) | ≥75% |
| Communication (interview rating) | ≥7/10 |
| Culture fit (team feedback) | ≥7/10 |
| Reference check | Positive |
Rule: Evaluate candidates in order received. First candidate meeting ALL thresholds → Hire immediately. Don't keep searching for "perfect" candidate.
Search budget: If first 5 candidates don't meet threshold, lower bar to 70% technical (but keep other criteria).
Example 2: Investment Decision (Take-the-Best)
Decision: Which startup to invest in?
Most predictive criterion: Founder track record (prior exits or significant roles)
Rule: Rank startups by founder quality alone. Invest in top 2. Ignore market size, product, traction (assume cue validity of founder >70%).
Validation: Test on past investments. If founder track record predicts success <70% of time, switch to different criterion.
Example 3: Customer Triage (Fast & Frugal Tree)
Decision: How to route incoming customer inquiry?
Tree:
Is customer enterprise (>1000 employees)?
├─ Yes → Assign to senior account exec (immediate response)
└─ No → Is issue billing/payment?
├─ Yes → Assign to finance team
└─ No → Is trial user (not paid)?
├─ Yes → Self-serve knowledge base
└─ No → Assign to support queue (24h SLA)
Example Checklists
Example 1: Software Deployment (READ-DO)
Software Deployment Pre-Flight Checklist
☐ All tests passing
└─ Unit, integration, E2E tests green
⚠ Database migrations tested on staging
└─ KILLER ITEM - Deployment blocked if migrations fail
☐ Rollback plan documented
└─ Link to runbook: [URL]
☐ Monitoring dashboards configured
└─ Alerts set for error rate, latency, traffic
☐ On-call engineer identified and notified
└─ Name: [___], Phone: [___]
☐ Stakeholders notified of deployment window
└─ Email sent with timing and impact
☐ Feature flags configured
└─ Gradual rollout enabled (10% → 50% → 100%)
☐ Backups completed
└─ Database backup timestamp: [___]
All items checked → Proceed with deployment
Example 2: Aviation Pre-Flight (DO-CONFIRM)
Pre-Flight Checklist (DO-CONFIRM)
Perform checks, then confirm:
☐ Fuel quantity verified (visual + gauge)
☐ Flaps freedom of movement checked
☐ Landing gear visual inspection complete
☐ Oil level within limits
☐ Control surfaces free and correct
☐ Instruments verified (altimeter, compass, airspeed)
☐ Seatbelts and harness secured
☐ Flight plan filed
All confirmed → Cleared for takeoff
Example 3: Surgical Safety (WHO Checklist - Challenge/Response)
WHO Surgical Safety Checklist - Time Out (Before Incision)
[Entire team pauses, nurse reads aloud, surgeon confirms each]
☐ Confirm patient identity
Response: "Name: [___], DOB: [___]"
☐ Confirm surgical site and procedure
Response: "Site marked, procedure: [___]"
☐ Anticipated critical events reviewed
Response: "Surgeon: [Key steps], Anesthesia: [Concerns], Nursing: [Equipment ready]"
☐ Antibiotic prophylaxis given within 60 min
Response: "Administered at [time]"
☐ Essential imaging displayed
Response: "[X-ray/MRI] displayed and reviewed"
All confirmed → Surgeon may proceed with incision
Application & Monitoring Template
Applying Heuristic
Heuristic being applied: [Name of rule]
Case log:
| Date | Decision | Heuristic Used | Outcome | Notes |
|---|---|---|---|---|
| [Date] | [What decided] | [Which rule] | [Good / Bad] | [What happened] |
| [Date] | [What decided] | [Which rule] | [Good / Bad] | [What happened] |
Success rate: [X good outcomes / Y total decisions = Z%]
Goal: ≥80% good outcomes. If <80%, refine heuristic.
Applying Checklist
Checklist being applied: [Name of checklist]
Usage log:
| Date | Procedure | Items Caught | Errors Prevented | Time Added |
|---|---|---|---|---|
| [Date] | [What done] | [# items flagged] | [What would've failed] | [+X min] |
| [Date] | [What done] | [# items flagged] | [What would've failed] | [+X min] |
Error rate:
- Before checklist: [X% failure rate]
- After checklist: [Y% failure rate]
- Improvement: [(X-Y)/X × 100]% reduction
Refinement Log Template
Iteration: [#1, #2, #3...]
Date: [When refined]
Problem identified: [What went wrong? When did heuristic/checklist fail?]
Root cause: [Why did it fail?]
- Heuristic: Wrong criterion chosen, threshold too high/low, environment changed
- Checklist: Missing critical step, too long (skipped), wrong format for user
Refinement made:
- Before: [Old rule/checklist]
- After: [New rule/checklist]
- Rationale: [Why this change should help]
Test plan: [How to validate refinement? Test on X cases, monitor for Y weeks]
Outcome: [Did refinement improve performance? Yes/No, by how much?]