Files
2025-11-30 08:38:26 +08:00

10 KiB
Raw Permalink Blame History

Heuristics and Checklists Templates

Quick-start templates for designing decision heuristics and error-prevention checklists.

Decision/Procedure Identification Template

What needs simplification?

Type: [Decision / Procedure]

Frequency: [How often does this occur? Daily / Weekly / Monthly]

Current approach: [How is this currently done?]

Problems with current approach:

  • Too slow (takes [X] hours/days)
  • Inconsistent outcomes (variance in quality)
  • Errors frequent ([X]% error rate)
  • Cognitive overload (too many factors to consider)
  • Analysis paralysis (can't decide, keep searching)
  • Knowledge not transferable (depends on expert intuition)

Goal: [What do you want to achieve? Faster decisions? Fewer errors? Consistent quality?]


Heuristic Design Template

Step 1: Define the Decision

Decision question: [What am I choosing?]

  • Example: "Which job candidate to hire?"
  • Example: "Which customer segment to prioritize?"

Options: [What are the alternatives?]

  1. [Option A]
  2. [Option B]
  3. [Option C] ...

Step 2: Choose Heuristic Type

Type selected: [Recognition / Take-the-Best / Satisficing / Fast & Frugal Tree]

Option A: Recognition Heuristic

Rule: If you recognize one option but not the other, choose the recognized one.

Applies when:

  • Recognition correlates with quality (brands, cities, experts)
  • Environment stable (not deceptive advertising)

Example: "Choose candidate from company I recognize (Google, Amazon) over unknown startup"

Option B: Take-the-Best Heuristic

Most important criterion: [What single factor best predicts outcome?]

Rule: Choose the option that scores best on this criterion alone. Ignore other factors.

Example: "For hiring engineers, use 'coding test score' only. Ignore school, years experience, personality."

Cue validity: [How often does this criterion predict success? Aim for >70%]

Option C: Satisficing

Minimum acceptable threshold: [What criteria must be met?]

Criterion Minimum Notes
[Criterion 1] [Threshold] [e.g., "Coding score ≥80%"]
[Criterion 2] [Threshold] [e.g., "Experience ≥2 years"]
[Criterion 3] [Threshold] [e.g., "Culture fit ≥7/10"]

Rule: Choose first option that meets ALL thresholds. Stop searching.

Search budget: [How many options to evaluate before lowering threshold? e.g., "Evaluate 3 candidates, if none meet threshold, adjust."]

Option D: Fast & Frugal Tree

Decision tree:

Question 1: [Binary question, e.g., "Is deal >$10k?"]
├─ Yes → [Action A or Question 2]
└─ No → [Action B]

Question 2: [Next binary question]
├─ Yes → [Action C]
└─ No → [Action D]

Example (Customer routing):

Is customer enterprise (>1000 employees)?
├─ Yes → Assign senior rep
└─ No → Is deal value >$10k?
    ├─ Yes → Assign mid-level rep
    └─ No → Self-serve flow

Step 3: Define Exceptions

When this heuristic should NOT be used:

  • [Condition 1: e.g., "Novel situation with no precedent"]
  • [Condition 2: e.g., "Stakes >$100k (requires full analysis)"]
  • [Condition 3: e.g., "Adversarial environment (deception likely)"]

Checklist Design Template

Step 1: Identify Critical Steps

Procedure: [What process needs a checklist?]

Brainstorm all steps (comprehensive list first):

  1. [Step 1]
  2. [Step 2]
  3. [Step 3] ...

Filter to critical steps (keep only steps that meet ≥1 criterion):

  • Often skipped (easy to forget)
  • Serious consequences if missed (failures, errors, safety risks)
  • Not immediately obvious (requires deliberate check)

Critical steps (5-10 items max):

  1. [Critical step 1]
  2. [Critical step 2]
  3. [Critical step 3]
  4. [Critical step 4]
  5. [Critical step 5]

Step 2: Choose Checklist Format

Format: [READ-DO / DO-CONFIRM / Challenge-Response]

Guidance:

  • READ-DO: Novices, unfamiliar procedures, irreversible actions
  • DO-CONFIRM: Experts, routine procedures, familiar tasks
  • Challenge-Response: Two-person verification for high-stakes

Step 3: Write Checklist

Checklist title: [e.g., "Software Deployment Pre-Flight Checklist"]

Pause points: [When to use this checklist?]

  • Before: [e.g., "Before initiating deployment"]
  • During: [e.g., "After migration, before going live"]
  • After: [e.g., "Post-deployment verification"]

Format template (READ-DO):

[CHECKLIST TITLE]

☐ [Verb-first action 1]
   └─ [Specific detail or criteria if needed]

☐ [Verb-first action 2]

⚠ [KILLER ITEM - must pass to proceed]

☐ [Verb-first action 3]

☐ [Verb-first action 4]

☐ [Verb-first action 5]

All items checked → Proceed with [next phase]

Format template (DO-CONFIRM):

[CHECKLIST TITLE]

Perform procedure from memory, then confirm each item:

☐ [Action 1 completed?]
☐ [Action 2 completed?]
☐ [Action 3 completed?]
☐ [Action 4 completed?]
☐ [Action 5 completed?]

All confirmed → Procedure complete

Example Heuristics

Example 1: Hiring Decision (Satisficing)

Decision: Choose job candidate from pool

Satisficing threshold:

Criterion Minimum
Technical skills (coding test) ≥75%
Communication (interview rating) ≥7/10
Culture fit (team feedback) ≥7/10
Reference check Positive

Rule: Evaluate candidates in order received. First candidate meeting ALL thresholds → Hire immediately. Don't keep searching for "perfect" candidate.

Search budget: If first 5 candidates don't meet threshold, lower bar to 70% technical (but keep other criteria).

Example 2: Investment Decision (Take-the-Best)

Decision: Which startup to invest in?

Most predictive criterion: Founder track record (prior exits or significant roles)

Rule: Rank startups by founder quality alone. Invest in top 2. Ignore market size, product, traction (assume cue validity of founder >70%).

Validation: Test on past investments. If founder track record predicts success <70% of time, switch to different criterion.

Example 3: Customer Triage (Fast & Frugal Tree)

Decision: How to route incoming customer inquiry?

Tree:

Is customer enterprise (>1000 employees)?
├─ Yes → Assign to senior account exec (immediate response)
└─ No → Is issue billing/payment?
    ├─ Yes → Assign to finance team
    └─ No → Is trial user (not paid)?
        ├─ Yes → Self-serve knowledge base
        └─ No → Assign to support queue (24h SLA)

Example Checklists

Example 1: Software Deployment (READ-DO)

Software Deployment Pre-Flight Checklist

☐ All tests passing
   └─ Unit, integration, E2E tests green

⚠ Database migrations tested on staging
   └─ KILLER ITEM - Deployment blocked if migrations fail

☐ Rollback plan documented
   └─ Link to runbook: [URL]

☐ Monitoring dashboards configured
   └─ Alerts set for error rate, latency, traffic

☐ On-call engineer identified and notified
   └─ Name: [___], Phone: [___]

☐ Stakeholders notified of deployment window
   └─ Email sent with timing and impact

☐ Feature flags configured
   └─ Gradual rollout enabled (10% → 50% → 100%)

☐ Backups completed
   └─ Database backup timestamp: [___]

All items checked → Proceed with deployment

Example 2: Aviation Pre-Flight (DO-CONFIRM)

Pre-Flight Checklist (DO-CONFIRM)

Perform checks, then confirm:

☐ Fuel quantity verified (visual + gauge)
☐ Flaps freedom of movement checked
☐ Landing gear visual inspection complete
☐ Oil level within limits
☐ Control surfaces free and correct
☐ Instruments verified (altimeter, compass, airspeed)
☐ Seatbelts and harness secured
☐ Flight plan filed

All confirmed → Cleared for takeoff

Example 3: Surgical Safety (WHO Checklist - Challenge/Response)

WHO Surgical Safety Checklist - Time Out (Before Incision)

[Entire team pauses, nurse reads aloud, surgeon confirms each]

☐ Confirm patient identity
   Response: "Name: [___], DOB: [___]"

☐ Confirm surgical site and procedure
   Response: "Site marked, procedure: [___]"

☐ Anticipated critical events reviewed
   Response: "Surgeon: [Key steps], Anesthesia: [Concerns], Nursing: [Equipment ready]"

☐ Antibiotic prophylaxis given within 60 min
   Response: "Administered at [time]"

☐ Essential imaging displayed
   Response: "[X-ray/MRI] displayed and reviewed"

All confirmed → Surgeon may proceed with incision

Application & Monitoring Template

Applying Heuristic

Heuristic being applied: [Name of rule]

Case log:

Date Decision Heuristic Used Outcome Notes
[Date] [What decided] [Which rule] [Good / Bad] [What happened]
[Date] [What decided] [Which rule] [Good / Bad] [What happened]

Success rate: [X good outcomes / Y total decisions = Z%]

Goal: ≥80% good outcomes. If <80%, refine heuristic.

Applying Checklist

Checklist being applied: [Name of checklist]

Usage log:

Date Procedure Items Caught Errors Prevented Time Added
[Date] [What done] [# items flagged] [What would've failed] [+X min]
[Date] [What done] [# items flagged] [What would've failed] [+X min]

Error rate:

  • Before checklist: [X% failure rate]
  • After checklist: [Y% failure rate]
  • Improvement: [(X-Y)/X × 100]% reduction

Refinement Log Template

Iteration: [#1, #2, #3...]

Date: [When refined]

Problem identified: [What went wrong? When did heuristic/checklist fail?]

Root cause: [Why did it fail?]

  • Heuristic: Wrong criterion chosen, threshold too high/low, environment changed
  • Checklist: Missing critical step, too long (skipped), wrong format for user

Refinement made:

  • Before: [Old rule/checklist]
  • After: [New rule/checklist]
  • Rationale: [Why this change should help]

Test plan: [How to validate refinement? Test on X cases, monitor for Y weeks]

Outcome: [Did refinement improve performance? Yes/No, by how much?]