399 lines
14 KiB
Markdown
399 lines
14 KiB
Markdown
# Ethics, Safety & Impact Assessment Templates
|
||
|
||
Quick-start templates for stakeholder mapping, harm/benefit analysis, fairness evaluation, risk prioritization, mitigation planning, and monitoring.
|
||
|
||
## Workflow
|
||
|
||
```
|
||
Ethics & Safety Assessment Progress:
|
||
- [ ] Step 1: Map stakeholders and identify vulnerable groups
|
||
- [ ] Step 2: Analyze potential harms and benefits
|
||
- [ ] Step 3: Assess fairness and differential impacts
|
||
- [ ] Step 4: Evaluate severity and likelihood
|
||
- [ ] Step 5: Design mitigations and safeguards
|
||
- [ ] Step 6: Define monitoring and escalation protocols
|
||
```
|
||
|
||
**Step 1: Map stakeholders and identify vulnerable groups**
|
||
|
||
Use [Stakeholder Mapping Template](#stakeholder-mapping-template) to identify all affected parties and prioritize vulnerable populations.
|
||
|
||
**Step 2: Analyze potential harms and benefits**
|
||
|
||
Brainstorm harms and benefits for each stakeholder group using [Harm/Benefit Analysis Template](#harmbenefit-analysis-template).
|
||
|
||
**Step 3: Assess fairness and differential impacts**
|
||
|
||
Evaluate outcome, treatment, and access disparities using [Fairness Assessment Template](#fairness-assessment-template).
|
||
|
||
**Step 4: Evaluate severity and likelihood**
|
||
|
||
Prioritize risks using [Risk Matrix Template](#risk-matrix-template) scoring severity and likelihood.
|
||
|
||
**Step 5: Design mitigations and safeguards**
|
||
|
||
Plan interventions using [Mitigation Planning Template](#mitigation-planning-template) for high-priority harms.
|
||
|
||
**Step 6: Define monitoring and escalation protocols**
|
||
|
||
Set up ongoing oversight using [Monitoring Framework Template](#monitoring-framework-template).
|
||
|
||
---
|
||
|
||
## Stakeholder Mapping Template
|
||
|
||
### Primary Stakeholders (directly affected)
|
||
|
||
**Group 1**: [Name of stakeholder group]
|
||
- **Size/reach**: [How many people?]
|
||
- **Relationship**: [How do they interact with feature/decision?]
|
||
- **Power/voice**: [Can they advocate for themselves? High/Medium/Low]
|
||
- **Vulnerability factors**: [Age, disability, marginalization, economic precarity, etc.]
|
||
- **Priority**: [High/Medium/Low risk]
|
||
|
||
**Group 2**: [Name of stakeholder group]
|
||
- **Size/reach**:
|
||
- **Relationship**:
|
||
- **Power/voice**:
|
||
- **Vulnerability factors**:
|
||
- **Priority**:
|
||
|
||
[Add more groups as needed]
|
||
|
||
### Secondary Stakeholders (indirectly affected)
|
||
|
||
**Group**: [Name]
|
||
- **How affected**: [Indirect impact mechanism]
|
||
- **Priority**: [High/Medium/Low risk]
|
||
|
||
### Societal/Systemic Impacts
|
||
|
||
- **Norms affected**: [What behaviors/expectations might shift?]
|
||
- **Precedents set**: [What does this enable or legitimize for future?]
|
||
- **Long-term effects**: [Cumulative, feedback loops, structural changes]
|
||
|
||
### Vulnerable Groups Prioritization
|
||
|
||
Check all that apply and note specific considerations:
|
||
|
||
- [ ] **Children** (<18): Special protections needed (consent, safety, development impact)
|
||
- [ ] **Elderly** (>65): Accessibility, digital literacy, vulnerability to fraud
|
||
- [ ] **People with disabilities**: Accessibility compliance, exclusion risk, safety
|
||
- [ ] **Racial/ethnic minorities**: Historical discrimination, disparate impact, cultural sensitivity
|
||
- [ ] **Low-income**: Economic harm, access barriers, inability to absorb costs
|
||
- [ ] **LGBTQ+**: Safety in hostile contexts, privacy, outing risk
|
||
- [ ] **Non-English speakers**: Language barriers, exclusion, misunderstanding
|
||
- [ ] **Politically targeted**: Dissidents, journalists, activists (surveillance, safety)
|
||
- [ ] **Other**: [Specify]
|
||
|
||
**Highest priority groups** (most vulnerable + highest risk):
|
||
1.
|
||
2.
|
||
3.
|
||
|
||
---
|
||
|
||
## Harm/Benefit Analysis Template
|
||
|
||
For each stakeholder group, identify potential harms and benefits.
|
||
|
||
### Stakeholder Group: [Name]
|
||
|
||
#### Potential Benefits
|
||
|
||
**Benefit 1**: [Description]
|
||
- **Type**: Economic, Social, Health, Autonomy, Access, Safety, etc.
|
||
- **Magnitude**: [High/Medium/Low]
|
||
- **Distribution**: [Who gets this benefit? Everyone or subset?]
|
||
- **Timeline**: [Immediate, Short-term <1yr, Long-term >1yr]
|
||
|
||
**Benefit 2**: [Description]
|
||
- **Type**:
|
||
- **Magnitude**:
|
||
- **Distribution**:
|
||
- **Timeline**:
|
||
|
||
#### Potential Harms
|
||
|
||
**Harm 1**: [Description]
|
||
- **Type**: Physical, Psychological, Economic, Social, Autonomy, Privacy, Reputational, Epistemic, Political
|
||
- **Mechanism**: [How does harm occur?]
|
||
- **Affected subgroup**: [Everyone or specific subset within stakeholder group?]
|
||
- **Severity**: [1-5, where 5 = catastrophic]
|
||
- **Likelihood**: [1-5, where 5 = very likely]
|
||
- **Risk Score**: [Severity × Likelihood]
|
||
|
||
**Harm 2**: [Description]
|
||
- **Type**:
|
||
- **Mechanism**:
|
||
- **Affected subgroup**:
|
||
- **Severity**:
|
||
- **Likelihood**:
|
||
- **Risk Score**:
|
||
|
||
**Harm 3**: [Description]
|
||
- **Type**:
|
||
- **Mechanism**:
|
||
- **Affected subgroup**:
|
||
- **Severity**:
|
||
- **Likelihood**:
|
||
- **Risk Score**:
|
||
|
||
#### Second-Order Effects
|
||
|
||
- **Feedback loops**: [Does harm create conditions for more harm?]
|
||
- **Accumulation**: [Do small harms compound over time?]
|
||
- **Normalization**: [Does this normalize harmful practices?]
|
||
- **Precedent**: [What does this enable others to do?]
|
||
|
||
---
|
||
|
||
## Fairness Assessment Template
|
||
|
||
### Outcome Fairness (results)
|
||
|
||
**Metric being measured**: [e.g., approval rate, error rate, recommendation quality]
|
||
|
||
**By group**:
|
||
|
||
| Group | Metric Value | Difference from Average | Disparate Impact Ratio |
|
||
|-------|--------------|-------------------------|------------------------|
|
||
| Group A | | | |
|
||
| Group B | | | |
|
||
| Group C | | | |
|
||
| Overall | | - | - |
|
||
|
||
**Disparate Impact Ratio** = (Outcome rate for protected group) / (Outcome rate for reference group)
|
||
- **> 0.8**: Generally acceptable (80% rule)
|
||
- **< 0.8**: Potential disparate impact, investigate
|
||
|
||
**Questions**:
|
||
- [ ] Are outcome rates similar across groups (within 20%)?
|
||
- [ ] If not, is there a legitimate justification?
|
||
- [ ] Do error rates (false positives/negatives) differ across groups?
|
||
- [ ] Who bears the burden of errors?
|
||
|
||
### Treatment Fairness (process)
|
||
|
||
**How decisions are made**: [Algorithm, human judgment, hybrid]
|
||
|
||
**By group**:
|
||
|
||
| Group | Treatment Description | Dignity/Respect | Transparency | Recourse |
|
||
|-------|----------------------|-----------------|--------------|----------|
|
||
| Group A | | High/Med/Low | High/Med/Low | High/Med/Low |
|
||
| Group B | | High/Med/Low | High/Med/Low | High/Med/Low |
|
||
|
||
**Questions**:
|
||
- [ ] Do all groups receive same quality of service/interaction?
|
||
- [ ] Are decisions explained equally well to all groups?
|
||
- [ ] Do all groups have equal access to appeals/recourse?
|
||
- [ ] Are there cultural or language barriers affecting treatment?
|
||
|
||
### Access Fairness (opportunity)
|
||
|
||
**Barriers to access**:
|
||
|
||
| Barrier Type | Description | Affected Groups | Severity |
|
||
|--------------|-------------|-----------------|----------|
|
||
| Economic | [e.g., cost, credit required] | | High/Med/Low |
|
||
| Technical | [e.g., device, internet, literacy] | | High/Med/Low |
|
||
| Geographic | [e.g., location restrictions] | | High/Med/Low |
|
||
| Physical | [e.g., accessibility, disability] | | High/Med/Low |
|
||
| Social | [e.g., stigma, discrimination] | | High/Med/Low |
|
||
| Legal | [e.g., documentation required] | | High/Med/Low |
|
||
|
||
**Questions**:
|
||
- [ ] Can all groups access the service/benefit equally?
|
||
- [ ] Are there unnecessary barriers that could be removed?
|
||
- [ ] Do barriers disproportionately affect vulnerable groups?
|
||
|
||
### Intersectionality Check
|
||
|
||
**Combinations of identities that may face unique harms**:
|
||
- Example: Black women (face both racial and gender bias)
|
||
- Example: Elderly immigrants (language + digital literacy + age)
|
||
|
||
Groups to check:
|
||
- [ ] Intersection of race and gender
|
||
- [ ] Intersection of disability and age
|
||
- [ ] Intersection of income and language
|
||
- [ ] Other combinations: [Specify]
|
||
|
||
---
|
||
|
||
## Risk Matrix Template
|
||
|
||
Score each harm on Severity (1-5) and Likelihood (1-5). Prioritize high-risk (red/orange) harms for mitigation.
|
||
|
||
### Severity Scale
|
||
|
||
- **5 - Catastrophic**: Death, serious injury, irreversible harm, widespread impact
|
||
- **4 - Major**: Significant harm, lasting impact, affects many people
|
||
- **3 - Moderate**: Noticeable harm, temporary impact, affects some people
|
||
- **2 - Minor**: Small harm, easily reversed, affects few people
|
||
- **1 - Negligible**: Minimal harm, no lasting impact
|
||
|
||
### Likelihood Scale
|
||
|
||
- **5 - Very Likely**: >75% chance, expected to occur
|
||
- **4 - Likely**: 50-75% chance, probable
|
||
- **3 - Possible**: 25-50% chance, could happen
|
||
- **2 - Unlikely**: 5-25% chance, improbable
|
||
- **1 - Rare**: <5% chance, very unlikely
|
||
|
||
### Risk Matrix
|
||
|
||
| Harm | Stakeholder Group | Severity | Likelihood | Risk Score | Priority |
|
||
|------|------------------|----------|------------|------------|----------|
|
||
| [Harm 1 description] | [Group] | [1-5] | [1-5] | [S×L] | [Color] |
|
||
| [Harm 2 description] | [Group] | [1-5] | [1-5] | [S×L] | [Color] |
|
||
| [Harm 3 description] | [Group] | [1-5] | [1-5] | [S×L] | [Color] |
|
||
|
||
**Priority Color Coding**:
|
||
- **Red** (Risk ≥15): Critical, must address before launch
|
||
- **Orange** (Risk 9-14): High priority, address soon
|
||
- **Yellow** (Risk 5-8): Monitor, mitigate if feasible
|
||
- **Green** (Risk ≤4): Low priority, document and monitor
|
||
|
||
**Prioritized Harms** (Red + Orange):
|
||
1. [Highest risk harm]
|
||
2. [Second highest]
|
||
3. [Third highest]
|
||
|
||
---
|
||
|
||
## Mitigation Planning Template
|
||
|
||
For each high-priority harm, design interventions.
|
||
|
||
### Harm: [Description of harm being mitigated]
|
||
|
||
**Affected Group**: [Who experiences this harm]
|
||
|
||
**Risk Score**: [Severity × Likelihood = X]
|
||
|
||
#### Mitigation Strategies
|
||
|
||
**Option 1: [Mitigation name]**
|
||
- **Type**: Prevent, Reduce, Detect, Respond, Safeguard, Transparency, Empower
|
||
- **Description**: [What is the intervention?]
|
||
- **Effectiveness**: [How much does this reduce risk? High/Medium/Low]
|
||
- **Cost/effort**: [Resources required? High/Medium/Low]
|
||
- **Tradeoffs**: [What are downsides or tensions?]
|
||
- **Owner**: [Who is responsible for implementation?]
|
||
- **Timeline**: [By when?]
|
||
|
||
**Option 2: [Mitigation name]**
|
||
- **Type**:
|
||
- **Description**:
|
||
- **Effectiveness**:
|
||
- **Cost/effort**:
|
||
- **Tradeoffs**:
|
||
- **Owner**:
|
||
- **Timeline**:
|
||
|
||
**Recommended Approach**: [Which option(s) to pursue and why]
|
||
|
||
#### Residual Risk
|
||
|
||
After mitigation:
|
||
- **New severity**: [1-5]
|
||
- **New likelihood**: [1-5]
|
||
- **New risk score**: [S×L]
|
||
|
||
**Acceptable?**
|
||
- [ ] Yes, residual risk is acceptable given tradeoffs
|
||
- [ ] No, need additional mitigations
|
||
- [ ] Escalate to [ethics committee/leadership/etc.]
|
||
|
||
#### Implementation Checklist
|
||
|
||
- [ ] Design changes specified
|
||
- [ ] Testing plan includes affected groups
|
||
- [ ] Documentation updated (policies, help docs, disclosures)
|
||
- [ ] Training provided (if human review/moderation involved)
|
||
- [ ] Monitoring metrics defined (see next template)
|
||
- [ ] Review date scheduled (when to reassess)
|
||
|
||
---
|
||
|
||
## Monitoring Framework Template
|
||
|
||
### Outcome Metrics
|
||
|
||
Track actual impacts post-launch to detect harms early.
|
||
|
||
**Metric 1**: [Metric name, e.g., "Approval rate parity"]
|
||
- **Definition**: [Precisely what is measured]
|
||
- **Measurement method**: [How calculated, from what data]
|
||
- **Baseline**: [Current or expected value]
|
||
- **Target**: [Goal value]
|
||
- **Threshold for concern**: [Value that triggers action]
|
||
- **Disaggregation**: [Break down by race, gender, age, disability, etc.]
|
||
- **Frequency**: [Daily, weekly, monthly, quarterly]
|
||
- **Owner**: [Who tracks and reports this]
|
||
|
||
**Metric 2**: [Metric name]
|
||
- Definition, method, baseline, target, threshold, disaggregation, frequency, owner
|
||
|
||
**Metric 3**: [Metric name]
|
||
- Definition, method, baseline, target, threshold, disaggregation, frequency, owner
|
||
|
||
### Leading Indicators & Qualitative Monitoring
|
||
|
||
- **Indicator 1**: [e.g., "User reports spike"] - Threshold: [level]
|
||
- **Indicator 2**: [e.g., "Declining engagement Group Y"] - Threshold: [level]
|
||
- **User feedback**: Channels for reporting concerns
|
||
- **Community listening**: Forums, social media, support tickets
|
||
- **Affected group outreach**: Check-ins with vulnerable communities
|
||
|
||
### Escalation Protocol
|
||
|
||
**Yellow Alert** (early warning):
|
||
- **Trigger**: [e.g., Metric exceeds threshold by 10-20%]
|
||
- **Response**: Investigate, analyze patterns, prepare report
|
||
|
||
**Orange Alert** (concerning):
|
||
- **Trigger**: [e.g., Metric exceeds threshold by >20%, or multiple yellow alerts]
|
||
- **Response**: Escalate to product/ethics team, begin mitigation planning
|
||
|
||
**Red Alert** (critical):
|
||
- **Trigger**: [e.g., Serious harm reported, disparate impact >20%, safety incident]
|
||
- **Response**: Escalate to leadership, pause rollout or rollback, immediate remediation
|
||
|
||
**Escalation Path**:
|
||
1. First escalation: [Role/person]
|
||
2. If unresolved or critical: [Role/person]
|
||
3. Final escalation: [Ethics committee, CEO, board]
|
||
|
||
### Review Cadence
|
||
|
||
- **Daily**: Critical safety metrics (safety-critical systems only)
|
||
- **Weekly**: User complaints, support tickets
|
||
- **Monthly**: Outcome metrics, disparate impact dashboard
|
||
- **Quarterly**: Comprehensive fairness audit
|
||
- **Annually**: External audit, stakeholder consultation
|
||
|
||
### Audit & Accountability
|
||
|
||
- **Audits**: Internal (who, frequency), external (independent, when)
|
||
- **Transparency**: What disclosed, where published
|
||
- **Affected group consultation**: How vulnerable groups involved in oversight
|
||
|
||
---
|
||
|
||
## Complete Assessment Template
|
||
|
||
Full documentation structure combines all above templates:
|
||
|
||
1. **Context**: Feature/decision description, problem, alternatives
|
||
2. **Stakeholder Analysis**: Use Stakeholder Mapping Template
|
||
3. **Harm & Benefit Analysis**: Use Harm/Benefit Analysis Template for each group
|
||
4. **Fairness Assessment**: Use Fairness Assessment Template (outcome/treatment/access)
|
||
5. **Risk Prioritization**: Use Risk Matrix Template, identify critical harms
|
||
6. **Mitigation Plan**: Use Mitigation Planning Template for each critical harm
|
||
7. **Monitoring & Escalation**: Use Monitoring Framework Template
|
||
8. **Decision**: Proceed/staged rollout/delay/reject with rationale and sign-off
|
||
9. **Post-Launch Review**: 30-day, 90-day checks, ongoing monitoring, updates
|